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Preface 


Through six editions now. Mathematical Methods for Physicists has provided all the math¬ 
ematical methods that aspirings scientists and engineers are likely to encounter as students 
and beginning researchers. More than enough material is included for a two-semester un¬ 
dergraduate or graduate course. 

The book is advanced in the sense that mathematical relations are almost always proven, 
in addition to being illustrated in terms of examples. These proofs are not what a mathe¬ 
matician would regard as rigorous, but sketch the ideas and emphasize the relations that 
are essential to the study of physics and related fields. This approach incorporates theo¬ 
rems that are usually not cited under the most general assumptions, but are tailored to the 
more restricted applications required by physics. For example, Stokes’ theorem is usually 
applied by a physicist to a surface with the tacit understanding that it be simply connected. 
Such assumptions have been made more explicit. 

Problem-Solving Skills 

The book also incorporates a deliberate focus on problem-solving skills. This more ad¬ 
vanced level of understanding and active learning is routine in physics courses and requires 
practice by the reader. Accordingly, extensive problem sets appearing in each chapter form 
an integral part of the book. They have been carefully reviewed, revised and enlarged for 
this Sixth Edition. 

Pathways Through the Material 

Undergraduates may be best served if they start by reviewing Chapter 1 according to the 
level of training of the class. Section 1.2 on the transformation properties of vectors, the 
cross product, and the invariance of the scalar product under rotations may be postponed 
until tensor analysis is started, for which these sections form the introduction and serve as 
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examples. They may continue their studies with linear algebra in Chapter 3, then perhaps 
tensors and symmetries (Chapters 2 and 4), and next real and complex analysis (Chap¬ 
ters 5-7), differential equations (Chapters 9, 10), and special functions (Chapters 11-13). 

In general, the core of a graduate one-semester course comprises Chapters 5-10 and 
11-13, which deal with real and complex analysis, differential equations, and special func¬ 
tions. Depending on the level of the students in a course, some linear algebra in Chapter 3 
(eigenvalues, for example), along with symmetries (group theory in Chapter 4), and ten¬ 
sors (Chapter 2) may be covered as needed or according to taste. Group theory may also be 
included with differential equations (Chapters 9 and 10). Appropriate relations have been 
included and are discussed in Chapters 4 and 9. 

A two-semester course can treat tensors, group theory, and special functions (Chap¬ 
ters 11-13) more extensively, and add Fourier series (Chapter 14), integral transforms 
(Chapter 15), integral equations (Chapter 16), and the calculus of variations (Chapter 17). 

Changes to the Sixth Edition 

Improvements to the Sixth Edition have been made in nearly all chapters adding examples 
and problems and more derivations of results. Numerous left-over typos caused by scan¬ 
ning into LaTeX, an error-prone process at the rate of many errors per page, have been 
corrected along with mistakes, such as in the Dirac /-matrices in Chapter 3. A few chap¬ 
ters have been relocated. The Gamma function is now in Chapter 8 following Chapters 6 
and 7 on complex functions in one variable, as it is an application of these methods. Dif¬ 
ferential equations are now in Chapters 9 and 10. A new chapter on probability has been 
added, as well as new subsections on differential forms and Mathieu functions in response 
to persistent demands by readers and students over the years. The new subsections are 
more advanced and are written in the concise style of the book, thereby raising its level to 
the graduate level. Many examples have been added, for example in Chapters 1 and 2, that 
are often used in physics or are standard lore of physics courses. A number of additions 
have been made in Chapter 3, such as on linear dependence of vectors, dual vector spaces 
and spectral decomposition of symmetric or Hermitian matrices. A subsection on the dif¬ 
fusion equation emphasizes methods to adapt solutions of partial differential equations to 
boundary conditions. New formulas have been developed for Hermite polynomials and are 
included in Chapter 13 that are useful for treating molecular vibrations; they are of interest 
to the chemical physicists. 
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We are grateful to them and to our Editors Barbara Holland and Tom Singer who organized 
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Chapter 1 


Vector Analysis 


1.1 Definitions, Elementary Approach 

In science and engineering we frequently encounter quantities that have magnitude and 
magnitude only: mass, time, and temperature. These we label scalar quantities, which re¬ 
main the same no matter what coordinates we use. In contrast, many interesting physical 
quantities have magnitude and, in addition, an associated direction. This second group 
includes displacement, velocity, acceleration, force, momentum, and angular momentum. 
Quantities with magnitude and direction are labeled vector quantities. Usually, in elemen¬ 
tary treatments, a vector is defined as a quantity having magnitude and direction. To dis¬ 
tinguish vectors from scalars, we identify vector quantities with boldface type, that is, V. 

Our vector may be conveniently represented by an arrow, with length proportional to the 
magnitude. The direction of the arrow gives the direction of the vector, the positive sense 
of direction being indicated by the point. In this representation, vector addition 

C = A + B (1.1) 

consists in placing the rear end of vector B at the point of vector A. Vector C is then 
represented by an arrow drawn from the rear of A to the point of B. This procedure, the 
triangle law of addition, assigns meaning to Eq. (1.1) and is illustrated in Fig. 1.1. By 
completing the parallelogram, we see that 

C = A + B = B + A, (1.2) 

as shown in Fig. 1.2. In words, vector addition is commutative. 

For the sum of three vectors 


D = A + B + C, 

Fig. 1.3, we may first add A and B: 

A + B = E. 


1 
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Figure 1.1 Triangle law of vector 
addition. 


B 



Figure 1.2 Parallelogram law of 
vector addition. 



Figure 1 .3 Vector addition is 
associative. 


Then this sum is added to C: 


D = E + C. 

Similarly, we may first add B and C: 

B + C = F. 


Then 


D = A + F. 


In terms of the original expression, 

(A + B) + C = A + (B + C). 


Vector addition is associative. 

A direct physical example of the parallelogram addition law is provided by a weight 
suspended by two cords. If the junction point (O in Fig. 1.4) is in equilibrium, the vector 
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Figure 1.4 Equilibrium of forces: Fi + F 2 = — F 3 . 


sum of the two forces F 1 and F 2 must just cancel the downward force of gravity, F 3 . Here 
the parallelogram addition law is subject to immediate experimental verification . 1 

Subtraction may be handled by defining the negative of a vector as a vector of the same 
magnitude but with reversed direction. Then 

A —B = A+(-B). 


In Fig. 1.3, 


A = E — B. 

Note that the vectors are treated as geometrical objects that are independent of any coor¬ 
dinate system. This concept of independence of a preferred coordinate system is developed 
in detail in the next section. 

The representation of vector A by an arrow suggests a second possibility. Arrow A 
(Fig. 1.5), starting from the origin , 2 terminates at the point (A*, A y , A z ). Thus, if we agree 
that the vector is to start at the origin, the positive end may be specified by giving the 
Cartesian coordinates (A x , A y , A z ) of the arrowhead. 

Although A could have represented any vector quantity (momentum, electric field, etc.), 
one particularly important vector quantity, the displacement from the origin to the point 


1 Strictly speaking, the parallelogram addition was introduced as a definition. Experiments show that if we assume that the 
forces are vector quantities and we combine them by parallelogram addition, the equilibrium condition of zero resultant force is 
satisfied. 

-We could start from any point in our Cartesian reference frame; we choose the origin for simplicity. This freedom of shifting 
the origin of the coordinate system without affecting the geometry is called translation invariance. 
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Figure 1.5 Cartesian components and direction cosines of A. 

(x, y, z), is denoted by the special symbol r. We then have a choice of referring to the dis¬ 
placement as either the vector r or the collection ( x, y, z), the coordinates of its endpoint: 

r +>(x,y,z). (1.3) 

Using r for the magnitude of vector r, we find that Fig. 1.5 shows that the endpoint coor¬ 
dinates and the magnitude are related by 

x — rcosa, y — r cos/3, z = rcosy. (1.4) 

Here cos a, cos fi, and cos y are called the direction cosines, a being the angle between the 
given vector and the positive x-axis, and so on. One further bit of vocabulary: The quan¬ 
tities A x , A y , and A z are known as the (Cartesian) components of A or the projections 
of A, with cos 2 a + cos 2 /S + cos 2 y — 1. 

Thus, any vector A may be resolved into its components (or projected onto the coordi¬ 
nate axes) to yield A x = A cos a, etc., as in Eq. (1.4). We may choose to refer to the vector 
as a single quantity A or to its components (A x , A y , A z ). Note that the subscript x in A x 
denotes the x component and not a dependence on the variable x. The choice between 
using A or its components (A x , A y , A z ) is essentially a choice between a geometric and 
an algebraic representation. Use either representation at your convenience. The geometric 
“arrow in space” may aid in visualization. The algebraic set of components is usually more 
suitable for precise numerical or algebraic calculations. 

Vectors enter physics in two distinct forms. (1) Vector A may represent a single force 
acting at a single point. The force of gravity acting at the center of gravity illustrates this 
form. (2) Vector A may be defined over some extended region; that is, A and its compo¬ 
nents may be functions of position: A x = A x (x, y, z), and so on. Examples of this sort 
include the velocity of a fluid varying from point to point over a given volume and electric 
and magnetic fields. These two cases may be distinguished by referring to the vector de¬ 
fined over a region as a vector field. The concept of the vector defined over a region and 
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being a function of position will become extremely important when we differentiate and 
integrate vectors. 

At this stage it is convenient to introduce unit vectors along each of the coordinate axes. 
Let x be a vector of unit magnitude pointing in the positive x-direction, y, a vector of unit 
magnitude in the positive y-direction, and z a vector of unit magnitude in the positive z- 
direction. Then xA x is a vector with magnitude equal to A x and in the x-direction. By 
vector addition, 


A = xA x + yA y + zA z . (1.5) 

Note that if A vanishes, all of its components must vanish individually; that is, if 
A = 0, then A x = A y = A z = 0. 

This means that these unit vectors serve as a basis, or complete set of vectors, in the three- 
dimensional Euclidean space in terms of which any vector can be expanded. Thus, Eq. (1.5) 
is an assertion that the three unit vectors x, y, and z span our real three-dimensional space: 
Any vector may be written as a linear combination of x, y, and z. Since x, y, and z are 
linearly independent (no one is a linear combination of the other two), they form a basis 
for the real three-dimensional Euclidean space. Finally, by the Pythagorean theorem, the 
magnitude of vector A is 


IAI — (A~ + A y + Az) 


2 \ 1/2 


( 1 . 6 ) 


Note that the coordinate unit vectors are not the only complete set, or basis. This resolution 
of a vector into its components can be carried out in a variety of coordinate systems, as 
shown in Chapter 2. Here we restrict ourselves to Cartesian coordinates, where the unit 
vectors have the coordinates x = (1,0, 0), y = (0,1,0) and z = (0,0, 1) and are all constant 
in length and direction, properties characteristic of Cartesian coordinates. 

As a replacement of the graphical technique, addition and subtraction of vectors may 
now be carried out in terms of their components. For A = xA x + yA y + z A z and B = 
xB x + yB y + z B z , 


A ± B = x(A, ± B x ) + y(A, ± B y ) + z (A. ± B z ). (1.7) 

It should be emphasized here that the unit vectors x, y, and z are used for convenience. 
They are not essential; we can describe vectors and use them entirely in terms of their 
components: A o- ( A x , A y , A -). This is the approach of the two more powerful, more 
sophisticated definitions of vector to be discussed in the next section. However, x, y, and 
z emphasize the direction. 

So far we have defined the operations of addition and subtraction of vectors. In the next 
sections, three varieties of multiplication will be defined on the basis of their applicability: 
a scalar, or inner, product, a vector product peculiar to three-dimensional space, and a 
direct, or outer, product yielding a second-rank tensor. Division by a vector is not defined. 
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Exercises 

1.1.1 Show how to find A and B, given A + B and A — B. 

1.1.2 The vector A whose magnitude is 1.732 units makes equal angles with the coordinate 
axes. Find A x , A y , and A z . 

1.1.3 Calculate the components of a unit vector that lies in the xy-plane and makes equal 
angles with the positive directions of the x- and y-axes. 

1.1.4 The velocity of sailboat A relative to sailboat B, v re i, is defined by the equation v re i = 
va ~ vb, where va is the velocity of A and v/; is the velocity of B. Determine the 
velocity of A relative to B if 

va = 30 km/hr east 
vB — 40 km/hr north. 

ANS. v re i = 50 km/hr, 53.1° south of east. 

1.1.5 A sailboat sails for 1 hr at 4 km/hr (relative to the water) on a steady compass heading 
of 40° east of north. The sailboat is simultaneously carried along by a current. At the 
end of the hour the boat is 6.12 km from its starting point. The line from its starting point 
to its location lies 60° east of north. Find the x (easterly) and y (northerly) components 
of the water’s velocity. 

ANS. i>east = 2.73 km/hr, i> nor th ^ 0 km/hr. 

1.1.6 A vector equation can be reduced to the form A = B. From this show that the one vector 
equation is equivalent to three scalar equations. Assuming the validity of Newton’s 
second law, F = ma, as a vector equation, this means that a x depends only on F x and 
is independent of F y and F-. 

1.1.7 The vertices A, B , and C of a triangle are given by the points (—1,0,2), (0, 1,0), and 
(1, —1,0), respectively. Find point D so that the figure ABCD forms a plane parallel¬ 
ogram. 

ANS. (0, -2, 2) or (2,0, -2). 

1.1.8 A triangle is defined by the vertices of three vectors A, B and C that extend from the 
origin. In terms of A, B, and C show that the vector sum of the successive sides of the 
triangle (AB + BC + CA ) is zero, where the side AB is from A to B, etc. 

1.1.9 A sphere of radius a is centered at a point rj . 

(a) Write out the algebraic equation for the sphere. 

(b) Write out a vector equation for the sphere. 

ANS. (a) (x - xi) 2 + (y - vi) 2 + (z - zi ) 2 = a 2 . 

(b) r = ri + a, with rj = center. 

(a takes on all directions but has a fixed magnitude a.) 
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1 . 1.10 A comer reflector is formed by three mutually perpendicular reflecting surfaces. Show 
that a ray of light incident upon the corner reflector (striking all three surfaces) is re¬ 
flected back along a line parallel to the line of incidence. 

Hint. Consider the effect of a reflection on the components of a vector describing the 
direction of the light ray. 

1.1.11 Hubble’s law. Hubble found that distant galaxies are receding with a velocity propor¬ 
tional to their distance from where we are on Earth. For the /th galaxy, 

v; = H 0 ri, 

with us at the origin. Show that this recession of the galaxies from us does not imply 
that we are at the center of the universe. Specifically, take the galaxy at ri as a new 
origin and show that Hubble’s law is still obeyed. 

1.1.12 Find the diagonal vectors of a unit cube with one corner at the origin and its three sides 
lying along Cartesian coordinates axes. Show that there are four diagonals with length 
V3. Representing these as vectors, what are their components? Show that the diagonals 
of the cube’s faces have length ~J2 and determine their components. 

1.2 Rotation of the Coordinate Axes 3 

In the preceding section vectors were defined or represented in two equivalent ways: 
(1) geometrically by specifying magnitude and direction, as with an arrow, and (2) al¬ 
gebraically by specifying the components relative to Cartesian coordinate axes. The sec¬ 
ond definition is adequate for the vector analysis of this chapter. In this section two more 
refined, sophisticated, and powerful definitions are presented. First, the vector field is de¬ 
fined in terms of the behavior of its components under rotation of the coordinate axes. This 
transformation theory approach leads into the tensor analysis of Chapter 2 and groups of 
transformations in Chapter 4. Second, the component definition of Section 1.1 is refined 
and generalized according to the mathematician’s concepts of vector and vector space. This 
approach leads to function spaces, including the Hilbert space. 

The definition of vector as a quantity with magnitude and direction is incomplete. On 
the one hand, we encounter quantities, such as elastic constants and index of refraction 
in anisotropic crystals, that have magnitude and direction but that are not vectors. On 
the other hand, our naive approach is awkward to generalize to extend to more complex 
quantities. We seek a new definition of vector field using our coordinate vector r as a 
prototype. 

There is a physical basis for our development of a new definition. We describe our phys¬ 
ical world by mathematics, but it and any physical predictions we may make must be 
independent of our mathematical conventions. 

In our specific case we assume that space is isotropic; that is, there is no preferred di¬ 
rection, or all directions are equivalent. Then the physical system being analyzed or the 
physical law being enunciated cannot and must not depend on our choice or orientation 
of the coordinate axes. Specifically, if a quantity S does not depend on the orientation of 
the coordinate axes, it is called a scalar. 

’’This section is optional here. It will be essential for Chapter 2. 
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Figure 1.6 Rotation of Cartesian coordinate axes about the z-axis. 

Now we return to the concept of vector r as a geometric object independent of the 
coordinate system. Let us look at r in two different systems, one rotated in relation to the 
other. 

For simplicity we consider first the two-dimensional case. If the x-, ^-coordinates are 
rotated counterclockwise through an angle <p, keeping r, fixed (Fig. 1.6), we get the fol¬ 
lowing relations between the components resolved in the original system (unprimed) and 
those resolved in the new rotated system (primed): 

x' = x cos (p + y simp, 

/ • . (. 1 * 0 / 
y = —x sin (p + y cos <p. 

We saw in Section 1.1 that a vector could be represented by the coordinates of a point; 
that is, the coordinates were proportional to the vector components. Hence the components 
of a vector must transform under rotation as coordinates of a point (such as r). Therefore 
whenever any pair of quantities A x and A y in the xy -coordinate system is transformed into 
(A' x , A' ) by this rotation of the coordinate system with 

K = A x cos(p -F Ay sin ip , ^ 

A' = — A x sin^> + A y cos <p, ' ' > 

we define 4 A x and A v as the components of a vector A. Our vector now is defined in terms 
of the transformation of its components under rotation of the coordinate system. If A x and 
A y transform in the same way as x and y, the components of the general two-dimensional 
coordinate vector r, they are the components of a vector A. If A x and A v do not show this 

1 A scalar quantity does not depend on the orientation of coordinates; S' = S expresses the fact that it is invariant under rotation 
of the coordinates. 
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form invariance (also called covariance) when the coordinates are rotated, they do not 
form a vector. 

The vector field components A x and A v satisfying the defining equations, Eqs. (1.9), as¬ 
sociate a magnitude A and a direction with each point in space. The magnitude is a scalar 
quantity, invariant to the rotation of the coordinate system. The direction (relative to the 
unprimed system) is likewise invariant to the rotation of the coordinate system (see Exer¬ 
cise 1.2.1). The result of all this is that the components of a vector may vary according to 
the rotation of the primed coordinate system. This is what Eqs. (1.9) say. But the variation 
with the angle is just such that the components in the rotated coordinate system A' x and A' 
define a vector with the same magnitude and the same direction as the vector defined by 
the components A x and A y relative to the x-, y-coordinate axes. (Compare Exercise 1.2.1.) 
The components of A in a particular coordinate system constitute the representation of 
A in that coordinate system. Equations (1.9), the transformation relations, are a guarantee 
that the entity A is independent of the rotation of the coordinate system. 

To go on to three and, later, four dimensions, we find it convenient to use a more compact 
notation. Let 



<7u = cos<p, fli 2 = sin<p, 


A 2 i = — sin <p. 


fl 22 = cos <p. 


( 1 . 10 ) 

(l.H) 


Then Eqs. (1.8) become 


Vj = flll-Vl + CI12X2, 

x' 2 — 021 X 1 +022X2- 


( 1 . 12 ) 


The coefficient fly may be interpreted as a direction cosine, the cosine of the angle between 
Xj and X j ; that is, 


fli 2 = cos(.Tj,* 2 ) = sin</>, 

a 2 i =cos(x 2 ,xi) = cos(^+ |j = — simp. 

The advantage of the new notation 5 is that it permits us to use the summation symbol ^ 
and to rewrite Eqs. (1.12) as 


2 

x'j — O-ijXj , 1 = 1,2. (1.14) 

j =1 

Note that i remains as a parameter that gives rise to one equation when it is set equal to 1 
and to a second equation when it is set equal to 2. The index j, of course, is a summation 
index, a dummy index, and, as with a variable of integration, j may be replaced by any 
other convenient symbol. 


5 You may wonder at the replacement of one parameter ip by four parameters ay. Clearly, the ay do not constitute a minimum 
set of parameters. For two dimensions the four ay are subject to the three constraints given in Eq. (1.18). The justification for 
this redundant set of direction cosines is the convenience it provides. Hopefully, this convenience will become more apparent 
in Chapters 2 and 3. For three-dimensional rotations (9 aij but only three independent) alternate descriptions are provided by: 
(1) the Euler angles discussed in Section 3.3, (2) quaternions, and (3) the Cayley-Klein parameters. These alternatives have their 
respective advantages and disadvantages. 
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The generalization to three, four, or N dimensions is now simple. The set of N quantities 
Vj is said to be the components of an /V-dimensional vector V if and only if their values 
relative to the rotated coordinate axes are given by 

N 

V! = J2 a U V J’ i = 1,2,..., N. (1.15) 

7=1 


As before, c/, ; is the cosine of the angle between x', and xj. Often the upper limit N and 
the corresponding range of i will not be indicated. It is taken for granted that you know 
how many dimensions your space has. 

From the definition of aij as the cosine of the angle between the positive x\ direction 
and the positive xj direction we may write (Cartesian coordinates) 6 


IJ ~ 

Using the inverse rotation {cp —*■ —<p) yields 

2 


C 7 = X/ 




dx'i 
3 Xj 


or 


i=i 


dxj_ 

dX; 


(1.16a) 


(1.16b) 


Note that these are partial derivatives. By use of Eqs. (1.16a) and (1.16b), Eq. (1.15) 
becomes 



The direction cosines aij satisfy an orthogonality condition 

^ ' ClijClik — Sjk 


or, equivalently. 


^ ' Oji Clki — Sjk ■ 


Here, the symbol Sjk is the Kronecker delta, defined by 


Sjk = 1 for j=k, 

Sjk = 0 for j / k. 


(1.17) 


(1.18) 


(1.19) 


( 1 . 20 ) 


It is easily verified that Eqs. (1.18) and (1.19) hold in the two-dimensional case by 

substituting in the specific cijj from Eqs. (1.11). The result is the well-known identity 

siir <p + cos 2 <p — 1 for the nonvanishing case. To verify Eq. (1.18) in general form, we 
may use the partial derivative forms of Eqs. (1.16a) and (1.16b) to obtain 

E d Xj dxk _9 Xj dx- _ dxj 

dX 1 , dx'- dx', dxk dxk 

i 1 1 i 1 


6 Differentiate x f - with respect to xj . See discussion following Eq. (1.21). 



1.2 Rotation of the Coordinate Axes 


11 


The last step follows by the standard rules for partial differentiation, assuming that xj is 
a function of x\ , x' 2 , x' 2 , and so on. The final result, 3 xj/dxk, is equal to 8 jk, since xj and 
Xk as coordinate lines ( j / k) are assumed to be perpendicular (two or three dimensions) 
or orthogonal (for any number of dimensions). Equivalently, we may assume that xj and 
Xk (j / k) are totally independent variables. If j — k, the partial derivative is clearly equal 
to 1. 

In redefining a vector in terms of how its components transform under a rotation of the 
coordinate system, we should emphasize two points: 

1. This definition is developed because it is useful and appropriate in describing our 
physical world. Our vector equations will be independent of any particular coordinate 
system. (The coordinate system need not even be Cartesian.) The vector equation can 
always be expressed in some particular coordinate system, and, to obtain numerical 
results, we must ultimately express the equation in some specific coordinate system. 

2. This definition is subject to a generalization that will open up the branch of mathemat¬ 
ics known as tensor analysis (Chapter 2). 

A qualification is in order. The behavior of the vector components under rotation of the 
coordinates is used in Section 1.3 to prove that a scalar product is a scalar, in Section 1.4 
to prove that a vector product is a vector, and in Section 1.6 to show that the gradient of a 
scalar i/r, Vi//, is a vector. The remainder of this chapter proceeds on the basis of the less 
restrictive definitions of the vector given in Section 1.1. 

Summary: Vectors and Vector Space 

It is customary in mathematics to label an ordered triple of real numbers (x i, X 2 , X 3 ) a 
vector x. The number x n is called the nth component of vector x. The collection of all 
such vectors (obeying the properties that follow) form a three-dimensional real vector 
space. We ascribe five properties to our vectors: If x = (x i, x ~2 , X3) and y = (vi, yi , >’ 3 ), 

1. Vector equality: x = y means x/ — y,-, i — 1,2, 3. 

2. Vector addition: x + y = z means x,- + y; — Zi,i — 1,2,3. 

3. Scalar multiplication: ax ** (ax 1 , ax 2 , 0x3) (with a real). 

4. Negative of a vector: — x = (— l)x o- (— x\, —X 2 , —X 3 ). 

5. Null vector: There exists a null vector 0 o- (0, 0,0). 

Since our vector components are real (or complex) numbers, the following properties 
also hold: 

1. Addition of vectors is commutative: x + y = y + x. 

2. Addition of vectors is associative: (x + y) + z = x + (y + z). 

3. Scalar multiplication is distributive: 

a(x + y) = ax + ay, also (a + b)x = ax + bx. 

4. Scalar multiplication is associative: (ab)x — a(bx). 
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Further, the null vector 0 is unique, as is the negative of a given vector x. 

So far as the vectors themselves are concerned this approach merely formalizes the com¬ 
ponent discussion of Section 1.1. The importance lies in the extensions, which will be con¬ 
sidered in later chapters. In Chapter 4, we show that vectors form both an Abelian group 
under addition and a linear space with the transformations in the linear space described by 
matrices. Finally, and perhaps most important, for advanced physics the concept of vectors 
presented here may be generalized to (1) complex quantities, 7 (2) functions, and (3) an infi¬ 
nite number of components. This leads to infinite-dimensional function spaces, the Hilbert 
spaces, which are important in modern quantum theory. A brief introduction to function 
expansions and Hilbert space appears in Section 10.4. 

Exercises 

1.2.1 (a) Show that the magnitude of a vector A, A — (A 7 + A 7 ) 1 / 2 , is independent of the 

orientation of the rotated coordinate system, 

(Al + Alf 2 = (Ai + 4) m . 

that is, independent of the rotation angle tp. 

This independence of angle is expressed by saying that A is invariant under 
rotations. 

(b) At a given point (x, y), A defines an angle a relative to the positive x-axis and 
a' relative to the positive x'-axis. The angle from x to x' is <p. Show that A — A! 
defines the same direction in space when expressed in terms of its primed compo¬ 
nents as in terms of its unprimed components; that is, 

a = a — (p. 

1.2.2 Prove the orthogonality condition JT «/,•«*/ = <5^. As a special case of this, the direc¬ 
tion cosines of Section 1.1 satisfy the relation 

cos 2 a + cos 2 p + cos 2 y = 1, 
a result that also follows from Eq. (1.6). 

1.3 Scalar or Dot Product 

Having defined vectors, we now proceed to combine them. The laws for combining vectors 
must be mathematically consistent. From the possibilities that are consistent we select two 
that are both mathematically and physically interesting. A third possibility is introduced in 
Chapter 2, in which we form tensors. 

The projection of a vector A onto a coordinate axis, which gives its Cartesian compo¬ 
nents in Eq. (1.4), defines a special geometrical case of the scalar product of A and the 
coordinate unit vectors: 

A x = A cos a = A • x, A v = Acos/3 = A • y, A z = A cos y = A • z. (1.22) 

7 The H-dimensional vector space of real «-tuples is often labeled R" and the »-dimensional vector space of complex //-tuples is 

labeled C". 
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This special case of a scalar product in conjunction with general properties the scalar prod¬ 
uct is sufficient to derive the general case of the scalar product. 

Just as the projection is linear in A, we want the scalar product of two vectors to be 
linear in A and B, that is, obey the distributive and associative laws 

A-(B + C)=A-B + A-C (1.23a) 

A- (yB) = (yA) • B = yA • B, (1.23b) 

where y is a number. Now we can use the decomposition of B into its Cartesian components 
according to Eq. (1.5), B = B x x + B v y + B z z, to construct the general scalar or dot product 
of the vectors A and B as 

A B = A • ( B x x + By y + B z z) 

= B x A • x + B v A • y + B z A • z upon applying Eqs. (1.23a) and (1.23b) 

= B X A X + By Ay + B Z A Z upon substituting Eq. (1.22). 

Hence 

(1.24) 

If A = B in Eq. (1.24), we recover the magnitude A = (]C A 2 )^ 2 of A in Eq. (1.6) from 
Eq. (1.24). 

It is obvious from Eq. (1.24) that the scalar product treats A and B alike, or is sym¬ 
metric in A and B, and is commutative. Thus, alternatively and equivalently, we can first 
generalize Eqs. (1.22) to the projection Ab of A onto the direction of a vector B ^ 0 
as Ag = A cos 9 = A • B, where B = R/B is the unit vector in the direction of B and 9 
is the angle between A and B, as shown in Fig. 1.7. Similarly, we project B onto A as 
Ba = B cos 9 = B • A. Second, we make these projections symmetric in A and B, which 
leads to the definition 

A-B = A b B = AB a — AB cos 9. (1.25) 

z 




Figure 1.7 Scalar product A • B = AB cos9. 
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Figure 1.8 The distributive law 
A • (B + C) = AB a + AC A = A (B + C) A . Eq. (1.23a). 


The distributive law in Eq. (1.23a) is illustrated in Fig. 1.8, which shows that the sum of 
the projections of B and C onto A, B,\ + Ca is equal to the projection of B + C onto A, 
(B + C ) A . 

It follows from Eqs. (1.22), (1.24), and (1.25) that the coordinate unit vectors satisfy the 
relations 


x-x = y-y = z-z=l, (1.26a) 

whereas 

x-y = x-z = y-z = 0. (1.26b) 

If the component definition, Eq. (1.24), is labeled an algebraic definition, then Eq. (1.25) 
is a geometric definition. One of the most common applications of the scalar product in 
physics is in the calculation of work = force displacement- cos 6, which is interpreted as 
displacement times the projection of the force along the displacement direction, i.e., the 
scalar product of force and displacement, W — F • S. 

If A • B = 0 and we know that A / 0 and B / 0, then, from Eq. (1.25), cos 0 — 0, or 
0 — 90°, 270°, and so on. The vectors A and B must be perpendicular. Alternately, we 
may say A and B are orthogonal. The unit vectors x, y, and z are mutually orthogonal. To 
develop this notion of orthogonality one more step, suppose that n is a unit vector and r is 
a nonzero vector in the xy-plane; that is, r = xx + yy (Fig. 1.9). If 

n • r = 0 

for all choices of r, then n must be perpendicular (orthogonal) to the xy-plane. 

Often it is convenient to replace x, y, and z by subscripted unit vectors e m , m = 1,2, 3, 
with x = ei, and so on. Then Eqs. (1.26a) and (1.26b) become 

Cm " C n = $mn- (1.26c) 

For m ^ n the unit vectors e m and e„ are orthogonal. For m — n each vector is normal¬ 
ized to unity, that is, has unit magnitude. The set e m is said to be orthonormal. A major 
advantage of Eq. (1.26c) over Eqs. (1.26a) and (1.26b) is that Eq. (1.26c) may readily be 
generalized to /V-dimensional space: m, n = 1,2,..., N. Finally, we are picking sets of 
unit vectors e m that are orthonormal for convenience - a very great convenience. 
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n 



Invariance of the Scalar Product Under Rotations 

We have not yet shown that the word scalar is justified or that the scalar product is indeed 
a scalar quantity. To do this, we investigate the behavior of A • B under a rotation of the 
coordinate system. By use of Eq. (1.15), 

A x B x + ^ v + A z B_ = y ^a x iAj Y] a XJ Bj + ’Y, a yi / ^i Y. a y.i B j 

i j < j 

y ' a zi Aj ) ' a z j Bj. (1-27) 

< j 

Using the indices k and / to sum over x, y, and z, we obtain 

J2 A 'k B 'k =EEE fl «^ s i’ ( L28 > 

k l i j 

and, by rearranging the terms on the right-hand side, we have 

E = = EEM'«, = Y a ' b '- ^ 

k l i j i j i 

The last two steps follow by using Eq. (1.18), the orthogonality condition of the direction 
cosines, and Eqs. (1.20), which define the Kronecker delta. The effect of the Kronecker 
delta is to cancel all terms in a summation over either index except the term for which the 
indices are equal. In Eq. (1.29) its effect is to set j = i and to eliminate the summation 
over j. Of course, we could equally well set i — j and eliminate the summation over i. 
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Equation (1.29) gives us 


£« = £^-> 


(1.30) 


which is just our definition of a scalar quantity, one that remains invariant under the rotation 
of the coordinate system. 

In a similar approach that exploits this concept of invariance, we take C = A + B and 
dot it into itself: 


C-C=(A + B)-(A + B) 


= AA + BB + 2AB. 


(1.31) 


Since 


C C = C 2 , (1.32) 

the square of the magnitude of vector C and thus an invariant quantity, we see that 

A B = l -(C 2 - A 2 - B 2 ), invariant. (1.33) 

Since the right-hand side of Eq. (1.33) is invariant — that is, a scalar quantity — the left- 
hand side, A • B, must also be invariant under rotation of the coordinate system. Hence 
A • B is a scalar. 

Equation (1.31) is really another form of the law of cosines, which is 

C 2 = A 2 + B 2 + 2AB cos 0. (1.34) 

Comparing Eqs. (1.31) and (1.34), we have another verification of Eq. (1.25), or, if pre¬ 
ferred, a vector derivation of the law of cosines (Fig. 1.10). 

The dot product, given by Eq. (1.24), may be generalized in two ways. The space need 
not be restricted to three dimensions. In «-dimensional space, Eq. (1.24) applies with the 
sum running from 1 to n. Moreover, n may be infinity, with the sum then a convergent infi¬ 
nite series (Section 5.2). The other generalization extends the concept of vector to embrace 
functions. The function analog of a dot, or inner, product appears in Section 10.4. 



Figure 1.10 The law of cosines. 
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Exercises 

1.3.1 Two unit magnitude vectors e, and e / are required to be either parallel or perpendicular 
to each other. Show that e,- • e, provides an interpretation of Eq. (1.18), the direction 
cosine orthogonality relation. 

1.3.2 Given that (1) the dot product of a unit vector with itself is unity and (2) this relation is 
valid in all (rotated) coordinate systems, show that x' • x' = I (with the primed system 
rotated 45° about the z-axis relative to the unprimed) implies that x • y = 0. 

1.3.3 The vector r, starting at the origin, terminates at and specifies the point in space (x,y,z). 
Find the surface swept out by the tip of r if 

(a) (r — a) • a = 0. Characterize a geometrically. 

(b) (r — a) • r = 0. Describe the geometric role of a. 

The vector a is constant (in magnitude and direction). 

1.3.4 The interaction energy between two dipoles of moments Mi and fi 2 may be written in 
the vector form 

v /G -/G> 3(Mi -r)(M 2 -r) 

" — r 3 ' r 5 

and in the scalar form 

/Cl/XT 

V = —(2 cos 9 1 cos 6 -j — sin 9\ sin 62 cos tp). 

r i 

Here 9\ and @2 are the angles of Mi and M 2 relative to r, while q> is the azimuth of M 2 
relative to the Mi _r plane (Fig. 1.11). Show that these two forms are equivalent. 

Hint: Equation (12.178) will be helpful. 

1.3.5 A pipe comes diagonally down the south wall of a building, making an angle of 45° 
with the horizontal. Coming into a corner, the pipe turns and continues diagonally down 
a west-facing wall, still making an angle of 45° with the horizontal. What is the angle 
between the south-wall and west-wall sections of the pipe? 

ANS. 120°. 

1.3.6 Find the shortest distance of an observer at the point (2, 1, 3) from a rocket in free 
flight with velocity (1,2, 3) m/s. The rocket was launched at time t — 0 from (1, 1, 1). 
Fengths are in kilometers. 

1.3.7 Prove the law of cosines from the triangle with corners at the point of C and A in 
Fig. 1.10 and the projection of vector B onto vector A. 



Figure 1.11 Two dipole moments. 
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1.4 Vector or Cross Product 


A second form of vector multiplication employs the sine of the included angle instead 
of the cosine. For instance, the angular momentum of a body shown at the point of the 
distance vector in Fig. 1.12 is defined as 

angular momentum = radius arm x linear momentum 

= distance x linear momentum x sin 0 . 


For convenience in treating problems relating to quantities such as angular momentum, 
torque, and angular velocity, we define the vector product, or cross product, as 


C = AxB, with C — AB sin#. 


(1.35) 


Unlike the preceding case of the scalar product, C is now a vector, and we assign it a 
direction perpendicular to the plane of A and B such that A, B, and C form a right-handed 
system. With this choice of direction we have 


AxB = — BxA, anticommutation. 

From this definition of cross product we have 

xxx = yxy = zxz = 0 , 


whereas 


xxy = z, yxz = x, zxx = y, 
yxx=—z, zxy=— x, x x z = —y. 


(1.36a) 

(1.36b) 

(1.36c) 


Among the examples of the cross product in mathematical physics are the relation between 
linear momentum p and angular momentum L, with L defined as 


L = r x p, 



Figure 1.12 Angular momentum. 
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Figure 1.13 Parallelogram representation of the vector product. 


and the relation between linear velocity v and angular velocity «, 

v = s)xr. 

Vectors v and p describe properties of the particle or physical system. However, the posi¬ 
tion vector r is determined by the choice of the origin of the coordinates. This means that 
oj and L depend on the choice of the origin. 

The familiar magnetic induction B is usually defined by the vector product force equa¬ 
tion 8 


= q\ x B (mks units). 

Here v is the velocity of the electric charge q and is the resulting force on the moving 
charge. 

The cross product has an important geometrical interpretation, which we shall use in 
subsequent sections. In the parallelogram defined by A and B (Fig. 1.13), B sin 0 is the 
height if A is taken as the length of the base. Then |A x B| = AB sin0 is the area of the 
parallelogram. As a vector, A x B is the area of the parallelogram defined by A and B, with 
the area vector normal to the plane of the parallelogram. This suggests that area (with its 
orientation in space) may be treated as a vector quantity. 

An alternate definition of the vector product can be derived from the special case of the 
coordinate unit vectors in Eqs. (1.36c) in conjunction with the linearity of the cross product 
in both vector arguments, in analogy with Eqs. (1.23) for the dot product. 


Ax (B + C)=AxB + AxC, 

(1.37a) 

(A + B)xC = AxC + BxC, 

(1.37b) 

A x (vB) = yA x B = (vA) x B, 

(1.37c) 


'The electric field E is assumed here to be zero. 
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where y is a number again. Using the decomposition of A and B into their Cartesian com¬ 
ponents according to Eq. (1.5), we find 



upon applying Eqs. (1.37a) and (1.37b) and substituting Eqs. (1.36a), (1.36b), and (1.36c) 
so that the Cartesian components of A x B become 

C x = A y B z — A z By, Cy — A Z B x — A X B Z , C z = A x By — AyB x , (1.38) 

or 

C, = AjBk — AjfBj, i, j. k all different, (1.39) 

and with cyclic permutation of the indices j, and k corresponding to x, y, and z, respec¬ 
tively. The vector product C may be mnemonically represented by a determinant, 9 



X 

y 

Z 

» A v 

A- 

» A v 

A- 

Av 

A„ 


c = 

A, 

B x 

A v 

By 

Aj 

B z 

= x y 
~ By 

Bz 

B, 

B z 

+ *B, 

y 

By * 

(1.40) 


which is meant to be expanded across the top row to reproduce the three components of C 
listed in Eqs. (1.38). 

Equation (1.35) might be called a geometric definition of the vector product. Then 
Eqs. (1.38) would be an algebraic definition. 

To show the equivalence of Eq. (1.35) and the component definition, Eqs. (1.38), let us 
form A • C and B • C, using Eqs. (1.38). We have 

A ■ C = A • (A x B) 

— A x (Ay B z — A z B y ) + Ay(A - B x — A X B Z ) + A z (A x B y — A y B x ) 

= 0. (1.41) 

Similarly, 

B ■ C = B • (A x B) = 0. (1.42) 

Equations (1.41) and (1.42) show that C is perpendicular to both A and B (cos 9 — 0,9 — 
±90°) and therefore perpendicular to the plane they determine. The positive direction is 
determined by considering special cases, such as the unit vectors x x y = z (C z = +A x B y ). 
The magnitude is obtained from 

(A x B) • (A x B) = A 2 B 2 - (A • B) 2 

= A 2 B 2 - A 2 B 2 cos 2 6 


l, See Section 3.1 for a brief summary of determinants. 


= A 2 B 2 sin 2 9. 


(1.43) 
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Hence 


C = AB sin(9. (1.44) 

The first step in Eq. (1.43) may be verified by expanding out in component form, using 
Eqs. (1.38) for A x B and Eq. (1.24) for the dot product. From Eqs. (1.41), (1.42), and 
(1.44) we see the equivalence of Eqs. (1.35) and (1.38), the two definitions of vector prod¬ 
uct. 

There still remains the problem of verifying that C = A x B is indeed a vector, that 
is, that it obeys Eq. (1.15), the vector transformation law. Starting in a rotated (primed 
system). 


C) = A'jB' k — A' k B'j, i, j, and k in cyclic order, 

~ ^ (l jl '3 / 'y ' &km Bm ^ @kl A / ^ ^ Ini B >n 

1 m l in 

— ^ ' (u jlCtkm Qkl a jm)AlB m . (1.45) 

The combination of direction cosines in parentheses vanishes for m — l. We therefore have 
j and k taking on fixed values, dependent on the choice of i, and six combinations of 
/ and in. If i — 3, then j — 1, k — 2 (cyclic order), and we have the following direction 
cosine combinations: 10 


«11«22 — A21«12 = A33> 

flt3Ci21 — ^23^11 — fl 32> (1-46) 

012^23 — 022^13 = ^31 

and their negatives. Equations (1.46) are identities satisfied by the direction cosines. They 
may be verified with the use of determinants and matrices (see Exercise 3.3.3). Substituting 
back into Eq. (1.45), 

C3 = 033^1 Bi + Q32A3B1 + Q31 A?Z?3 — a^A^Bi — a^AiBi — aj,iAj,B2 
= ^3\C\ + CI 32 C 2 + <733^3 

= X! fl 3 n C n- d-47) 

n 

By permuting indices to pick up C\ and C), we see that Eq. (1.15) is satisfied and C is 
indeed a vector. It should be mentioned here that this vector nature of the cross product 
is an accident associated with the three-dimensional nature of ordinary space. 11 It will be 
seen in Chapter 2 that the cross product may also be treated as a second-rank antisymmetric 
tensor. 


'^Equations (1.46) hold for rotations because they preserve volumes. For a more general orthogonal transformation, the r.h.s. of 
Eqs. (1.46) is multiplied by the determinant of the transformation matrix (see Chapter 3 for matrices and determinants). 

11 Specifically Eqs. (1.46) hold only for three-dimensional space. See D. Hestenes and G. Sobczyk, Clifford Algebra to Geometric 
Calculus (Dordrecht: Reidel, 1984) for a far-reaching generalization of the cross product. 
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If we define a vector as an ordered triplet of numbers (or functions), as in the latter part 
of Section 1.2, then there is no problem identifying the cross product as a vector. The cross- 
product operation maps the two triples A and B into a third triple, C, which by definition 
is a vector. 

We now have two ways of multiplying vectors; a third form appears in Chapter 2. But 
what about division by a vector? It turns out that the ratio B/A is not uniquely specified 
(Exercise 3.2.21) unless A and B are also required to be parallel. Hence division of one 
vector by another is not defined. 


Exercises 

1.4.1 Show that the medians of a triangle intersect in the center, which is 2/3 of the median’s 
length from each corner. Construct a numerical example and plot it. 

1.4.2 Prove the law of cosines starting from A 2 = (B — C) 2 . 

1.4.3 Starting with C = A + B, show that CxC = 0 leads to 

A x B = —B x A. 

1.4.4 Show that 

(a) (A — B) • (A + B) = A 2 — B 2 , 

(b) (A — B) x (A + B) = 2A x B. 

The distributive laws needed here, 

A • (B + C) = A • B + A • C, 
and 

Ax(B + C)=AxB+AxC, 

may easily be verified (if desired) by expansion in Cartesian components. 

1.4.5 Given the three vectors, 

P = 3x + 2y — z, 

Q = —6x — 4y + 2z, 

R = x — 2y — z, 

find two that are perpendicular and two that are parallel or antiparallel. 

1.4.6 If P = x P x + y P v and Q = xQ x + y Q y are any two nonparallel (also nonantiparallel) 
vectors in the xy-plane, show that P x Q is in the '-direction. 

Prove that (A x B) • (A xB) = (AB ) 2 - (A • B) 2 . 


1.4.7 
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1.4.8 Using the vectors 

P = xcos 9 + y sin(9, 

Q = xcos tp — y sin</>, 

R = xcos tp + y sin <p, 
prove the familiar trigonometric identities 

sin(0 + (p) — sin 9 cos tp + cos 9 sin (p, 
cos (9 + tp) — cost? cos tp — sin 9 sin <p. 

1.4.9 (a) Find a vector A that is perpendicular to 

U = 2x + y — z, 

V = x — y + z. 

(b) What is A if, in addition to this requirement, we demand that it have unit magni¬ 
tude? 

1.4.10 If four vectors a, b, c, and d all lie in the same plane, show that 

(a x b) x (c x d) = 0. 

Hint. Consider the directions of the cross-product vectors. 

1.4.11 The coordinates of the three vertices of a triangle are (2, 1, 5), (5, 2, 8), and (4, 8, 2). 
Compute its area by vector methods, its center and medians. Lengths are in centimeters. 
Hint. See Exercise 1.4.1. 

1.4.12 The vertices of parallelogram ABCD are (1,0, 0), (2, —1,0), (0, —1, 1), and (—1,0,1) 
in order. Calculate the vector areas of triangle ABD and of triangle BCD. Are the two 
vector areas equal? 

ANS. Area abd = - j(x + y + 2z). 

1.4.13 The origin and the three vectors A, B, and C (all of which start at the origin) define a 
tetrahedron. Taking the outward direction as positive, calculate the total vector area of 
the four tetrahedral surfaces. 

Note. In Section 1.11 this result is generalized to any closed surface. 

1.4.14 Find the sides and angles of the spherical triangle ABC defined by the three vectors 

A= (1,0, 0), 

b = (^° 4 )' 

c =(°'^7!> 

Each vector starts from the origin (Fig. 1.14). 
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x 

Figure 1.14 Spherical triangle. 



1.4.15 Derive the law of sines (Fig. 1.15): 

sin a sin/I siny 

1.4.16 The magnetic induction B is defined by the Lorentz force equation, 

F — q(\ x B). 

Carrying out three experiments, we find that if 

F 

v = x, — — 2 z — 4y, 

q 

F „ „ 

v = y, — = 4x — z, 

q 

F „ 

v = z, — = y — 2x. 

q 

From the results of these three separate experiments calculate the magnetic induction B. 

1.4.17 Define a cross product of two vectors in two-dimensional space and give a geometrical 
interpretation of your construction. 

1.4.18 Find the shortest distance between the paths of two rockets in free flight. Take the first 
rocket path to be r = iq + tjvi with launch at iq = (1,1, 1) and velocity vi = (1, 2, 3) 
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Figure 1.1 5 Law of sines. 


and the second rocket path as r = r 2 + UW with r 2 = (5,2, 1) and V 2 = (—1, —1, 1). 
Lengths are in kilometers, velocities in kilometers per hour. 

1.5 Triple S calar Product, Triple Vector Product 
T riple Scalar Product 

Sections 1.3 and 1.4 cover the two types of multiplication of interest here. However, there 
are combinations of three vectors, A (B X C) and A X (B x C), that occur with sufficient 
frequency to deserve further attention. The combination 

A • (B x C) 

is known as the triple scalar product. B x C yields a vector that, dotted into A, gives a 
scalar. We note that (A • B) x C represents a scalar crossed into a vector, an operation that 
is not defined. Hence, if we agree to exclude this undefined interpretation, the parentheses 
may be omitted and the triple scalar product written A • B x C. 

Using Eqs. (1.38) for the cross product and Eq. (1.24) for the dot product, we obtain 

A • B x C = A x (ByC z — B z Cy) + Ay(B z C x — B X C Z ) + A - ( B x C v — B v C x ) 

= B CxA=C AxB 

= —A • C x B = —C ■ B x A = —B • A x C, and so on. (1.48) 

There is a high degree of symmetry in the component expansion. Every term contains the 
factors At, Bj , and Ck- If i, j, and k are in cyclic order (x , y, z ), the sign is positive. If the 
order is anticyclic, the sign is negative. Further, the dot and the cross may be interchanged. 


ABxC = AxBC. 


(1.49) 




A convenient representation of the component expansion of Eq. (1.48) is provided by the 
determinant 


(1.50) 

The rules for interchanging rows and columns of a determinant 12 provide an immediate 
verification of the permutations listed in Eq. (1.48), whereas the symmetry of A, B, and 
C in the determinant form suggests the relation given in Eq. (1.49). The triple products 
encountered in Section 1.4, which showed that A x B was perpendicular to both A and B, 
were special cases of the general result (Eq. (1.48)). 

The triple scalar product has a direct geometrical interpretation. The three vectors A, B, 
and C may be interpreted as defining a parallelepiped (Fig. 1.16): 

|B x C| = BC sin$ 

= area of parallelogram base. (1.51) 

The direction, of course, is normal to the base. Dotting A into this means multiplying the 
base area by the projection of A onto the normal, or base times height. Therefore 

A • B x C = volume of parallelepiped defined by A, B, and C. 

The triple scalar product finds an interesting and important application in the construc¬ 
tion of a reciprocal crystal lattice. Let a, b, and c (not necessarily mutually perpendicular) 

1 “See Section 3.1 for a summary of the properties of determinants. 
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represent the vectors that define a crystal lattice. The displacement from one lattice point 
to another may then be written 


r = n a a + ni, b + n c c, 

with n a ,nb, and n c taking on integral values. With these vectors we may form 
, bxc .. cxa . axb 


a = 


a b x c 


b = 


a b x c 


a b x c 


(1.52) 


(1.53a) 


We see that a' is perpendicular to the plane containing b and c, and we can readily show 
that 


a' a = b' b = c' c=l, (1.53b) 

whereas 


a' • b = a' • c = b' • a = b' • c = c' • a = c' • b = 0. (1.53c) 

It is from Eqs. (1.53b) and f 1.53c) that the name reciprocal lattice is associated with the 
points r' = n' a a' + n', b' + n'.c'. The mathematical space in which this reciprocal lattice ex¬ 
ists is sometimes called a Fourier space, on the basis of relations to the Fourier analysis of 
Chapters 14 and 15. This reciprocal lattice is useful in problems involving the scattering of 
waves from the various planes in a crystal. Further details may be found in R. B. Leighton’s 
Principles of Modern Physics, pp. 44CM-48 [New York: McGraw-Hill (1959)]. 


Triple Vector Product 

The second triple product of interest is A x (B x C), which is a vector. Here the parentheses 
must be retained, as may be seen from a special case (x x x) x y = 0, while x x (x x y) = 
x x z = — y. 


Example 1.5.1 atriple vector product 


For the vectors 

A = x + 2y — z = (1,2, —1), B = y + z= (0,1,1), C = x -y = (0,1, 1), 


B x C = 


x y z 

0 1 1 

1 -1 0 


= x + y — z, 


and 


A x (B x C) = 


x y z 

1 2 -1 

1 1 -1 


= -x - z = -(y + z) - (x - y) 
= —B — C. 


By rewriting the result in the last line of Example 1.5.1 as a linear combination of B and 
C, we notice that, taking a geometric approach, the triple vector product is perpendicular 
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z 



Figure 1.17 B and C are in the xy-plane. 
B x C is perpendicular to the xy-plane and 
is shown here along the "-axis. Then 
A x (B x C) is perpendicular to the "-axis 
and therefore is back in the xy-plane. 


to A and to B x C. The plane defined by B and C is perpendicular to B x C, and so the 
triple product lies in this plane (see Fig. 1.17): 

A x (B x C) = i/B + dC. (1.54) 


Taking the scalar product of Eq. (1.54) with A gives zero for the left-hand side, so 
«A • B + i>A • C = 0. Hence u = wA ■ C and v — —w A • B for a suitable w. Substitut¬ 
ing these values into Eq. (1.54) gives 


A x (B x C) = w[ B(A ■ C) - C(A • B)]; 

we want to show that 


(1.55) 


w — 1 

in Eq. (1.55), an important relation sometimes known as the BAC-CAB rule. Since 
Eq. (1.55) is linear in A, B , and C, w is independent of these magnitudes. That is, we 
only need to show that w — 1 for unit vectors A, B, C. Let us denote B • C = cos a, 
C • A = cos p, A • B = cos y, and square Eq. (1.55) to obtain 

[A x (B x C)] 2 = A 2 (B x C) 2 - [A ■ (B x C)] 2 

= 1 - cos 2 a - [A - (B x C)] 2 

= w 2 [(A • C) 2 + (A • B) 2 - 2(A • B)(A • C)(B ■ C)] 

= ur (cos P + cos y — 2 cos a cos/l cosy), 


(1.56) 
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using (A x B) 2 = A 2 B 2 — (A • B) 2 repeatedly (see Eq. (1.43) for a proof). Consequently, 
the (squared) volume spanned by A, B, C that occurs in Eq. (1.56) can be written as 

[A • (B x C)] 2 = 1 — cos 2 a — ur (cos 2 /) + cos 2 y — 2 cos a cos /3 cos y). 

Here w 2 — 1, since this volume is symmetric in a, /3, y. That is, w = ± I and is inde¬ 
pendent of A, B, C. Using again the special case x x (x x y) = —y in Eq. (1.55) finally 
gives w — 1. (An alternate derivation using the Levi-Civita symbol Sijk of Chapter 2 is the 
topic of Exercise 2.9.8.) 

It might be noted here that just as vectors are independent of the coordinates, so a vector 
equation is independent of the particular coordinate system. The coordinate system only 
determines the components. If the vector equation can be established in Cartesian coor¬ 
dinates, it is established and valid in any of the coordinate systems to be introduced in 
Chapter 2. Thus, Eq. (1.55) may be verified by a direct though not very elegant method of 
expanding into Cartesian components (see Exercise 1.5.2). 


Exercises 

1.5.1 One vertex of a glass parallelepiped is at the origin (Fig. 1.18). The three adjacent 
vertices are at (3, 0, 0), (0, 0,2), and (0, 3, 1). All lengths are in centimeters. Calculate 
the number of cubic centimeters of glass in the parallelepiped using the triple scalar 
product. 

1.5.2 Verify the expansion of the triple vector product 

A x (B x C) = B(A • C) - C(A • B) 



Figure 1.18 Parallelepiped: triple scalar product. 
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by direct expansion in Cartesian coordinates. 

1.5.3 Show that the first step in Eq. (1.43), which is 

(A x B) • (A x B) = A 2 B 2 - (A • B) 2 , 
is consistent with the BAC-CAB rule for a triple vector product. 

1.5.4 You are given the three vectors A, B, and C, 

A = x + y, 

B = y + z, 

C = x — z. 

(a) Compute the triple scalar product, A • B x C. Noting that A = B + C, give a geo¬ 
metric interpretation of your result for the triple scalar product. 

(b) Compute Ax (B x C). 

1.5.5 The orbital angular momentum L of a particle is given by L = r x p = mr x v, where 
p is the linear momentum. With linear and angular velocity related by v = oo x r, show 
that 

L = mr 2 [« — r(r • w)]. 

Here r is a unit vector in the r-direction. For r • <o = 0 this reduces to T = loo, with the 
moment of inertia I given by mr 2 . In Section 3.5 this result is generalized to form an 
inertia tensor. 

1.5.6 The kinetic energy of a single particle is given by T = \mv 2 . For rotational motion this 
becomes \m(oo x r) 2 . Show that 

T — -m[r 2 oo 2 — (r • w) 2 ]. 

For r • to — 0 this reduces to T = ^ Iar , with the moment of inertia I given by mr 2 . 

1.5.7 Show that 13 

a x (b x c) + b x (c x a) + c x (a x b) = 0. 

1.5.8 A vector A is decomposed into a radial vector A,- and a tangential vector A,. If r is a 
unit vector in the radial direction, show that 

(a) A,- = f (A • r) and 

(b) A, = — r x (r x A). 

1.5.9 Prove that a necessary and sufficient condition for the three (nonvanishing) vectors A, 
B, and C to be coplanar is the vanishing of the triple scalar product 

A • B x C = 0. 

13 This is Jacobi’s identity for vector products; for commutators it is important in the context of Lie algebras (see Eq. (4.16) in 
Section 4.2). 
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1.5.10 

1.5.11 

1.5.12 

1.5.13 


Three vectors A, B, and C are given by 

A = 3x — 2y + 2z, 

B = 6x + 4y — 2z, 

C = —3x — 2y — 4z. 

Compute the values of A • B x C and A x (B x C), C x (A x B) and B x (C X A). 
Vector D is a linear combination of three noncoplanar (and nonorthogonal) vectors: 

D = aA + bB + cC. 


Show that the coefficients are given by a ratio of triple scalar products. 


DBxC 

ABxC' 


and so on. 


Show that 


Show that 


(A x B) • (C x D) = (A ■ C)(B • D) - (A • D)(B • C). 


(A x B) x (C x D) = (A • B x D)C - (A • B x C)D. 

1.5.14 For a spherical triangle such as pictured in Fig. 1.14 show that 

sin A sin B sin C 
sin BC sin CA sinAB 

Here sin A is the sine of the included angle at A, while BC is the side opposite (in 
radians). 

1.5.15 Given 

, bxc , cxa , axb 

a =—r-. b=— -, c =— -, 

abxc abxc abxc 

and a • b x c / 0, show that 


(a) 

(b) 

(c) 


x-y = S X y, (x, y = a, b, c), 

a' • b' x c' = (a ■ b x c) _1 , 
b' x c' 

a =-. 

a' b' x c' 


1.5.16 If x • y' = S xy , (x, y = a, b, c), prove that 

, bxc 
a =-. 

abxc 

(This is the converse of Problem 1.5.15.) 

1.5.17 Show that any vector V may be expressed in terms of the reciprocal vectors a', b', c' (of 
Problem 1.5.15) by 


V = (V • a)a' + (V • b)b' + (V • c)c'. 
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1.5.18 An electric charge q\ moving with velocity vi produces a magnetic induction B given 

by 


„ Mo vi x r 

B = 3 “ — T~ 

4jt r z 


(mks units). 


where r points from q\ to the point at which B is measured (Biot and Savart law). 


(a) Show that the magnetic force on a second charge qi, velocity V 2 , is given by the 
triple vector product 


F 2 = 


MO 

47 T r 2 


V 2 x (vi X 


r). 


(b) 

(c) 


Write out the corresponding magnetic force Fi that qj exerts on q\. Define your 
unit radial vector. How do F i and F 2 compare? 

Calculate Fj and F 2 for the case of <71 and c / 2 moving along parallel trajectories 
side by side. 


ANS. 


(b) F| = 


mo qiqi 


Vi x (v 2 x r). 


(c) Fi = 


In general, there is no simple relation between 
F 1 and F 2 . Specifically, Newton’s third law, F 1 = 
does not hold. 

Mo qiqi 


-f 2 . 


v 2 r = —F 2 . 


Mutual attraction. 


1.6 Gradient, V 


To provide a motivation for the vector nature of partial derivatives, we now introduce the 

total variation of a function F{x, y), 


3 F 3 F 

dF — —dx H- d y. 

dx 3 y 


It consists of independent variations in the x- and y-directions. We write dF as a sum of 
two increments, one purely in the x- and the other in the y-direction. 


dF(x, y) 


Fix + dx, y + dy) — F(x, y) 

[Fix + dx, y + dy) - Fix, y + dy)\ + [F{x, y + dy) 


3 F 3 F 

~x~ dx + ——dy, 
ax dy 


Fix, y)] 


by adding and subtracting F(x, y + dy). The mean value theorem (that is, continuity of F) 
tells us that here dF/dx, dF/dy are evaluated at some point f, q between x and x + dx, y 
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and y + dy, respectively. As dx -> 0 and dy -> 0, § —> x and rj -> y. This result general¬ 
izes to three and higher dimensions. For example, for a function ip of three variables. 


d(p(x, y, z) 


\<p(x + dx, y + dy, z + dz) — tp(x, y + dy, z + dz)] 
+ \<p{x, y + dy, z + dz) — <p(x, y, z + dz)] 

+ \(p{x, y, z+dz) - <p(x, y, z)] 


3 w 3 <p 3 <p 
-y-dx + —dy + —dz. 
dx dy dz 


(1.57) 


Algebraically, dip in the total variation is a scalar product of the change in position dr and 
the directional change of ip. And now we are ready to recognize the three-dimensional 
partial derivative as a vector, which leads us to the concept of gradient. 

Suppose that ip(x,y,z) is a scalar point function, that is, a function whose value depends 
on the values of the coordinates {x, y, z). As a scalar, it must have the same value at a given 
fixed point in space, independent of the rotation of our coordinate system, or 

(p'(x[, x' 2 , X3) = ip(x i,X2, X3). (1.58) 

By differentiating with respect to x] we obtain 

dip'(x j,X 2 ,Xj) d(p{x\ , X2, X3) dip 3 Xj dip 

dx] dx• “ dxj dx] 2— ,a,J dxj 


by the rules of partial differentiation and Eqs. (1.16a) and (1.16b). But comparison with 
Eq. (1.17), the vector transformation law, now shows that we have constructed a vector 
with components dip/dxj. This vector we label the gradient of ip. 

A convenient symbolism is 


or 


„ dip „ dip „ dip 

\w = x-f y-b z — 

Y dx J dy dz 





(1.60) 


(1.61) 


Vi p (or del ip) is our gradient of the scalar ip, whereas V (del) itself is a vector differential 
operator (available to operate on or to differentiate a scalar ip). All the relationships for V 
(del) can be derived from the hybrid nature of del in terms of both the partial derivatives 
and its vector nature. 

The gradient of a scalar is extremely important in physics and engineering in expressing 
the relation between a force field and a potential field. 


force F = — V(potential V), 


(1.62) 


which holds for both gravitational and electrostatic fields, among others. Note that the 
minus sign in Eq. (1.62) results in water flowing downhill rather than uphill! If a force can 
be described, as in Eq. (1.62), by a single function V (r) everywhere, we call the scalar 
function V its potential. Because the force is the directional derivative of the potential, we 
can find the potential, if it exists, by integrating the force along a suitable path. Because the 
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total variation dV — V V ■ dr — — F ■ dr is the work done against the force along the path 
d r, we recognize the physical meaning of the potential (difference) as work and energy. 
Moreover, in a sum of path increments the intermediate points cancel, 

[V(r + rfri + dr 2 ) - V(r + dri)] + [V(r + dri) - V(r)] = V(r + dr 2 + dri) - V(r), 

so the integrated work along some path from an initial point r, to a final point r is given by 
the potential difference V (r ) — V(r, ) at the endpoints of the path. Therefore, such forces 
are especially simple and well behaved: They are called conservative. When there is loss of 
energy due to friction along the path or some other dissipation, the work will depend on the 
path, and such forces cannot be conservative: No potential exists. We discuss conservative 
forces in more detail in Section 1.13. 


Example 1.6.1 The Gradient of a Potential V(r) 

Let us calculate the gradient of V (r) — V{■/x 2 + y 2 + zr ), so 

r,.,, , ,3V(r) 3V(r) av(r) 

VV(r)=x— -+ y --T z -—. 

dx dy dz 

Now, V ( r ) depends on x through the dependence of r on .r. Therefore 14 

dV (r) dV(r) dr 

dx dr dx 

From r as a function of x,y,z, 

dr d(x 2 + y 2 + S 2 ) 1 / 2 x x 

dx 

Therefore 


dx (x 2 + y 2 + z 2 ) 1 / 2 r 

dV(r) dV(r) x 


dx dr r 

Permuting coordinates (x -> y, y —»• z, z —>• x) to obtain the y and z derivatives, we get 



Here r is a unit vector (r/r ) in the positive radial direction. The gradient of a function of 
r is a vector in the (positive or negative) radial direction. In Section 2.5, r is seen as one 
of the three orthonormal unit vectors of spherical polar coordinates and r d/dr as the radial 
component of V. ■ 


4 This is a special case of the chain rule of partial differentiation: 


dV(r,6,(p) _ dV dr dV 36 dV d<p 

dx dr dx d6 dx dip dx ’ 


where dV/dO = dV/d<p = 0, dV/dr dV/dr. 




A Geometrical Interpretation 


1.6 Gradient, V 


35 


One immediate application of \ ip is to dot it into an increment of length 

dr — xdx + ydy + z dz- 

Thus we obtain 

dip d(p dtp 

Vcp ■ dr — —dx H- dy H- dz — dip, 

dx ay ' dz 

the change in the scalar function ip corresponding to a change in position dr. Now consider 
P and Q to be two points on a surface < p(x, y, z) — C, a constant. These points are chosen 
so that Q is a distance dr from P. Then, moving from P to Q, the change in < p{x , y, z) — C 
is given by 


dcp = (Vip) ■ dr — 0 


(1.63) 


since we stay on the surface (p(x . y, z.) = C . This shows that V<p is perpendicular to dr. 
Since dr may have any direction from P as long as it stays in the surface of constant <p, 
point Q being restricted to the surface but having arbitrary direction, is seen as normal 
to the surface tp — constant (Fig. 1.19). 

If we now permit dr to take us from one surface <p — C\ to an adjacent surface (p — Ci 
(Fig. 1.20), 

dcp = Ci - C 2 = AC = (V<p) • dr. (1.64) 


For a given dip, \dr\ is a minimum when it is chosen parallel to W<p (cos 0 — 1); or, for 
a given |<fr|, the change in the scalar function ip is maximized by choosing dr parallel to 



Figure 1.19 The length increment dr has to stay on the surface ip — C. 
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Figure 1.20 Gradient. 

Vcp. This identifies Vy? as a vector having the direction of the maximum space rate 
of change of <p, an identification that will be useful in Chapter 2 when we consider non- 
Cartesian coordinate systems. This identification of Vy> may also be developed by using 
the calculus of variations subject to a constraint. Exercise 17.6.9. 


Example 1.6.2 Force as Gradient of a Potential 


As a specific example of the foregoing, and as an extension of Example 1.6.1, we consider 
the surfaces consisting of concentric spherical shells. Fig. 1.21. We have 

<p(.x,y,z) = (x 2 + y 2 + z 2 ) 1/2 = r = C, 


where r is the radius, equal to C, our constant. AC = A <p = Ar, the distance between two 
shells. From Example 1.6.1 


„d<p(r) „ 

\(p(r) — r-= r. 

dr 

The gradient is in the radial direction and is normal to the spherical surface <p = C. 


Example 1.6.3 Integration BY Parts OF Gradient 

Let us prove the formula f A(r) • V/(r) d?r — — f /( r)V -A(r) d 3 r, where A or / or both 
vanish at infinity so that the integrated parts vanish. This condition is satisfied if, for exam¬ 
ple, A is the electromagnetic vector potential and / is a bound-state wave function i/f (r). 
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Figure 1.21 Gradient for 

ip(x, y, z ) = (x 2 + y 2 + z 2 ) 1 / 2 , spherical 
shells: (x 2 + y 2 + z 2 ) 1/2 — n = C 2 , 
(x 2 +'y 2 + z?) 1/2 = n = Ci. 


Writing the inner product in Cartesian coordinates, integrating each one-dimensional 
integral by parts, and dropping the integrated terms, we obtain 


/ 


A(r) • V/(r)firr = 


■// 


4c/l~-o 


/ 


3 A* ' 

/- dx 

dx 


dy dz - 


-Ilf 
-/ 


. 9 A, 


3.r 


III 


.3 A, 


f ——dx dy dz — /// f ——dy dx dz — I f dz dx dy 


dy 


Ilf 


,3A 7 


3z 


/(r)V • A(r)<i j r. 


If A = e lkz e describes an outgoing photon in the direction of the constant polarization unit 
vector e and / = 1 // (r) is an exponentially decaying bound-state wave function, then 

/ r de' kz C 

e ,kz e ■ Vt/f(r)r/ 3 r = —e z / —cf 3 r = —/ i/r(r )e lkz d 3 r, 

because only the ^-component of the gradient contributes. ■ 


Exercises 

1.6.1 If S(*, y, z) = (x 2 + y 2 + z 2 )~ 3/2 , find 

(a) VS at the point (1,2, 3); 

(b) the magnitude of the gradient of S, V.S' at (1, 2, 3); and 

(c) the direction cosines of VS at (1, 2, 3). 
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1.6.2 (a) Find a unit vector perpendicular to the surface 

-t 2 + r + r = 3 

at the point (1, 1,1). Lengths are in centimeters. 

(b) Derive the equation of the plane tangent to the surface at (1,1,1). 

ANS. (a) (x + y + z)/\/3, (b) x + y + z = 3. 

1.6.3 Given a vector r \2 — x(xi — X 2 ) + y(vi — >’2) + z(z 1 — Z2), show that V 1^12 (gradient 
with respect to xi, yi, and zi of the magnitude r\ 2 ) is a unit vector in the direction of 
ri 2 - 

1.6.4 If a vector function F depends on both space coordinates (x, y, z) and time t, show that 

9F 

d F = (dr • V)F + —dt. 

at 

1.6.5 Show that V (uv) = v V u + uVr, where u and v are differentiable scalar functions of 

x, y, and z. 

(a) Show that a necessary and sufficient condition that u(x,y,z) and v(x,y,z ) are 
related by some function f(u, v) — 0 is that (Vm) x (Vw) = 0. 

(b) If u — u(x, y) and v — v(x, y), show that the condition (Vm) x (Vu) = 0 leads to 
the two-dimensional Jacobian 


J 



3 u 

3 u 

dx 

dy 

dv 

dv 

dx 

dy 


The functions u and v are assumed differentiable. 


1.7 Divergence, V 

Differentiating a vector function is a simple extension of differentiating scalar quantities. 
Suppose r (t) describes the position of a satellite at some time t. Then, for differentiation 
with respect to time, 

dr(t) r(t + At) — r(f) 

-= lim -= v, linear velocity. 

dt A—>-0 A t 

Graphically, we again have the slope of a curve, orbit, or trajectory, as shown in Fig. 1.22. 

If we resolve r(f) into its Cartesian components, dr/dt always reduces directly to a 
vector sum of not more than three (for three-dimensional space) scalar derivatives. In other 
coordinate systems (Chapter 2) the situation is more complicated, for the unit vectors are 
no longer constant in direction. Differentiation with respect to the space coordinates is 
handled in the same way as differentiation with respect to time, as seen in the following 
paragraphs. 
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Figure 1 .22 Differentiation of a vector. 


In Section 1.6, V was defined as a vector operator. Now, paying attention to both its 
vector and its differential properties, we let it operate on a vector. First, as a vector we dot 
it into a second vector to obtain 


V -V = 


dVx 

dx 


dVy 3Vz 
3 y 3 z 


(1.65a) 


known as the divergence of V. This is a scalar, as discussed in Section 1.3. 


Example 1.7.1 Divergence of Coordinate Vector 
Calculate V • r: 


„ /„ 3 » 3 „ 3 . ^ 

V r = x— + y— + z— • (xt + yy + z z) 
\ 3t dy az ' 

dx dv 3 z 

—- \~ - \~ -, 

dx dy 3 z 


or V • r = 3. 


Example 1.7.2 Divergence of Central Force Field 
Generalizing Example 1.7.1, 


V ' = + ly[ yf(r) ] + 

. ,, . t 2 df y 2 df z 2 df 

— 3/(r) H-——I-——I-— 

r dr r dr r dr 

df 

= 3 f(r) + r-j-. 

dr 
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The manipulation of the partial derivatives leading to the second equation in Example 1.7.2 
is discussed in Example 1.6.1. In particular, if f(r) — r” _1 , 

V • (rr" _1 ) = V •?/-" 

= 3r" -1 + (n — l)r" _1 

= (n + 2)r" _1 . (1.65b) 

This divergence vanishes for n — —2, except at r = 0, an important fact in Section 1.14. ■ 


Example 1.7.3 Integration BY Parts OF Divergence 


Let us prove the formula f /(r)V • A(r )d?r — — j A • V f d?r, where A or / or both 
vanish at infinity. 

To show this, we proceed, as in Example 1.6.3, by integration by parts after writing 
the inner product in Cartesian coordinates. Because the integrated terms are evaluated at 
infinity, where they vanish, we obtain 


f , f ( 3A V 3A V 3A Z \ 

/ /(r)V • A(r)d 3 r — / f ( - dxdydzB - -dydxdzB - -dzdxdy) 

J J ' \ Bx By 3 z ' ) 


By 

3 / 3 / 3 / \ 

A Y —dxdydz + A y —dydxdz + A z —dzdx dy 1 
3.x " By " 3z ) 


-J 

= - J A -Wfd 3 r. 


A Physical Interpretation 


To develop a feeling for the physical significance of the divergence, consider V • (pv) with 
v(x, y, z), the velocity of a compressible fluid, and p(x, y, z), its density at point (x, y, z). 
If we consider a small volume dx dy dz (Fig. 1.23) at x = y = z = 0, the fluid flowing into 
this volume per unit time (positive x-direction) through the face EFGH is (rate of flow 
in) efgh = pv x U=0 = dy dz■ The components of the flow pv y and pv z tangential to this 
face contribute nothing to the flow through this face. The rate of flow out (still positive 
x-direction) through face ABCD is pv x \ x =dx dy dz■ To compare these flows and to find the 
net flow out, we expand this last result, like the total variation in Section 1.6. 15 This yields 


(rate of flow out) ABC d — pv x \x=dx dy dz 


pv x + —(pvx)dx 
Bx 


dydz. 


J.v=0 


Here the derivative term is a first correction term, allowing for the possibility of nonuniform 
density or velocity or both. 16 The zero-order term pv x |. T =o (corresponding to uniform flow) 


1 ^ Here we have the increment dx and we show a partial derivative with respect to x since pv x may also depend on y and z. 
^Strictly speaking, pv x is averaged over face EFGH and the expression pv x + (d/dx)(pv x ) dx is similarly averaged over face 
ABCD. Using an arbitrarily small differential volume, we find that the averages reduce to the values employed here. 
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Figure 1.23 Differential rectangular parallelepiped (in first octant). 


cancels out: 


Net rate of flow out| x = — (pv x ) dx dy dz. 
dx 


Equivalently, we can arrive at this result by 


pv x ( Ajc, 0, 0) — pv x (0,0, 0) 3 [pv x {x,y,z)i 

ltm -=- 

A.v—>-0 Aa dx 0 0 0 

Now, the A'-axis is not entitled to any preferred treatment. The preceding result for the two 
faces perpendicular to the A-axis must hold for the two faces perpendicular to the y-axis, 
with x replaced by y and the corresponding changes for y and z: y —>■ z, z —>■ a. This is 
a cyclic permutation of the coordinates. A further cyclic permutation yields the result for 
the remaining two faces of our parallelepiped. Adding the net rate of flow out for all three 
pairs of surfaces of our volume element, we have 


net flow out 
(per unit time) 


9 9 9 

-X-(PVx) + -X-(PVy) + — ( PV Z ) 
ox ay dz 


dx dy dz 


— V • ( py) dx dy dz. 


( 1 . 66 ) 


Therefore the net flow of our compressible fluid out of the volume element dxdydz per 
unit volume per unit time is V • (pv). Hence the name divergence. A direct application is 
in the continuity equation 

^ + V-(pv) = 0, (1.67a) 

dt 

which states that a net flow out of the volume results in a decreased density inside the 
volume. Note that in Eq. (1.67a), p is considered to be a possible function of time as well 
as of space: p{x, y, z. t). The divergence appears in a wide variety of physical problems. 
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ranging from a probability current density in quantum mechanics to neutron leakage in a 
nuclear reactor. 

The combination V • (/V), in which / is a scalar function and V is a vector function, 
may be written 


9 9 9 

V • (/V) = —(fV x ) + — (fVy) + — (. fV z ) 
ox oy dz 


V, 

dx 

= (V/)-V- 


9Vx_ 9 /, 

3x 3 y 

/V-V, 


— 7C ^ + / T7 1 + TT - + 77 ^ 


V, 

dz 


.dVz 

dz 


(1.67b) 


which is just what we would expect for the derivative of a product. Notice that V as a 
differential operator differentiates both / and V; as a vector it is dotted into V (in each 
term). 

If we have the special case of the divergence of a vector vanishing. 


V - B = 0, 


( 1 . 68 ) 


the vector B is said to be solenoidal, the term coming from the example in which B is the 
magnetic induction and Eq. (1.68) appears as one of Maxwell’s equations. When a vector 
is solenoidal, it may be written as the curl of another vector known as the vector potential. 
(In Section 1.13 we shall calculate such a vector potential.) 


Exercises 

1.7.1 For a particle moving in a circular orbit r = xr cos cot + y r sin cot, 

(a) evaluate rxr, with r = ^ = v. 

(b) Show that r + &rr = 0 with r—^. 

The radius r and the angular velocity co are constant. 

ANS. (a) z cor 2 . 

1.7.2 Vector A satisfies the vector transformation law, Eq. (1.15). Show directly that its time 
derivative dA/dt also satisfies Eq. (1.15) and is therefore a vector. 

1.7.3 Show, by differentiating components, that 

(a) |(A-B) = ^-B + A. f, 

(b) i(AxB) = fxB + Axf, 

just like the derivative of the product of two algebraic functions. 

1.7.4 In Chapter 2 it will be seen that the unit vectors in non-Cartesian coordinate systems are 
usually functions of the coordinate variables, e,- = e,- (q\ , q 2 , < 73 ) but |e,-1 = 1. Show that 
either 3e ,-/dqj = 0 or 3e ,/dqj is orthogonal to e,-. 

Hint, dej/dqj = 0. 
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1.7.5 Prove V • (a x b) = b • (V x a) — a • (V x b). 

Hint. Treat as a triple scalar product. 

1.7.6 The electrostatic field of a point charge q is 

E = ' ~ 2 - 
4jtso r- 

Calculate the divergence of E. What happens at the origin? 


1.8 Curl, Vx 


Another possible operation with the vector operator V is to cross it into a vector. We obtain 


,. 3 9 

V x V = x — V z -T v 

1 9v dz y 


dz 


dx 


y (^-v x --v z +z i-v y --v. 


dx 


3 y 


x 

JL 

dx 

v x 


y z 

JL JL 
dy dz 

Vy V z 


(1.69) 


which is called the curl of V. In expanding this determinant we must consider the derivative 
nature of V. Specifically, V x V is defined only as an operator, another vector differential 
operator. It is certainly not equal, in general, to —V x V. 17 In the case of Eq. (1.69) the 
determinant must be expanded from the top down so that we get the derivatives as shown 
in the middle portion of Eq. (1.69). If V is crossed into the product of a scalar and a vector, 
we can show 


V x (fY)\ x = 


d 9 

Z-(.fV Z )--(fVy) 
dy dz 


/ 3V Z df dV y df 
= /VxVU + (V/)xVU. 


(1.70) 


If we permute the coordinates x -> y, y —> z, Z -» x to pick up the v-component and 
then permute them a second time to pick up the "-component, then 


V x (/V) = /V x V + (V/) x V, 


(1.71) 


which is the vector product analog of Eq. (1.67b). Again, as a differential operator V 
differentiates both / and V. As a vector it is crossed into V (in each term). 


17 In this same spirit, if A is a differential operator, it is not necessarily true that A x A = 0. Specifically, for the quantum 
mechanical angular momentum operator L = — / (r x V), we find that L x L = / L. See Sections 4.3 and 4.4 for more details. 
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Example 1.8.1 Vector Potential of a Constant B Field 

From electrodynamics we know that V • B = 0, which has the general solution B = V x A, 
where A(r) is called the vector potential (of the magnetic induction), because V • (V x A) = 
(V X V) • A = 0, as a triple scalar product with two identical vectors. This last identity will 
not change if we add the gradient of some scalar function to the vector potential, which, 
therefore, is not unique. 

In our case, we want to show that a vector potential isA=^(Bxr). 

Using the BAC-BAC rule in conjunction with Example 1.7.1, we find that 

2V x A = V x (B x r) = (V • r)B - (B • V)r = 3B - B = 2B, 

where we indicate by the ordering of the scalar product of the second term that the gradient 
still acts on the coordinate vector. ■ 




Figure 1 .24 Circulation around a differential loop. 
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Although the circulation is technically given by a vector line integral / V • dX (Sec¬ 
tion 1.10), we can set up the equivalent scalar integrals here. Let us take the circulation to 
be 


circulation 1234 = 


= V x (x, y)dX x + J V y (x, y)dX y 

Vy(x, y) dXy. 


(1.75) 


The numbers 1,2, 3, and 4 refer to the numbered line segments in Fig. 1.24. In the first 
integral, dX x = +dx; but in the third integral, dX x — —dx because the third line segment 
is traversed in the negative x -direction. Similarly, dX y = +dy for the second integral, —dy 
for the fourth. Next, the integrands are referred to the point (xq, yo) with a Taylor expan¬ 
sion 18 taking into account the displacement of line segment 3 from 1 and that of 2 from 4. 
For our differential line segments this leads to 


circulation 1234 = V x (xq, yo) dx + 


8Vy ' 

V y (x o, yo) + ~fa dx 


dy 


dV x 

V x (xo, yo) + —— dy 

fy . 


(-dx) + Vy(x 0 , yo )(~dy) 


dV y 

dx 


dV x 

dy 


dx dy. 


(1.76) 


Dividing by dx dy, we have 


circulation per unit area = V x V| z . (1.77) 

The circulation 19 about our differential area in the xy-plane is given by the 7 -component 
of V x V. In principle, the curl V x V at (xo, yo) could be determined by inserting a 
(differential) paddle wheel into the moving fluid at point (xo, yo). The rotation of the little 
paddle wheel would be a measure of the curl, and its axis would be along the direction of 
V x V, which is perpendicular to the plane of circulation. 

We shall use the result, Eq. (1.76), in Section 1.12 to derive Stokes’ theorem. Whenever 
the curl of a vector V vanishes, 


V x V = 0, (1.78) 

V is labeled irrotational. The most important physical examples of irrotational vectors are 
the gravitational and electrostatic forces. In each case 

V = C^ = c4, (1-79) 

r- r 3 

where C is a constant and r is the unit vector in the outward radial direction. For the 
gravitational case we have C = —Gm\m 2 , given by Newton’s law of universal gravitation. 
If C = /4jreo- we have Coulomb’s law of electrostatics (mks units). The force V 


1 ^ Here. Vy (a'o + dx. yo) = V\ (a'q , yo) + (inrLo.vo dx + ••■ . The higher-order terms will drop out in the limit as dx 0. 
A correction term for the variation of Vy with y is canceled by the corresponding term in the fourth integral. 

19 In fluid dynamics V x V is called the “vorticity.” 
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given in Eq. (1.79) may be shown to be irrotational by direct expansion into Cartesian 
components, as we did in Example 1.8.1. Another approach is developed in Chapter 2, in 
which we express V x, the curl, in terms of spherical polar coordinates. In Section 1.13 we 
shall see that whenever a vector is irrotational, the vector may be written as the (negative) 
gradient of a scalar potential. In Section 1.16 we shall prove that a vector field may be 
resolved into an irrotational part and a solenoidal part (subject to conditions at infinity). 
In terms of the electromagnetic field this corresponds to the resolution into an irrotational 
electric field and a solenoidal magnetic field. 

For waves in an elastic medium, if the displacement u is irrotational, V xu = 0, plane 
waves (or spherical waves at large distances) become longitudinal. If u is solenoidal, 
V • u = 0, then the waves become transverse. A seismic disturbance will produce a dis¬ 
placement that may be resolved into a solenoidal part and an irrotational part (compare 
Section 1.16). The irrotational part yields the longitudinal P (primary) earthquake waves. 
The solenoidal part gives rise to the slower transverse S (secondary) waves. 

Using the gradient, divergence, and curl, and of course the BAC-CAB rule, we may 
construct or verify a large number of useful vector identities. For verification, complete 
expansion into Cartesian components is always a possibility. Sometimes if we use insight 
instead of routine shuffling of Cartesian components, the verification process can be short¬ 
ened drastically. 

Remember that V is a vector operator, a hybrid creature satisfying two sets of rules: 

1. vector rules, and 

2. partial differentiation rules — including differentiation of a product. 

Example 1.8.3 Gradient of a Dot Product 

Verify that 

V(A • B) = (B • V)A + (A • V)B + B x (V x A) + A x (V x B). (1.80) 

This particular example hinges on the recognition that V (A • B) is the type of term that 
appears in the BAC-CAB expansion of a triple vector product, Eq. (1.55). For instance, 

A x (V x B) = V(A • B) - (A • V)B, 

with the V differentiating only B, not A. From the commutativity of factors in a scalar 
product we may interchange A and B and write 

B x (V x A) = V(A B) - (B V)A, 

now with V differentiating only A, not B. Adding these two equations, we obtain V dif¬ 
ferentiating the product A • B and the identity, Eq. (1.80). This identity is used frequently 
in electromagnetic theory. Exercise 1.8.13 is a simple illustration. ■ 
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Let us prove the formula f C(r) • (V x A(r)) d 3 r — J A(r) • (V x C(r ))<Pr, where A or 
C or both vanish at infinity. 

To show this, we proceed, as in Examples 1.6.3 and 1.7.3, by integration by parts after 
writing the inner product and the curl in Cartesian coordinates. Because the integrated 
terms vanish at infinity we obtain 


C 7 


J C(r) • (V x A(r)) d 

-f 

-s 

= J A(r) • (V xC(r ))d 3 r, 

just rearranging appropriately the terms after integration by parts. 



d 3 r 


d\ 


Exercises 

1.8.1 Show, by rotating the coordinates, that the components of the curl of a vector transform 
as a vector. 

Hint. The direction cosine identities of Eq. (1.46) are available as needed. 

1.8.2 Show that u x v is solenoidal if u and v are each irrotational. 

1.8.3 If A is irrotational, show that A x r is solenoidal. 

1.8.4 A rigid body is rotating with constant angular velocity u>. Show that the linear velocity 
v is solenoidal. 

1.8.5 If a vector function f(jc, y , z) is not irrotational but the product of / and a scalar function 
g(x, y, z) is irrotational, show that then 

f V x f=0. 

1.8.6 If (a) V = xV x (x, y) + y V y (x . y ) and (b) V x V / 0, prove that V x V is perpendicular 
to V. 

1.8.7 Classically, orbital angular momentum is given by L = r x p, where p is the linear 
momentum. To go from classical mechanics to quantum mechanics, replace p by the 
operator —/V (Section 15.6). Show that the quantum mechanical angular momentum 
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operator has Cartesian components (in units of ti) 



1.8.8 Using the angular momentum operators previously given, show that they satisfy com¬ 
mutation relations of the form 

[L X , Ly ] = L X Ly — LyL X = f'Lj 

and hence 

LxL = i L. 

These commutation relations will be taken later as the defining relations of an angular 
momentum operator—Exercise 3.2.15 and the following one and Chapter 4. 

1.8.9 With the commutator bracket notation [L x , L y ] = L x L y — L y L x , the angular momen¬ 
tum vector L satisfies [L x , L v ] = i L z , etc., or L x L = i L. 

If two other vectors a and b commute with each other and with L, that is, [a,b] = 
[a, L] = [b, L] = 0, show that 

[a • L, b • L] = i (a x b) • L. 

1.8.10 For A = xA x (x, y. z) and B = xB x (x, y, z) evaluate each term in the vector identity 

V(A • B) = (B • V)A + (A • V)B + B x (V x A) + A x (V x B) 
and verify that the identity is satisfied. 

1.8.11 Verify the vector identity 

V x (A x B) = (B • V)A — (A • V)B — B(V • A) + A(V • B). 

1.8.12 As an alternative to the vector identity of Example 1.8.3 show that 

V(A • B) = (A x V) x B + (B x V) x A + A(V • B) + B(V ■ A). 

1.8.13 Verify the identity 

A x (V x A) = ^ V(A 2 ) - (A • V)A. 

1.8.14 If A and B are constant vectors, show that 


V(A • B x r) = A x B. 
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1.8.15 A distribution of electric currents creates a constant magnetic moment m = const. The 
force on m in an external magnetic induction B is given by 

F = V x (B x m). 


Show that 


F= (m V)B. 


Note. Assuming no time dependence of the fields. Maxwell’s equations yield V x B = 0. 
Also, V • B = 0. 


1.8.16 


An electric dipole of moment p is located at the origin. The dipole creates an electric 
potential at r given by 


VKr) = 


P r 

47reor 3 


Find the electric field, E = — Vi jr at r. 


1.8.17 


The vector potential A of a magnetic dipole, dipole moment m, is given by A(r) = 
(/xo/47r)(m x r / r 3 ). Show that the magnetic induction B = V x A is given by 

/x o 3r(r • m) - m 

Art r 3 

Note. The limiting process leading to point dipoles is discussed in Section 12.1 for 
electric dipoles, in Section 12.5 for magnetic dipoles. 


1.8.18 The velocity of a two-dimensional flow of liquid is given by 


V = xu(x, y) — yv(x, y). 


If the liquid is incompressible and the flow is irrotational, show that 

3 u dv 3 u dv 

dx 3 y 3 y dx 

These are the Cauchy-Riemann conditions of Section 6.2. 

1.8.19 The evaluation in this section of the four integrals for the circulation omitted Taylor 
series terms such as dV x /dx, dV y /dy and all second derivatives. Show that dV x /dx, 
dVy/dy cancel out when the four integrals are added and that the second derivative 
terms drop out in the limit as dx —> 0, dy —> 0. 

Hint. Calculate the circulation per unit area and then take the limit dx —> 0, dy —> 0. 


1.9 Successive Applications of V 

We have now defined gradient, divergence, and curl to obtain vector, scalar, and vector 
quantities, respectively. Letting V operate on each of these quantities, we obtain 

(a) V • V<p (b) V x V<p 

fd) V • V x V (e) V x (V x V) 


(c) VV • V 
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all five expressions involving second derivatives and all five appearing in the second-order 
differential equations of mathematical physics, particularly in electromagnetic theory. 

The first expression, V • ¥<p, the divergence of the gradient, is named the Laplacian of ip. 
We have 


/J „ 3 

I v _ L v _ 

+ z 3 ] 


\ dx dy 

dz) 

V dx 

d 2 V d 2 ip 

3 2 ip 


dx 2 dy 2 

dz 2 



3 y 3 z 


When ip is the electrostatic potential, we have 


(1.81a) 


V • V<p = 0 


(1.81b) 


at points where the charge density vanishes, which is Laplace’s equation of electrostatics. 
Often the combination V • V is written V 2 , or A in the European literature. 


Example 1.9.1 lapiacian of a potential 


Calculate V • W(r). 

Referring to Examples 1.6.1 and 1.7.2, 

„dV 2 dV d 2 V 

V • V V(r) = V ■ r — = - — + —y, 
dr r dr dr- 

replacing f(r) in Example 1.7.2 by 1 /r • dV/dr. If V(r) = r n , this reduces to 


V • Vr" = n(n + l)r 


n—2 


This vanishes for n — 0 [ V (r) — constant] and for n = — 1; that is, V (r) — 1/r is a solution 
of Laplace’s equation, V 2 V(r) — 0. This is for r ^ 0. At r — 0, a Dirac delta function is 
involved (see Eq. (1.169) and Section 9.7). ■ 

Expression (b) may be written 


V x V(p — 

By expanding the determinant, we obtain 

3 2 ' 


V x V<p = x 


<P 


3 y 3 z 

3 2 


X 

y 

Z 

_a_ 

d_ 

d_ 

dx 

dy 

dz 

d (p 

d (p 

d(p 

dx 

dy 

dz 

3 2 q> 

\ , . 

( 


+ y 

— 


<P 


3 2 ip 
dx 3 y 3 y dx 


■ip 


d"<p 


3 z dx dx 3 z 


— 0 , 


(1.82) 


assuming that the order of partial differentiation may be interchanged. This is true as long 
as these second partial derivatives of ip are continuous functions. Then, from Eq. (1.82), 
the curl of a gradient is identically zero. All gradients, therefore, are irrotational. Note that 
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the zero in Eq. (1.82) comes as a mathematical identity, independent of any physics. The 
zero in Eq. (1.81b) is a consequence of physics. 

Expression (d) is a triple scalar product that may be written 


_d_ 

d_ 

_3_ 

dx 

dy 

3 z 

_d_ 

d_ 

_3_ 

dx 

dy 

3 z 

v x 

Vy 

V z 


(1.83) 


Again, assuming continuity so that the order of differentiation is immaterial, we obtain 


V • V x V = 0. 


(1.84) 


The divergence of a curl vanishes or all curls are solenoidal. In Section 1.16 we shall see 
that vectors may be resolved into solenoidal and irrotational parts by Helmholtz’s theorem. 
The two remaining expressions satisfy a relation 

V x (V x V) = VV-V- V- VV, (1.85) 

valid in Cartesian coordinates (but not in curved coordinates). This follows immediately 
from Eq. (1.55), the BAC-CAB rule, which we rewrite so that C appears at the extreme 
right of each term. The term V • VV was not included in our list, but it may be defined by 
Eq. (1.85). 


Example 1.9.2 Electromagnetic Wave Equation 


One important application of this vector relation (Eq. (1.85)) is in the derivation of the 
electromagnetic wave equation. In vacuum Maxwell’s equations become 


V B = 0, 

V • E = 0, 


3E 

V x B = £oMOt , 
at 


V 


xE = - 


3B 

~dt' 


(1.86a) 

(1.86b) 

(1.86c) 

(1.86d) 


Here E is the electric field, B is the magnetic induction, £q is the electric permittivity, 
and fiQ is the magnetic permeability (SI units), so sq/iq — 1 /c 2 , c being the velocity of 
light. The relation has important consequences. Because eo, Mo can be measured in any 
frame, the velocity of light is the same in any frame. 

Suppose we eliminate B from Eqs. (1.86c) and (1.86d). We may do this by taking the 
curl of both sides of Eq. (1.86d) and the time derivative of both sides of Eq. (1.86c). Since 
the space and time derivatives commute. 


3 3B 

— VxB=Vx—, 

3 1 3 1 


and we obtain 
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Application of Eqs. (1.85) and (1.86b) yields 

9 2 E 

V • VE = eo/io-^2 - . (1-87) 

the electromagnetic vector wave equation. Again, if E is expressed in Cartesian coor¬ 
dinates, Eq. (1.87) separates into three scalar wave equations, each involving the scalar 
Laplacian. 

When external electric charge and current densities are kept as driving terms in 
Maxwell’s equations, similar wave equations are valid for the electric potential and the 
vector potential. To show this, we solve Eq. (1.86a) by writing B = V x A as a curl of the 
vector potential. This expression is substituted into Faraday’s induction law in differential 
form, Eq. (1.86d), to yield V x (E + = 0. The vanishing curl implies that E + ^ is a 

gradient and, therefore, can be written as —V<p, where <p(r, t) is defined as the (nonstatic) 
electric potential. These results for the B and E fields. 


B = V x A, 


9A 

E = -Vw-, 

dt 


solve the homogeneous Maxwell’s equations. 

We now show that the inhomogeneous Maxwell’s equations. 



1 9E 

V • E = p/so. 

Oersted’s law: V x B-- — = /xq] 

c z dt 


in differential form lead to wave equations for the potentials <p and A, provided that V • A is 
determined by the constraint \ + V • A = 0. This choice of fixing the divergence of the 

vector potential, called the Lorentz gauge, serves to uncouple the differential equations of 
both potentials. This gauge constraint is not a restriction; it has no physical effect. 

Substituting our electric field solution into Gauss’ law yields 


— = V • E = -V>-V • A = -V 2 <p + -r—?r, 


the wave equation for the electric potential. In the last step we have used the Lorentz 
gauge to replace the divergence of the vector potential by the time derivative of the electric 
potential and thus decouple <p from A. 

Finally, we substitute B = V xA into Oersted’s law and use Eq. (1.85), which expands 
V 2 in terms of a longitudinal (the gradient term) and a transverse component (the curl 
term). This yields 


1 9E , 1/9® 9 2 A\ 

^ J+ ?97 = Vx(VxA) = V(V - A) - VA = ^ J -?( V 97 + ^j’ 

where we have used the electric field solution (Eq. (1.88)) in the last step. Now we see that 
the Lorentz gauge condition eliminates the gradient terms, so the wave equation 


1 9 2 A 

c 2 dt 2 


V"A = /x 0 J 


(1.91) 
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for the vector potential remains. 

Finally, looking back at Oersted’s law, taking the divergence of Eq. (1.89), dropping 
V • (V xB) = 0, and substituting Gauss’ law for V - E = p/eo, we find /xq V • J = — ^3 |y, 

where eo/xo = 1 /c 2 , that is, the continuity equation for the current density. This step justi¬ 
fies the inclusion of Maxwell’s displacement current in the generalization of Oersted’s law 
to nonstationary situations. ■ 


Exercises 

1.9.1 Verify Eq. (1.85), 

V x (V x V) = VV • V - V • VV, 
by direct expansion in Cartesian coordinates. 

1.9.2 Show that the identity 

V x (V x V) = V V • V - V • VV 

follows from the BAC-CAB rule for a triple vector product. Justify any alteration of the 
order of factors in the BAC and CAB terms. 

1.9.3 Prove that V x (<pV<p) = 0. 

1.9.4 You are given that the curl of F equals the curl of G. Show that F and G may differ by 
(a) a constant and (b) a gradient of a scalar function. 

1.9.5 The Navier-Stokes equation of hydrodynamics contains a nonlinear term (v- V)v. Show 
that the curl of this term may be written as —V x [v x (V x v)]. 

1.9.6 From the Navier-Stokes equation for the steady flow of an incompressible viscous fluid 
we have the term 

V x [v x (V x v)], 

where v is the fluid velocity. Show that this term vanishes for the special case 

\ = xv(y,z)- 

1.9.7 Prove that (Vh) x (V v ) is solenoidal, where 11 and v are differentiable scalar functions. 

1.9.8 q> is a scalar satisfying Laplace’s equation, V 2 <p = 0. Show that V<p is both solenoidal 
and irrotational. 

1.9.9 With 1 fr a scalar (wave) function, show that 

9 9 9 3 2 i 1/ dxlr 

(r x V) ■ (r x V)i jr — r 2 'V"\Jr — r 2 —^— 2 r —. 

dr- dr 

(This can actually be shown more easily in spherical polar coordinates. Section 2.5.) 
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1.9.10 In a (nonrotating) isolated mass such as a star, the condition for equilibrium is 

VP + pWcp — 0. 

Here P is the total pressure, p is the density, and cp is the gravitational potential. Show 
that at any given point the normals to the surfaces of constant pressure and constant 
gravitational potential are parallel. 

1.9.11 In the Pauli theory of the electron, one encounters the expression 

(p — eA) x (p — eA)ijr, 

where i// is a scalar (wave) function. A is the magnetic vector potential related to the 
magnetic induction B by B = V x A. Given that p = —/V, show that this expression 
reduces to ieBxfr. Show that this leads to the orbital £-factor gL = 1 upon writing the 
magnetic moment as /r = in units of Bohr magnetons and L = -irx V. See also 
Exercise 1.13.7. 

1.9.12 Show that any solution of the equation 

V x (V x A) - k 2 A = 0 

automatically satisfies the vector Helmholtz equation 

V 2 A + k 2 A = 0 

and the solenoidal condition 

V • A = 0. 

Hint. Let V- operate on the first equation. 

1.9.13 The theory of heat conduction leads to an equation 

'V 2 q> = k |Vcf>| 2 , 

where <t> is a potential satisfying Laplace’s equation: V 2 <1> = 0. Show that a solution of 
this equation is 


4 / = 



1.10 Vector Integration 


The next step after differentiating vectors is to integrate them. Let us start with line integrals 
and then proceed to surface and volume integrals. In each case the method of attack will be 
to reduce the vector integral to scalar integrals with which the reader is assumed familiar. 
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Line Integrals 


Using an increment of length dr — x dx + v dy + zdz, 

we may encounter the line integrals 

/ < pdr , 

(1.92a) 

Jc 


I V ■ dr, 

(1.92b) 

Jc 


f Vxrfr, 

(1.92c) 


in each of which the integral is over some contour C that may be open (with starting point 
and ending point separated) or closed (forming a loop). Because of its physical interpreta¬ 
tion that follows, the second form, Eq. (1.92b) is by far the most important of the three. 
With ip, a scalar, the first integral reduces immediately to 


L vdt=i !c 


L 


tpdr — x <p(x, y, z)dx + y / <p(x, y, z)dy + z / ip(x,y,z)dz. 


L 


(1.93) 


This separation has employed the relation 


/ x(pdx = x j <pdx, 


(1.94) 


which is permissible because the Cartesian unit vectors x, y, and z are constant in both 
magnitude and direction. Perhaps this relation is obvious here, but it will not be true in the 
non-Cartesian systems encountered in Chapter 2. 

The three integrals on the right side of Eq. (1.93) are ordinary scalar integrals and, to 
avoid complications, we assume that they are Riemann integrals. Note, however, that the 
integral with respect to x cannot be evaluated unless y and z are known in terms of x 
and similarly for the integrals with respect to y and z- This simply means that the path 
of integration C must be specified. Unless the integrand has special properties so that 
the integral depends only on the value of the end points, the value will depend on the 
particular choice of contour C. For instance, if we choose the very special case <p = 1, 
Eq. (1.92a) is just the vector distance from the start of contour C to the endpoint, in this 
case independent of the choice of path connecting fixed endpoints. With dr = x dx +y dy + 
zdz, the second and third forms also reduce to scalar integrals and, like Eq. (1.92a), are 
dependent, in general, on the choice of path. The form (Eq. (1.92b)) is exactly the same 
as that encountered when we calculate the work done by a force that varies along the 
path. 


W = 


J F-dr= J F x {x,y,z)dx + J F y (x,y,z)dy + J F z (x,y,z)dz. (1.95a) 


In this expression F is the force exerted on a particle. 




Example 1.10.1 path-dependent work 


The force exerted on a body is F = —xy + yx. The problem is to calculate the work done 
going from the origin to the point (1,1): 

r 1,1 pi,\ 

W — Fdr — I (—ydx + xdy). (1.95b) 

J o.o J 0,0 

Separating the two integrals, we obtain 

ydx+ I xdy. (1.95c) 

Jo 

The first integral cannot be evaluated until we specify the values of y as x ranges from 0 
to 1. Likewise, the second integral requires x as a function of y. Consider first the path 
shown in Fig. 1.25. Then 

W = -( 0 dx+ f \dy — 1, (1.95d) 

Jo Jo 

since y — 0 along the first segment of the path and x = 1 along the second. If we select the 
path [x = 0,0 ^ y ^ 1] and [0 ^ x ^ 1, y = 1], then Eq. (1.95c) gives W = — 1. For this 
force the work done depends on the choice of path. ■ 



Surface Integrals 

Surface integrals appear in the same forms as line integrals, the element of area also being 
a vector, dar. 20 Often this area element is written nd A, in which n is a unit (normal) vector 
to indicate the positive direction. 21 There are two conventions for choosing the positive 
direction. First, if the surface is a closed surface, we agree to take the outward normal 
as positive. Second, if the surface is an open surface, the positive normal depends on the 
direction in which the perimeter of the open surface is traversed. If the right-hand fingers 


-°Recall that in Section 1.4 the area (of a parallelogram) is represented by a cross-product vector. 
21 Although n always has unit length, its direction may well be a function of position. 
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Figure 1.26 Right-hand rule for 
the positive normal. 


are placed in the direction of travel around the perimeter, the positive normal is indicated by 
the thumb of the right hand. As an illustration, a circle in the .rv-plane (Fig. 1.26) mapped 
out from x to y to —x to —y and back to x will have its positive normal parallel to the 
positive z-axis (for the right-handed coordinate system). 

Analogous to the line integrals, Eqs. (1.92a) to (1.92c), surface integrals may appear in 
the forms 


/ 


< pda , 


J V da, 


/Vx da. 


Again, the dot product is by far the most commonly encountered form. The surface integral 
/ V • da may be interpreted as a flow or flux through the given surface. This is really what 
we did in Section 1.7 to obtain the significance of the term divergence. This identification 
reappears in Section 1.11 as Gauss’ theorem. Note that both physically and from the dot 
product the tangential components of the velocity contribute nothing to the flow through 
the surface. 


Volume Integrals 

Volume integrals are somewhat simpler, for the volume element iir is a scalar quantity. 22 
We have 


j Ydr=x f V x dr+y j V y dr+i. f V z dr, (1-96) 

Jv Jv Jv Jv 

again reducing the vector integral to a vector sum of scalar integrals. 


“Frequently the symbols <r/~V and tPx are used to denote a volume element in coordinate (xyz or * 1 * 2 x 3 ) space. 
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Figure 1 .27 Differential rectangular parallelepiped (origin at center). 


Integral Definitions of Gradient, Divergence, and Curl 

One interesting and significant application of our surface and volume integrals is their use 
in developing alternate definitions of our differential relations. We find 


f wda 

V<p= lim J / , 

/ dT^o J dr 

(1.97) 

b 

> ^ 

o 

j J 

ii 

> 

> 

(1.98) 

f da x V 

V x V = lim J . 

fd r^o J dr 

(1.99) 


In these three equations f dr is the volume of a small region of space and da is the vector 
area element of this volume. The identification of Eq. (1.98) as the divergence of V was 
carried out in Section 1.7. Here we show that Eq. (1.97) is consistent with our earlier 
definition of Vy? (Eq. (1.60)). For simplicity we choose dr to be the differential volume 
dxdydz (Fig. 1.27). This time we place the origin at the geometric center of our volume 
element. The area integral leads to six integrals, one for each of the six faces. Remembering 
that da is outward, da ■ x = — \da\ for surface EFHG, and +\da\ for surface ABDC, we 
have 
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Using the total variations, we evaluate each integrand at the origin with a correction in¬ 
cluded to correct for the displacement (±dx/ 2, etc.) of the center of the face from the 
origin. Having chosen the total volume to be of differential size ( f dr = dxdydz ), we 
drop the integral signs on the right and obtain 


/ 


(pda = 



„ 3 <p 

+ y^-- 
3 y 


, 3 cp 
'~dz 


dxdydz. 


( 1 . 100 ) 


Dividing by 

J dr — dx dy dz, 

we verify Eq. (1.97). 

This verification has been oversimplified in ignoring other correction terms beyond the 
first derivatives. These additional terms, which are introduced in Section 5.6 when the 
Taylor expansion is developed, vanish in the limit 


/ 


dr 0 (dx -* 0, dy -» 0 ,dz—> 0). 


This, of course, is the reason for specifying in Eqs. (1.97), (1.98), and (1.99) that this limit 
be taken. Verification of Eq. (1.99) follows these same lines exactly, using a differential 
volume dxdydz. 


Exercises 


1.10.1 The force field acting on a two-dimensional linear oscillator may be described by 

F = —xkx — yky. 

Compare the work done moving against this force field when going from (1,1) to (4,4) 
by the following straight-line paths: 


(a) (1, 1) -> (4, 1) —»■ (4,4) 

(b) (1,1) ->(1,4) ->(4,4) 

(c) (1, 1) —* (4,4) along x = y. 

This means evaluating 


along each path. 



F • dr 


1.10.2 Find the work done going around a unit circle in the xy-plane: 


(a) counterclockwise from 0 to n, 

(b) clockwise from 0 to — n, doing work against a force field given by 

F — + y* 

x 2 + y 2 x 2 + y 2 

Note that the work done depends on the path. 
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1.10.3 Calculate the work you do in going from point (1, 1) to point (3, 3). The force you exert 
is given by 


F = x(x — y) + y(x + y). 


Specify clearly the path you choose. Note that this force field is nonconservative. 

1.10.4 Evaluate r • dr. 

Note. The symbol <p means that the path of integration is a closed loop. 

1.10.5 Evaluate 

1 f 

- r da 

3 J s 

over the unit cube defined by the point (0, 0, 0) and the unit intercepts on the positive 
x-, y-, and '-axes. Note that (a) r • da is zero for three of the surfaces and (b) each of 
the three remaining surfaces contributes the same amount to the integral. 

1.10.6 Show, by expansion of the surface integral, that 


lim 

fdr^O 


f s da x V 
fdr 


= V x V. 


Hint. Choose the volume f dr to be a differential volume dx dy dz. 


1.11 Gauss’ Theorem 

Here we derive a useful relation between a surface integral of a vector and the volume inte¬ 
gral of the divergence of that vector. Let us assume that the vector V and its first derivatives 
are continuous over the simply connected region (that does not have any holes, such as a 
donut) of interest. Then Gauss’ theorem states that 

(1.101a) 

In words, the surface integral of a vector over a closed surface equals the volume integral 
of the divergence of that vector integrated over the volume enclosed by the surface. 

Imagine that volume V is subdivided into an arbitrarily large number of tiny (differen¬ 
tial) parallelepipeds. For each parallelepiped 

V do = V Ydr (1.101b) 

six surfaces 

from the analysis of Section 1.7, Eq. (1.66), with p\ replaced by V. The summation is 
over the six faces of the parallelepiped. Summing over all parallelepipeds, we find that the 
V • da terms cancel (pairwise) for all interior faces; only the contributions of the exterior 
surfaces survive (Fig. 1.28). Analogous to the definition of a Riemann integral as the limit 
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Figure 1.28 Exact 
cancellation of da 's on 
interior surfaces. No 
cancellation on the 
exterior surface. 


of a sum, we take the limit as the number of parallelepipeds approaches infinity (—> oo) 
and the dimensions of each approach zero (-* 0): 

£ Y-da = £ Y-Ydr 

exterior surfaces volumes 

Is V ■ da = f v Y-Ydr. 

The result is Eq. (1.101a), Gauss’ theorem. 

From a physical point of view Eq. (1.66) has established V • V as the net outflow of 
fluid per unit volume. The volume integral then gives the total net outflow. But the surface 
integral f V- da is just another way of expressing this same quantity, which is the equality. 
Gauss’ theorem. 


Green’s Theorem 


A frequently useful corollary of Gauss’ theorem is a relation known as Green’s theorem. If 
u and v are two scalar functions, we have the identities 


V • (u Yv) = mV • Yv + (Yu) ■ (Yv), (1.102) 

V • (v Yu) = vY ■ Yu + (Yv) ■ (Yu). (1.103) 


Subtracting Eq. (1.103) from Eq. (1.102), integrating over a volume ( u,v , and their 
derivatives, assumed continuous), and applying Eq. (1.101a) (Gauss’ theorem), we obtain 



(mV • Vr — vY ■ Yu)d r = 



(mVd — vYu) ■ da. 


(1.104) 
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This is Green’s theorem. We use it for developing Green’s functions in Chapter 9. An 
alternate form of Green’s theorem, derived from Eq. (1.102) alone, is 


C ft ) uVvda= fff i 

JJ dV JJJv 


mV • V vdr 


ill 


Vm • Yvdr . 


(1.105) 


This is the form of Green’s theorem used in Section 1.16. 


Alternate Forms of Gauss’ Theorem 


Although Eq. (1.101a) involving the divergence is by far the most important form of Gauss’ 
theorem, volume integrals involving the gradient and the curl may also appear. Suppose 

Y(x,y,z)=V(x,y,z) a, (1.106) 


in which a is a vector with constant magnitude and constant but arbitrary direction. (You 
pick the direction, but once you have chosen it, hold it fixed.) Equation (1.101a) becomes 


a 



vd °=iil 


V •aV dr = a • 



V V dr 


(1.107) 


by Eq. (1.67b). This may be rewritten 


a 



v ‘ < °-ffl 


V V dr 


= 0 . 


(1.108) 


Since |a| ^ 0 and its direction is arbitrary, meaning that the cosine of the included angle 
cannot always vanish, the terms in brackets must be zero. 23 The result is 



vd ° = ffl 


YVdr. 


(1.109) 


In a similar manner, using V = a x P in which a is a constant vector, we may show 


<j ft dcrx P= fff V 
JJdV JJJv 


x Pdr. 


( 1 . 110 ) 


These last two forms of Gauss’ theorem are used in the vector form of Kirchoff diffraction 
theory. They may also be used to verify Eqs. (1.97) and (1.99). Gauss’ theorem may also 
be extended to tensors (see Section 2.11). 


Exercises 


l.ll.l 


Using Gauss’ theorem, prove that 


if S — 3 V is a closed surface. 



da — 0 


- 3 This exploitation of the arbitrary nature of a part of a problem is a valuable and widely used technique. The arbitrary vector 
is used again in Sections 1.12 and 1.13. Other examples appear in Section 1.14 (integrands equated) and in Section 2.8, quotient 
rule. 
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1.11.2 Show that 



r • da — V, 


where V is the volume enclosed by the closed surface S — dV. 
Note. This is a generalization of Exercise 1.10.5. 


1.11.3 If B = V x A, show that 


for any closed surface S. 



B • da = 0 


1.11.4 Over some volume V let x// be a solution of Laplace’s equation (with the derivatives 
appearing there continuous). Prove that the integral over any closed surface in V of the 
normal derivative of i// (dxfr/dn, or Vi/r • n) will be zero. 


1.11.5 In analogy to the integral definition of gradient, divergence, and curl of Section 1.10, 
show that 


V 2 ep — lim 
fdr^Q 


f Nep ■ da 
Idr 


1.11.6 The electric displacement vector D satisfies the Maxwell equation V • D = p, where p 
is the charge density (per unit volume). At the boundary between two media there is a 
surface charge density a (per unit area). Show that a boundary condition for D is 


(D 2 - D|) • n = cr. 


n is a unit vector normal to the surface and out of medium 1. 

Hint. Consider a thin pillbox as shown in Fig. 1.29. 

1.11.7 From Eq. (1.67b), with V the electric field E and f the electrostatic potential <p, show 
that, for integration over all space, 

J pep dr = so J E 2 dr. 

This corresponds to a three-dimensional integration by parts. 

Hint. E = —N(p. V • E = p/sq. You may assume that ep vanishes at large r at least as 
fast as r~ l . 



Figure 1.29 Pillbox. 
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1.11.8 A particular steady-state electric current distribution is localized in space. Choosing a 
bounding surface far enough out so that the current density J is zero everywhere on the 
surface, show that 

Hint. Take one component of J at a time. With V • J = 0, show that J, = V • (x, J) and 
apply Gauss’ theorem. 


1.11.9 


The creation of a localized system of steady electric currents (current density J) and 
magnetic fields may be shown to require an amount of work 


Transform this into 




/// 

/// 


H B dr. 


J ■ Adr. 


Here A is the magnetic vector potential: V xA = B. 

Hint. In Maxwell’s equations take the displacement current term 3D/3 1 = 0. If the fields 
and currents are localized, a bounding surface may be taken far enough out so that the 
integrals of the fields and currents over the surface yield zero. 


1.11.10 Prove the generalization of Green’s theorem: 



(vCu — uCv)dr = 



u — uVv) ■ da. 


Here C is the self-adjoint operator (Section 10.1), 


£ = V • [p(r)V] + q(r) 


and p.q. n , and v are functions of position, p and q having continuous first derivatives 
and u and v having continuous second derivatives. 

Note. This generalized Green’s theorem appears in Section 9.7. 


1.12 Stokes’Theorem 

Gauss’ theorem relates the volume integral of a derivative of a function to an integral of 
the function over the closed surface bounding the volume. Here we consider an analogous 
relation between the surface integral of a derivative of a function and the line integral of 
the function, the path of integration being the perimeter bounding the surface. 

Let us take the surface and subdivide it into a network of arbitrarily small rectangles. 
In Section 1.8 we showed that the circulation about such a differential rectangle (in the 
xy-plane) is V x V|. dx dy. From Eq. (1.76) applied to one differential rectangle, 

V-<tt = V x \ da. 

four sides 


(nil) 
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Figure 1.30 Exact cancellation on 
interior paths. No cancellation on the 
exterior path. 


We sum over all the little rectangles, as in the definition of a Riemann integral. The surface 
contributions (right-hand side of Eq. (1.111)) are added together. The line integrals (left- 
hand side of Eq. (1.111)) of all interior line segments cancel identically. Only the line 
integral around the perimeter survives (Fig. 1.30). Taking the usual limit as the number of 
rectangles approaches infinity while dx —> 0, dy —► 0, we have 


exterior line 
segments 


£ V x V • da 

rectangles 




V -dX = / V xY-da. 

Is 


( 1 . 112 ) 


This is Stokes’ theorem. The surface integral on the right is over the surface bounded 
by the perimeter or contour, for the line integral on the left. The direction of the vector 
representing the area is out of the paper plane toward the reader if the direction of traversal 
around the contour for the line integral is in the positive mathematical sense, as shown in 
Fig. 1.30. 

This demonstration of Stokes’ theorem is limited by the fact that we used a Maclaurin 
expansion of V(x, y, z) in establishing Eq. (1.76) in Section 1.8. Actually we need only 
demand that the curl of V(x, y, z) exist and that it be integrable over the surface. A proof 
of the Cauchy integral theorem analogous to the development of Stokes’ theorem here but 
using these less restrictive conditions appears in Section 6.3. 

Stokes’ theorem obviously applies to an open surface. It is possible to consider a closed 
surface as a limiting case of an open surface, with the opening (and therefore the perimeter) 
shrinking to zero. This is the point of Exercise 1.12.7. 
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Alternate Forms of Stokes’ Theorem 


As with Gauss’ theorem, other relations between surface and line integrals are possible. 
We find 


L 


da x Vy> = 



(1.113) 


and 


L 


{da x V) x P= <f> (ilxP. 


as 


(1.114) 


Equation (1.113) may readily be verified by the substitution V = a <p, in which a is a vec¬ 
tor of constant magnitude and of constant direction, as in Section 1.11. Substituting into 
Stokes’ theorem, Eq. (1.112), 


For the line integral. 


L 


(V x 2 up) • da = — / ax • da 


-h 

-7 S 


Wcp x da. 


(1.115) 


and we obtain 



acp ■ dX = a • 



cpdX. 


a 


(<j) (pdX + J V(p x do^J =0. 


(1.116) 

(1.117) 


Since the choice of direction of a is arbitrary, the expression in parentheses must vanish, 
thus verifying Eq. (1.113). Equation (1.114) may be derived similarly by using V = a x P, 
in which a is again a constant vector. 

We can use Stokes’ theorem to derive Oersted’s and Faraday’s laws from two of 
Maxwell’s equations, and vice versa, thus recognizing that the former are an integrated 
form of the latter. 


Example 1.12.1 Oersted’s and Faraday’s Laws 

Consider the magnetic field generated by a long wire that carries a stationary current 7. 
Starting from Maxwell’s differential law V xH = J, Eq. (1.89) (with Maxwell’s displace¬ 
ment current 3D/3/ = 0 for a stationary current case by Ohm’s law), we integrate over a 
closed area S perpendicular to and surrounding the wire and apply Stokes’ theorem to get 

I = f J • da = / (V x H) • da = (f H • dr, 

Js Js Jas 

which is Oersted’s law. Here the line integral is along 3 S, the closed curve surrounding the 
cross-sectional area S. 
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Similarly, we can integrate Maxwell’s equation for V x E, Eq. (1.86d), to yield Faraday’s 
induction law. Imagine moving a closed loop (3 S) of wire (of area S ) across a magnetic 
induction field B. We integrate Maxwell’s equation and use Stokes’ theorem, yielding 

f d f d 4> 

E • dr — / (V x E) • <ftr =-/ B ■ dcr = -, 

Js dt Js dt 

which is Faraday’s law. The line integral on the left-hand side represents the voltage in¬ 
duced in the wire loop, while the right-hand side is the change with time of the magnetic 
flux O through the moving surface S of the wire. ■ 



Both Stokes’ and Gauss’ theorems are of tremendous importance in a wide variety of 
problems involving vector calculus. Some idea of their power and versatility may be ob¬ 
tained from the exercises of Sections 1.11 and 1.12 and the development of potential theory 
in Sections 1.13 and 1.14. 


Exercises 


1 . 12.1 


1.12.2 


Given a vector t = —xy + yx, show, with the help of Stokes’ theorem, that the integral 
around a continuous closed curve in the xy-plane 


1 

2 


t • dX = - 
2 


(x dy — y dx) — A, 


the area enclosed by the curve. 

The calculation of the magnetic moment of a current loop leads to the line integral 


r x dr. 


(a) Integrate around the perimeter of a current loop (in the .ry-plane) and show that 
the scalar magnitude of this line integral is twice the area of the enclosed surface. 

(b) The perimeter of an ellipse is described by r = xa cos 0 + yb sin 6. From part (a) 
show that the area of the ellipse is nab. 


1.12.3 Evaluate £r x dr by using the alternate form of Stokes’ theorem given by Eq. (1.114): 


l 


(dcr xV)xP=(i(ttxP. 


Take the loop to be entirely in the xy- plane. 


1.12.4 In steady state the magnetic field H satisfies the Maxwell equation V x H = J, where J 
is the current density (per square meter). At the boundary between two media there is a 
surface current density K. Show that a boundary condition on H is 


nx (H 2 — Hi) = K. 


n is a unit vector normal to the surface and out of medium 1. 

Hint. Consider a narrow loop perpendicular to the interface as shown in Fig. 1.31. 
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medium 2 


medium 1 

Figure 1.31 
Integration path 
at the boundary 
of two media. 


1.12.5 From Maxwell’s equations, V x H = J, with J here the current density and E = 0. Show 
from this that 


H dr = I, 


where I is the net electric current enclosed by the loop integral. These are the differential 
and integral forms of Ampere’s law of magnetism. 

1.12.6 A magnetic induction B is generated by electric current in a ring of radius R. Show that 
the magnitude of the vector potential A (B = V x A) at the ring can be 

V 


|A| = 


2n R 


where <p is the total magnetic flux passing through the ring. 

Note. A is tangential to the ring and may be changed by adding the gradient of a scalar 
function. 


1.12.7 Prove that 


L 


V x V • da = 0, 


if S is a closed surface. 

1.12.8 Evaluate <fr ■ dr (Exercise 1.10.4) by Stokes’ theorem. 

1.12.9 Prove that 


mV v ■ dX — — <t> vVu • dX. 


1.12.10 Prove that 


iiWv-dX — J (Vw) x (Vu) • da. 


1.13 Potential Theory 


Scalar Potential 

If a force over a given simply connected region of space S (which means that it has no 
holes) can be expressed as the negative gradient of a scalar function (p, 


F = —Vcp, 


( 1 . 118 ) 
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we call (p a scalar potential that describes the force by one function instead of three. A scalar 
potential is only determined up to an additive constant, which can be used to adjust its value 
at infinity (usually zero) or at some other point. The force F appearing as the negative 
gradient of a single-valued scalar potential is labeled a conservative force. We want to 
know when a scalar potential function exists. To answer this question we establish two 
other relations as equivalent to Eq. (1.118). These are 

VxF = 0 (1.119) 


and 


F • dr = 0, 


( 1 . 120 ) 


for every closed path in our simply connected region S. We proceed to show that each of 
these three equations implies the other two. Let us start with 


F = —Vcp. 


Then 


( 1 . 121 ) 


V x F = — V x V(p — 0 


( 1 . 122 ) 


by Eq. (1.82) or Eq. (1.118) implies Eq. (1.119). Turning to the line integral, we have 


F ■ dr — — (b V(p ■ dr — — (b dip, 


(1.123) 


using Eq. (1.118). Now, dip integrates to give ip. Since we have specified a closed loop, 
the end points coincide and we get zero for every closed path in our region S for which 
Eq. (1.118) holds. It is important to note the restriction here that the potential be single¬ 
valued and that Eq. (1.118) hold for all points in S. This problem may arise in using a scalar 
magnetic potential, a perfectly valid procedure as long as no net current is encircled. As 
soon as we choose a path in space that encircles a net current, the scalar magnetic potential 
ceases to be single-valued and our analysis no longer applies. 

Continuing this demonstration of equivalence, let us assume that Eq. (1.120) holds. If 
ji F • dr = 0 for all paths in S, we see that the value of the integral joining two distinct 
points A and B is independent of the path (Fig. 1.32). Our premise is that 


F • dr = 0. 


ACBDA 


(1.124) 


Therefore 

I F dr = - I F ■ dr — j F ■ dr, (1.125) 

Jacb Jbda Jadb 

reversing the sign by reversing the direction of integration. Physically, this means that 
the work done in going from A to B is independent of the path and that the work done in 
going around a closed path is zero. This is the reason for labeling such a force conservative: 
Energy is conserved. 
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Figure 1.32 Possible paths for doing work. 


With the result shown in Eq. (1.125), we have the work done dependent only on the 
endpoints A and B. That is. 


f B 

work done by force = / F • dr — cp(A) — cp(B). (1.126) 


Equation (1.126) defines a scalar potential (strictly speaking, the difference in potential 
between points A and B) and provides a means of calculating the potential. If point B 
is taken as a variable, say, (x,y,z), then differentiation with respect to x, y, and z will 
recover Eq. (1.118). 

The choice of sign on the right-hand side is arbitrary. The choice here is made to achieve 
agreement with Eq. (1.118) and to ensure that water will run downhill rather than uphill. 
For points A and B separated by a length d r, Eq. (1.126) becomes 

F ■ dr ——dcp ——Wcp ■ dr. (1.127) 


This may be rewritten 


(F + V</>) • dr — 0, 

and since <ir is arbitrary, Eq. (1.118) must follow. If 


F • dr = 0, 


(1.128) 


(1.129) 


we may obtain Eq. (1.119) by using Stokes’ theorem (Eq. (1.112)): 

(j)F ■ dr = J VxF-(/<r. (1.130) 

If we take the path of integration to be the perimeter of an arbitrary differential area da. 
the integrand in the surface integral must vanish. Hence Eq. (1.120) implies Eq. (1.119). 

Finally, if V x F = 0, we need only reverse our statement of Stokes’ theorem 
(Eq. (1.130)) to derive Eq. (1.120). Then, by Eqs. (1.126) to (1.128), the initial statement 
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Figure 1.33 Equivalent formulations of a conservative force. 


<P 



Figure 1 .34 Potential energy versus distance (gravitational, 
centrifugal, and simple harmonic oscillator). 


F = —Vi -p is derived. The triple equivalence is demonstrated (Fig. 1.33). To summarize, 
a single-valued scalar potential function q> exists if and only if F is irrotational or the work 
done around every closed loop is zero. The gravitational and electrostatic force fields given 
by Eq. (1.79) are irrotational and therefore are conservative. Gravitational and electrostatic 
scalar potentials exist. Now, by calculating the work done (Eq. (1.126)), we proceed to 
determine three potentials (Fig. 1.34). 
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Example 1.13.1 Gravitational Potential 


Find the scalar potential for the gravitational force on a unit mass m \, 


F g = - 


G/Hl7«2? 
r 2 



(1.131) 


radially inward. By integrating Eq. (1.118) from infinity in to position r, we obtain 


<PG(r ) - <Pg(°o ) = - 



F g -dr = + 



F g • dr. 


(1.132) 


By use of F G = —F app iied, a comparison with Eq. (1.95a) shows that the potential is the 
work done in bringing the unit mass in from infinity. (We can define only potential dif¬ 
ference. Here we arbitrarily assign infinity to be a zero of potential.) The integral on the 
right-hand side of Eq. (1.132) is negative, meaning that <p G (r) is negative. Since F G is 
radial, we obtain a contribution to <p only when dr is radial, or 

kdr k Gm\m2 

<PG(r) = ~ -=- = — =-—. 

J, r- r r 


The final negative sign is a consequence of the attractive force of gravity. ■ 


Example 1.13.2 Centrifugal Potential 


Calculate the scalar potential for the centrifugal force per unit mass, F G = u> 2 r r, radially 
outward. Physically, you might feel this on a large horizontal spinning disk at an amuse¬ 
ment park. Proceeding as in Example 1.13.1 but integrating from the origin outward and 
taking <pc (0) = 0, we have 


<Pc(r) = 




F c • dr = — 


2 2 
arr* 


If we reverse signs, taking Fsho = — At, we obtain i^sho = \kr 2 , the simple harmonic 
oscillator potential. 

The gravitational, centrifugal, and simple harmonic oscillator potentials are shown in 
Fig. 1.34. Clearly, the simple harmonic oscillator yields stability and describes a restoring 
force. The centrifugal potential describes an unstable situation. ■ 


Thermodynamics — Exact Differentials 

In thermodynamics, which is sometimes called a search for exact differentials, we en¬ 
counter equations of the form 

1 if = P(x, y ) dx + Q(x, y ) dy. (1.133a) 

The usual problem is to determine whether f ( P(x , y) dx + Q(x , y)dy) depends only on 
the endpoints, that is, whether df is indeed an exact differential. The necessary and suffi¬ 
cient condition is that 

df df 
df = — dx + — dy 


(1.133b) 
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or that 


P(x,y) = df/dx, 
Q(x, y) = df/dy. 

Equations (1.133c) depend on satisfying the relation 

dP(x, y) _ dQ(x, y) 
3 y dx 


(1.133c) 


(1.133d) 


This, however, is exactly analogous to Eq. (1.119), the requirement that F be irrotational. 
Indeed, the "-component of Eq. (1.119) yields 


with 


_ dFy_ 
3 y dx 




(1.133e) 


Vector Potential 

In some branches of physics, especially electrodynamics, it is convenient to introduce a 
vector potential A such that a (force) field B is given by 

B = VxA. (1.134) 


Clearly, if Eq. (1.134) holds, V • B = 0 by Eq. (1.84) and B is solenoidal. Here we want 
to develop a converse, to show that when B is solenoidal a vector potential A exists. We 
demonstrate the existence of A by actually calculating it. Suppose B = xb\ + yb 2 + zb? 
and our unknown A = xa \ + ya 2 + z «3 . By Eq. (1.134), 


da 2 
3y 
dai 
3 z 
3 a 2 
dx 


dci 2 

3 z 
da?, 
dx 
dai 
dy 


= b t, 

(1.135a) 

= b 2 , 

(1.135b) 

= h. 

(1.135c) 


Let us assume that the coordinates have been chosen so that A is parallel to the vz-plane; 
that is, a i — 0. 24 Then 


, _ da 3 

2 dx 

, 3fl2 

b-x — -• 

dx 


(1.136) 


-^Clearly, this can be done at any one point. It is not at all obvious that this assumption will hold at all points; that is, A will be 
two-dimensional. The justification for the assumption is that it works; Eq. (1.141) satisfies Eq. (1.134). 
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Integrating, we obtain 


a 2 = b 2 dx + f 2 (y, z), 

J x 0 x 

a3 = - I b 2 dx + My,z), 

Jxi) 


(1.137) 


where f 2 and fj are arbitrary functions of y and z but not functions of x. These two 
equations can be checked by differentiating and recovering Eq. (1.136). Equation (1.135a) 
becomes 25 


903 _ 9fl2 __ I'Y—+ — — - — 

3 y 3 z 


da 2 da 2 f 

3 y 9z J X( 

-r- 

J xa 


3/3 _ 3/2 

3 y 3 z 


_ [ Xd h. dx + d A_ d A 

Jx o 9x 3 y dz ’ 


using V • B = 0. Integrating with respect to x, we obtain 

3«3 3(72 3/3 3/7 

- 7 — - — =bi(x,y,z) -bi(x 0 ,y,z) + -— 1 - 

dy dz dy dz 

Remembering that fj and f 2 are arbitrary functions of y and z, we choose 

f2 = 0, 

/3= [ bi(xo,y,z)dy. 


(1.138) 


(1.139) 


(1.140) 


so that the right-hand side of Eq. (1.139) reduces to b[(x,y,z), in agreement with 
Eq. (1.135a). With f 2 and given by Eq. (1.140), we can construct A: 


A = y / b 3 (x,y,z)dx+ z\ b\(x 0 ,y,z)dy ■ 


b 2 (x, y, z)dx 


(1.141) 


However, this is not quite complete. We may add any constant since B is a derivative of A. 
What is much more important, we may add any gradient of a scalar function V(p without 
affecting B at all. Finally, the functions f 2 and f 2 are not unique. Other choices could 
have been made. Instead of setting «i = 0 to get Eq. (1.136) any cyclic permutation of 
1,2, 3, x, y, z, xo, yo-i zo would also work. 

Example 1.13.3 A Magnetic Vector Potential FOR a Constant Magnetic Field 

To illustrate the construction of a magnetic vector potential, we take the special but still 
important case of a constant magnetic induction 


B = zB- 


(1.142) 


Leibniz’ formula in Exercise 9.6.13 is useful here. 
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in which B z is a constant. Equations (1.135a to c) become 

daj, 3fl2 _ q 
3 y 3 z 

3(71 3(73 

3 z dx 

3(72 3(71 

dx 3 y 

If we assume that a\ = 0, as before, then by Eq. (1.141) 


'/ 


A = y I B z dx = yxB z 


(1.143) 


(1.144) 


setting a constant of integration equal to zero. It can readily be seen that this A satisfies 
Eq. (1.134). 

To show that the choice ai = 0 was not sacred or at least not required, let us try setting 
< 7 3 = 0. From Eq. (1.143) 



^ = 0, 

3z 

(1.145a) 


^=0, 

dz 

(1.145b) 

3(77 


(1.145c) 

— 

-= B-. 

dx 

dy 

We see a i and cn_ are independent of z, or 


ai=ai(x,y), ai — a 2 (x,y). 

(1.146) 

Equation (1.145c) is satisfied if we take 

<72 = p j 

r 

1 B z dx = pxB z 

(1.147) 

and 

a\ — (P ~ 1) J 

f B z dy = (p-l)yB z , 

(1.148) 

with p any constant. Then 

3 

<x 

II 

< 

- 1 )yB- + y pxB z . 

(1.149) 


Again, Eqs. (1.134), (1.142), and (1.149) are seen to be consistent. Comparison of Eqs. 
(1.144) and (1.149) shows immediately that A is not unique. The difference between 
Eqs. (1.144) and (1.149) and the appearance of the parameter p in Eq. (1.149) may be 
accounted for by rewriting Eq. (1.149) as 

A = — ^ (xy - y. x)B z + (p - ^ (xy + y x)B- 
= -^(*y-yx)B z + (p - \\b 7 V(p 


(1.150) 
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with 


<p — xy. 


(1.151) 


The first term in A corresponds to the usual form 

A=^(Bxr) (1.152) 

forB, a constant. 

Adding a gradient of a scalar function, A say, to the vector potential A does not affect 
B, by Eq. (1.82); this is known as a gauge transformation (see Exercises 1.13.9 and 4.6.4): 

A^A'=A + VA. (1.153) 


Suppose now that the wave function fo solves the Schrodinger equation of quantum 
mechanics without magnetic induction field B, 

\^(-ihV) 2 + v - E \f 0 = 0, (1-154) 


describing a particle with mass m and charge e. When B is switched on, the wave equation 
becomes 


— (—ih V — eAr + V — E > \[r — 0. 
2m 


(1.155) 


Its solution f picks up a phase factor that depends on the coordinates in general, 


i jr (r) = exp 


fo(r). 





(1.156) 


From the relation 


(—ihV — eA)ifr — exp 


= exp 


ie r 

~h J 


- A-dr' 


ie C 

J 


- A-dr' 


(—ih'V — eAli/ro — ihilro —A 
h 


( ihV l/ro). 


(1.157) 


it is obvious that i jr solves Eq. (1.155) if i//o solves Eq. (1.154). The gauge covariant deriv¬ 
ative V — i (e/h )A describes the coupling of a charged particle with the magnetic field. It is 
often called minimal substitution and plays a central role in quantum electromagnetism, 
the first and simplest gauge theory in physics. 

To summarize this discussion of the vector potential. When a vector B is solenoidal, a 
vector potential A exists such that B = V x A. A is undetermined to within an additive 
gradient. This corresponds to the arbitrary zero of a potential, a constant of integration for 
the scalar potential. 

In many problems the magnetic vector potential A will be obtained from the current 
distribution that produces the magnetic induction B. This means solving Poisson’s (vector) 
equation (see Exercise 1.14.4). 
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Exercises 

1.13.1 If a force F is given by 

F = (x 2 + y 2 + z 2 )" (xx + yy + z z), 

find 

(a) V • F. 

(b) V x F. 

(c) A scalar potential tp(x,y,z) so that F = — Vip. 

(d) For what value of the exponent n does the scalar potential diverge at both the origin 
and infinity? 

ANS. (a) (2/t + 3)r 2 ", (b) 0. 

( c )- 2 ^T 2 '- 2 " +2 ’ «#-l,(d)n = -l, 

<p = — In r. 

1.13.2 A sphere of radius a is uniformly charged (throughout its volume). Construct the elec¬ 
trostatic potential tp{r) for 0 ^ r < oo. 

Hint. In Section 1.14 it is shown that the Coulomb force on a test charge at r = ro 
depends only on the charge at distances less than ro and is independent of the charge 
at distances greater than ro. Note that this applies to a spherically symmetric charge 
distribution. 

1.13.3 The usual problem in classical mechanics is to calculate the motion of a particle given 
the potential. For a uniform density (po), nonrotating massive sphere. Gauss’ law of 
Section 1.14 leads to a gravitational force on a unit mass mo at a point ro produced by 
the attraction of the mass at r ^ ro. The mass at r > ro contributes nothing to the force. 

(a) Show that F/mo = — (47rGpo/3)r, 0 SC r ^ a. where a is the radius of the sphere. 

(b) Find the corresponding gravitational potential, 0 ^ r ^ a. 

(c) Imagine a vertical hole running completely through the center of the Earth and out 
to the far side. Neglecting the rotation of the Earth and assuming a uniform density 
Po = 5.5 gm/cm 3 , calculate the nature of the motion of a particle dropped into the 
hole. What is its period? 

Note. F oc r is actually a very poor approximation. Because of varying density, 
the approximation F = constant along the outer half of a radial line and F oc r 
along the inner half is a much closer approximation. 

1.13.4 The origin of the Cartesian coordinates is at the Earth’s center. The moon is on the z- 
axis, a fixed distance R away (center-to-center distance). The tidal force exerted by the 
moon on a particle at the Earth’s surface (point x, y,z) is given by 

F x = -GMm , F y = -GMm -Ar, F z = +2GMm . 

R* R-* R* 

Find the potential that yields this tidal force. 
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ANS. 


GMm 
R 3 


2 1 i 1 2 

z -2*'-r v I' 


In terms of the Legendre polynomials of 
Chapter 12 this becomes 
GMm ? 

-^ 3 — r-P 2 (cos 0 ). 

1.13.5 A long, straight wire carrying a current I produces a magnetic induction B with com¬ 
ponents 


B 


_ /_y_ 


27t \ x 2 + y 2 ’ x 2 + y- 


:, 0 


Find a magnetic vector potential A. 

ANS. A = — z(noI/4 jt) ln(x 2 + y 2 ). (This solution is not unique.) 

1.13.6 If 


B 


x y z 


find a vector A such that V xA = B. One possible solution is 

xyz yxz 


A = 


r(x 2 + y 2 ) r{x 2j ry 2 ) 


1.13.7 Show that the pair of equations 


A=-(Bxr), B = V xA 
2 

is satisfied by any constant magnetic induction B. 

1.13.8 Vector B is formed by the product of two gradients 

B= (Vk) x (Vu), 

where u and v are scalar functions. 


(a) Show that B is solenoidal. 

(b) Show that 

1 

A = -(u Vu — u Vm) 

2 

is a vector potential for B, in that 

B = V x A. 

1.13.9 The magnetic induction B is related to the magnetic vector potential A by B — V x A. 
By Stokes’ theorem 


B • da — d) A ■ dr. 



1.14 Gauss’ Law, Poisson’s Equation 


79 


Show that each side of this equation is invariant under the gauge transformation, A -* 
A + W(p. 

Note. Take the function q> to be single-valued. The complete gauge transformation is 
considered in Exercise 4.6.4. 


1.13.10 


1.13.11 


With E the electric field and A the magnetic vector potential, show that [E + 3A/3r] is 
irrotational and that therefore we may write 


E — —N(p — 


3A 

~di' 


The total force on a charge q moving with velocity v is 


F = <?(E + v x B). 


Using the scalar and vector potentials, show that 


F = q 


d A 

-N(p -— + V(A • v) 

dt 


Note that we now have a total time derivative of A in place of the partial derivative of 
Exercise 1.13.10. 


1.14 Gauss’Law, Poisson’s Equation 
G auss’ Law 


Consider a point electric charge q at the origin of our coordinate system. This produces an 
electric field E given by 26 


E _ < 7 * 

4jtSor 2 ' 


(1.158) 


We now derive Gauss’ law, which states that the surface integral in Fig. 1.35 is q/so if the 
closed surface S — 3 V includes the origin (where q is located) and zero if the surface does 
not include the origin. The surface S is any closed surface; it need not be spherical. 

Using Gauss’ theorem, Eqs. (1.101a) and (1.101b) (and neglecting the q/A tt So), we 
obtain 


f r ■da f 


v | 4 


dr — 0 


(1.159) 


by Example 1.7.2, provided the surface S does not include the origin, where the integrands 
are not defined. This proves the second part of Gauss’ law. 

The first part, in which the surface S must include the origin, may be handled by sur¬ 
rounding the origin with a small sphere S' — dV 1 of radius 8 (Fig. 1.36). So that there 
will be no question what is inside and what is outside, imagine the volume outside the 
outer surface S and the volume inside surface S'(r < 8) connected by a small hole. This 


-®The electric field E is defined as the force per unit charge on a small stationary test charge q t : E = F /q t . From Coulomb's law 
the force on qt due to q is F = (qqt/ Ati sq)(t / r~). When we divide by qt, Eq. (1.158) follows. 





Figure 1.36 Exclusion of the origin. 

joins surfaces S and S', combining them into one single simply connected closed surface. 
Because the radius of the imaginary hole may be made vanishingly small, there is no ad¬ 
ditional contribution to the surface integral. The inner surface is deliberately chosen to be 
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spherical so that we will be able to integrate over it. Gauss’ theorem now applies to the 
volume between S and S' without any difficulty. We have 


L 


r • d (t 

r 2 



r • da’ 
~ S2“ 


= 0 . 


(1.160) 


We may evaluate the second integral, for da' = —r8 2 dQ, in which dQ is an element of 
solid angle. The minus sign appears because we agreed in Section 1.10 to have the positive 
normal F outward from the volume. In this case the outward F is in the negative radial 
direction, F = — r. By integrating over all angles, we have 


r r da' _ r r 

Js' 82 Js’ 


r8 2 dQ 


8 2 


= —47T, 


independent of the radius S. With the constants from Eq. (1.158), this results in 


L 


E • da = ——An = —, 


47T£o 


£o 


(1.161) 


(1.162) 


completing the proof of Gauss’ law. Notice that although the surface S may be spherical, 
it need not be spherical. Going just a bit further, we consider a distributed charge so that 


L 


q — I pdx. 


(1.163) 


Equation (1.162) still applies, with q now interpreted as the total distributed charge en¬ 
closed by surface S : 


f E • da — I —dr. 

Js Jv £o 


Using Gauss’ theorem, we have 


/ V • Edr = / —dr. 

Jv Jv £ 0 

Since our volume is completely arbitrary, the integrands must be equal, or 


(1.164) 


(1.165) 


V • E = —, 

£0 


(1.166) 


one of Maxwell’s equations. If we reverse the argument. Gauss’ law follows immediately 
from Maxwell’s equation. 


Poisson’s Equation 

If we replace E by — V</), Eq. (1.166) becomes 


p 

V • V<p = — —, 
£0 


(1.167a) 
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which is Poisson’s equation. For the condition p — 0 this reduces to an even more famous 
equation. 


V • V<p = 0, 


(1.167b) 


Laplace’s equation. We encounter Laplace’s equation frequently in discussing various co¬ 
ordinate systems (Chapter 2) and the special functions of mathematical physics that appear 
as its solutions. Poisson’s equation will be invaluable in developing the theory of Green’s 
functions (Section 9.7). 

From direct comparison of the Coulomb electrostatic force law and Newton’s law of 
universal gravitation. 


F E = 


l qiq2 ~ 

4nso r 2 


F g = -G 


in i m 2 „ 



All of the potential theory of this section applies equally well to gravitational potentials. 
For example, the gravitational Poisson equation is 


V • V<p = +4nGp, 


(1.168) 


with p now a mass density. 


Exercises 


1.14.1 Develop Gauss’ law for the two-dimensional case in which 


v — —q 


In p 

2nso ’ 


E = — Vip — q 


P 

2nsop 


Here q is the charge at the origin or the line charge per unit length if the two-dimensional 
system is a unit thickness slice of a three-dimensional (circular cylindrical) system. The 
variable p is measured radially outward from the line charge, p is the corresponding 
unit vector (see Section 2.4). 


1.14.2 (a) Show that Gauss’ law follows from Maxwell’s equation 

V • E = —. 

so 

Here p is the usual charge density. 

(b) Assuming that the electric field of a point charge q is spherically symmetric, show 
that Gauss’ law implies the Coulomb inverse square expression 

E * 

47T£o''“ 

1.14.3 Show that the value of the electrostatic potential ip at any point P is equal to the average 
of the potential over any spherical surface centered on P. There are no electric charges 
on or within the sphere. 

Hint. Use Green’s theorem, Eq. (1.104), with m -1 = r, the distance from P, and v — (p. 
Also note Eq. (1.170) in Section 1.15. 
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1.14.4 Using Maxwell’s equations, show that for a system (steady current) the magnetic vector 
potential A satisfies a vector Poisson equation, 

V 2 A = —/xqJ, 


provided we require V • A = 0. 

1.15 Dirac Delta Function 

From Example 1.6.1 and the development of Gauss’ law in Section 1.14, 

/v.v(l)*~/v.(') < i.- 

depending on whether or not the integration includes the origin r = 0. This result may be 
conveniently expressed by introducing the Dirac delta function. 


—47T 
0 , 


(1.169) 


V 2 ^ = —4t r <$(r) = -47tS(x)S(y)S(z). 


This Dirac delta function is defined by its assigned properties 


<$(.*) = 0 , x^O 



(1.170) 


(1.171a) 

(1.171b) 


where f (x) is any well-behaved function and the integration includes the origin. As a 
special case of Eq. (1.171b), 



S(x) dx — 1. 


(1.171c) 


From Eq. (1.171b), <5(.r) must be an infinitely high, infinitely thin spike at x = 0, as in the 
description of an impulsive force (Section 15.9) or the charge density for a point charge. 27 
The problem is that no such function exists, in the usual sense of function. However, the 
crucial property in Eq. (1.171b) can be developed rigorously as the limit of a sequence 
of functions, a distribution. For example, the delta function may be approximated by the 


- 7 The delta function is frequently invoked to describe very short-range forces, such as nuclear forces. It also appears in the 
normalization of continuum wave functions of quantum mechanics. Compare Eq. (1.193c) for plane-wave eigenfunctions. 
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v = 8 (x) 
- n x ' 


H-1-*- 


.V 


Figure 1.37 5-Sequence 
function. 



Figure 1.38 5-Sequence 
function. 


sequences of functions, Eqs. (1.172) to (1.175) and Figs. 1.37 to 1.40: 

' 0 , 


S n (x) = 


_ j_ 
2 n 


n , 


X < 

_2_ < v < J- 

2 n ^ ^ In 


S„ (x) = 
&n(x) - 
Sn (x) — 


—= exp (—n 2 x 2 ) 
y/TT 

n 1 
it 1 + n 2 x 2 
sin«;t 


TCX 


1 f n ■ 

= — e ,xr dt. 
2tt J— n 


(1.172) 

(1.173) 

(1.174) 

(1.175) 
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Figure 1.39 ^-Sequence function. 



Figure 1.40 ^-Sequence function. 


These approximations have varying degrees of usefulness. Equation (1.172) is useful in 
providing a simple derivation of the integral property, Eq. (1.171b). Equation (1.173) 
is convenient to differentiate. Its derivatives lead to the Hermite polynomials. Equa¬ 
tion (1.175) is particularly useful in Fourier analysis and in its applications to quantum 
mechanics. In the theory of Fourier series, Eq. (1.175) often appears (modified) as the 
Dirichlet kernel: 


SnW = 


1 sin[(n + j)x] 
sin(jx) 


(1.176) 


In using these approximations in Eq. (1.171b) and later, we assume that f(x ) is well be¬ 
haved— it offers no problems at large x. 
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For most physical purposes such approximations are quite adequate. From a mathemat¬ 
ical point of view the situation is still unsatisfactory: The limits 


lim 8 n {x) 

n—> oo 


do not exist. 

A way out of this difficulty is provided by the theory of distributions. Recognizing that 
Eq. (1.171b) is the fundamental property, we focus our attention on it rather than on S(x) 
itself. Equations (1.172) to (1.175) with n — 1,2.3,... may be interpreted as sequences of 
normalized functions: 



8 n {x)dx — 1. 


(1.177) 


The sequence of integrals has the limit 


lim 

n—> oo 



S n (x)f(x)dx = /(0). 


(1.178) 


Note that Eq. (1.178) is the limit of a sequence of integrals. Again, the limit of 8 n (x), 
n —> oo, does not exist. (The limits for all four forms of 8 n (x) diverge at x — 0.) 

We may treat <5(.r) consistently in the form 

/ OO AOO 

8(x)f(x)dx= lim / 8 n (x)f{x)dx. (1.179) 

-oo 


8(x) is labeled a distribution (not a function) defined by the sequences 8 n {x) as indicated 
in Eq. (1.179). We might emphasize that the integral on the left-hand side of Eq. (1.179) is 
not a Riemann integral. 28 It is a limit. 

This distribution 8 (x ) is only one of an infinity of possible distributions, but it is the one 
we are interested in because of Eq. (1.171b). 

From these sequences of functions we see that Dirac’s delta function must be even in x, 
8(—x) = 8(x). 

The integral property, Eq. (1.171b), is useful in cases where the argument of the delta 
function is a function g (x ) with simple zeros on the real axis, which leads to the rules 


1 

S(ax) — -8(x), a > 0, (1.180) 

a 


S(g(x))= Y' — ——• (1.181a) 

« 1^)1 
g(a)=0, 
g'(a)jt0 


Equation (1.180) may be written 



f(x)8(ax) dx = 



/(-W)rfy=-/(0), 

\a) a 


28 It can be treated as a Stieltjes integral if desired. 8(x)dx is replaced by du(x), where u{x) is the Heaviside step function 
(compare Exercise 1.15.13). 
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applying Eq. (1.171b). Equation (1.180) may be written as 8 (ax) — ff8(x) for a < 0. To 
prove Eq. (1.181a) we decompose the integral 


/ oo _ ra+e 

f(x)8(g(x))dx = ^ / f(x)8((x-a)g'(a))dx (1.181b) 

-OO J a — S 


into a sum of integrals over small intervals containing the zeros of g(x). In these intervals, 
g(x) ~ g(a) + (x — a)g'(a) = (x — a)g'(a). Using Eq. (1.180) on the right-hand side of 
Eq. (1.181b) we obtain the integral of Eq. (1.181a). 

Using integration by parts we can also define the derivative 8 ' (x) of the Dirac delta 
function by the relation 

/ OO 7*00 

f(x)8'(x—x')dx = —j f'(x)8(x — x') dx — — f'(x'). (1.182) 

-OO J —OO 

We use 8 (x) frequently and call it the Dirac delta function 29 — for historical reasons. 
Remember that it is not really a function. It is essentially a shorthand notation, defined 
implicitly as the limit of integrals in a sequence, S„(x), according to Eq. (1.179). It should 
be understood that our Dirac delta function has significance only as part of an integrand. 
In this spirit, the linear operator f dx S(x — xo) operates on f(x) and yields f(x o): 

/ OO 

8 (x-x 0 )f(x)dx — f(x 0 ). (1.183) 

-OO 

It may also be classified as a linear mapping or simply as a generalized function. Shift¬ 
ing our singularity to the point x = x' , we write the Dirac delta function as 8 (x — x'). 
Equation (1.171b) becomes 



f(x)8(x — x') dx — fix 1 ). 


(1.184) 


As a description of a singularity at x = x , the Dirac delta function may be written as 
8 (x — x') or as 8 (x' — x). Going to three dimensions and using spherical polar coordinates, 
we obtain 



8(r)r 2 dr sin 0 dO dcp = 



8(x)8(y)8 (z) dx dydz— 1. 


(1.185) 


This corresponds to a singularity (or source) at the origin. Again, if our source is at r = iq, 
Eq. (1.185) becomes 


Iff 


8 (r 2 — r i )r| dr 2 sin 62 d 02 dcp 2 = 1. 


(1.186) 


2 ^Dirac introduced the delta function to quantum mechanics. Actually, the delta function can be traced back to Kirchhoff, 1882. 
For further details see M. Jammer, The Conceptual Development of Quantum Mechanics. New York: McGraw-Hill (1966), 
p. 301. 
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Example 1.15.1 Total Charge Inside a Sphere 


Consider the total electric flux <^E do out of a sphere of radius R around the origin 
surrounding n charges ej, located at the points r ,• with r; < R, that is, inside the sphere. 
The electric field strength E = — V<p(r), where the potential 


^=E 


j =i 


r- r, 


f P(r' 

J l r — i 


} d 3 r' 


is the sum of the Coulomb potentials generated by each charge and the total charge density 
is p (r) = j ej8(r — r j). The delta function is used here as an abbreviation of a pointlike 
density. Now we use Gauss’ theorem for 


/ 


E • da — — <f) Vip • da — — J W 2 (pdr — 
of G; 

E e J f S(r-r J ) d r = J2 e j 


P(r) 


dr — 


E< 


s 0 So 

in conjunction with the differential form of Gauss’s law, V • E = —p/so, and 


Example 1.15.2 Phase Space 

In the scattering theory of relativistic particles using Feynman diagrams, we encounter the 
following integral over energy of the scattered particle (we set the velocity of light c = 1): 

J d 4 p8(p 2 -m 2 )f(p) = J d 3 p J dpo8(p%-p 2 -m 2 )f(p) 

_ r d 3 P f(E, p) ^ r d 3 P f(E, p) 

Je >0 2 y/m 2 + p 2 Je <o 2 s/m 1 + p 2 

where we have used Eq. (1.181a) at the zeros E — ±sjm 2 + p 2 of the argument of the 
delta function. The physical meaning of 8(p 2 — m 2 ) is that the particle of mass m and 
four-momentum p fl = (pa, p) is on its mass shell, because p 2 — in 2 is equivalent to E — 
±^/m 2 + p 2 . Thus, the on-mass-shell volume element in momentum space is the Lorentz 

invariant in contrast to the nonrelativistic d 3 p of momentum space. The fact that 
a negative energy occurs is a peculiarity of relativistic kinematics that is related to the 
antiparticle. ■ 

Delta Function Representation by Orthogonal 
Functions 

Dirac’s delta function 30 can be expanded in terms of any basis of real orthogonal functions 
{( Pn(x ), n — 0, 1,2,...}. Such functions will occur in Chapter 10 as solutions of ordinary 
differential equations of the Sturm-Liouville form. 

30 This section is optional here. It is not needed until Chapter 10. 
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They satisfy the orthogonality relations 

b 

dx = 8 m m (1.187) 

where the interval ( a , b ) may be infinite at either end or both ends. [For convenience we 
assume that ip n has been defined to include (w (x )) 1,2 if the orthogonality relations contain 
an additional positive weight function w(x).\ We use the <p n to expand the delta function 
as 


OO 

S(x - t) = y ^a n (t)(p n {x), 

n =0 


(1.188) 


where the coefficients a„ are functions of the variable t. Multiplying by <p m (x) and inte¬ 
grating over the orthogonality interval (Eq. (1.187)), we have 


f b 

a m (t) = I 8(x — t)(p m (x) dx = (p m (t) (1.189) 


or 


OO 

S(x - t) — y ^ (p n {t)(p n {x) = S(t - x). (1.190) 

n =0 


This series is assuredly not uniformly convergent (see Chapter 5), but it may be used as 
part of an integrand in which the ensuing integration will make it convergent (compare 
Section 5.5). 

Suppose we form the integral / F(t)S(t — x)dx , where it is assumed that F(t ) can be 
expanded in a series of orthogonal functions (p p {t ), a property called completeness. We 
then obtain 


/ . oo oo 

F(t)S(t - x)dt = / y^a p (pp{t) (x)(pn(t)dt 

J p =0 n =0 

OO 

- y^apVpjx) = F(x), (1.191) 

P =0 

the cross products / (p p (p n dt(n / p) vanishing by orthogonality (Eq. (1.187)). Referring 
back to the definition of the Dirac delta function, Eq. (1.171b), we see that our series 
representation, Eq. (1.190), satisfies the defining property of the Dirac delta function and 
therefore is a representation of it. This representation of the Dirac delta function is called 
closure. The assumption of completeness of a set of functions for expansion of 8{x — t) 
yields the closure relation. The converse, that closure implies completeness, is the topic of 
Exercise 1.15.16. 
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Integral Representations for the Delta Function 


Integral transforms, such as the Fourier integral 


F(co) — 



f(t)exp(ia>t)dt 


of Chapter 15, lead to the corresponding integral representations of Dirac’s delta function. 
For example, take 

8 n (t—x )=-—— -— = — f exp (icoit — x)) dco, (1.192) 

n(t—x) 2 jt J_„ ' 


using Eq. (1.175). We have 


/ OO 

f(t)8 n (t — x)dt, (1.193a) 

-OO 

where 8 n (t — x) is the sequence in Eq. (1.192) defining the distribution S(t — x). Note that 
Eq. (1.193a) assumes that fit ) is continuous at t — x. If we substitute Eq. (1.192) into 
Eq. (1.193a) we obtain 

/»00 />« 

fix)— lim — / f{t) I exp (icoit — x)) dcodt. (1.193b) 

'^o o 2 jt J-oo J- n 

Interchanging the order of integration and then taking the limit as n —»■ oo, we have the 
Fourier integral theorem, Eq. (15.20). 

With the understanding that it belongs under an integral sign, as in Eq. (1.193a), the 
identification 


1 r°° 

)—— / exp (icoit — x)) d a> 
2n J —(x) 


8 it — x) — 


provides a very useful integral representation of the delta function. 
When the Laplace transform (see Sections 15.1 and 15.9) 


-j£ 


L$is)= / exp(— st)8it — to) = exp(— sto), to > 0 


is inverted, we obtain the complex representation 

j ny+ioo 

'y-i• 


j ny+io o 

Sit - to) = z— / exp(j(f - t 0 )) ds, 

±-ttl Jy — ioo 


(1.193c) 


(1.194) 


(1.195) 


which is essentially equivalent to the previous Fourier representation of Dirac’s delta func¬ 
tion. 
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Exercises 

1.15.1 


1.15.2 


1.15.3 


1.15.4 


1.15.5 


Let 


Show that 


S n (x) — 


r o, 

n, 

0 , 


T*' , 

~2ii <X< 27,’ 
1 „ „ 


/ oo 

f(x)8 n (x)dx = /(0), 

-oo 


assuming that /(x) is continuous at x = 0. 

Verify that the sequence 8 n (x), based on the function 


8 n (x) — 



x < 0, 
x > 0, 


is a delta sequence (satisfying Eq. (1.178)). Note that the singularity is at +0, the posi¬ 
tive side of the origin. 

Hint. Replace the upper limit (oo) by c/n , where c is large but finite, and use the mean 
value theorem of integral calculus. 


For 


n 

8 n (x) = ~ 


2 V 2 ’ 


(Eq. (1.174)), show that 


/: 


tv 1 + n 2 x 


8„(x)dx = 1. 


Demonstrate that 8 n = sin nx /txx is a delta distribution by showing that 


/ °° sin nx 

fix) - dx = f{ 0). 

-oo 


nx 


Assume that f(x) is continuous at x — 0 and vanishes as x —> ±oo. 
Hint. Replace x by y/n and take limn —> oo before integrating. 

Fejer’s method of summing series is associated with the function 


1 I" sin(«r/2) 

Si. (t ) — 

2nn L sin(f/2) 


Show that 8„ ( t ) is a delta distribution, in the sense that 


1 

lim - 

»->oo 2nn 



sin(nf/2) 

sin(r/2) 


dt = /(0). 
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1 . 15.6 Prove that 

r i 1 

8\a(x — x\) \ — —8(x — X]). 
a 

Note. If <5[a(x — x ])] is considered even, relative to x\, the relation holds for negative a 
and 1 /a may be replaced by \/\a\. 

1 . 15.7 Show that 


1 . 15.8 


1 . 15.9 


1 . 15.10 


<$[(x - Xi)(x —X2)] = [<5(* -X\) + <$(•* - X 2 )]/|xi - xi\. 
Hint. Try using Exercise 1.15.6. 

2 2 

Using the Gauss error curve delta sequence ( S„ = -j= e~" x ), show that 


d 

x —5(x) = — <5 (y), 

dx 

treating 8(x) and its derivative as in Eq. (1.179). 
Show that 



8\x)f{x)dx = -f'( 0). 


Here we assume that fix) is continuous at x = 0. 
Prove that 


S(fW) 


df(x) 

dx 


-1 

8(x -x 0 ), 

X=X0 


where x'o is chosen so that f(x o) = 0. 
Hint. Note that 8(f) df — 5(x) dx. 


1 . 15.11 


1 . 15.12 


Show that in spherical polar coordinates ( r , cos0, cp) the delta function <5(ri — r 2 ) be¬ 
comes 

1 

-j8(r i — r 2 )S(cos 6\ -cos02)5(<^i -<pi). 
r i 

Generalize this to the curvilinear coordinates (q \, qi_. qf) of Section 2.1 with scale fac¬ 
tors hi, hi, and hj,. 


A rigorous development of Fourier transforms 31 includes as a theorem the relations 

f X2 sin ax 

f(u +x )- dx 


2 

lim — 

a- s-oo Jt 


/ 

J X\ 


f(u + 0) + f(u — 0), X| < 0 < X2 

f(u + 0), X\ = 0 < X2 

f(u — 0), X\ <0 — X2 

0, X| < X 2 < 0 or 0 < xi < X 2 - 

Verify these results using the Dirac delta function. 


31 1. N. Sneddon. Fourier Transforms. New York: McGraw-Hill (1951). 
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function. 


1.15.13 (a) If we define a sequence 5„(x) = n/(2cosh" nx), show that 


£ 


S n (x) dx = 1, independent of n. 


(b) Continuing this analysis, show that 


.32 


f s„ 

J —oo 


( x)dx = -[1 + tanhnx] = u n (x). 


lim u n (x) — 

n—> oo 


0, x < 0, 

1, x > 0. 


This is the Heaviside unit step function (Fig. 1.41). 

1 . 15.14 Show that the unit step function u(x) may be represented by 


1 1 f 

u(x) = - + —P J 


00 • dt 
e lxt ~, 
t 


2 27r i j —oo 

where P means Cauchy principal value (Section 7.1). 

1 . 15.15 As a variation of Eq. (1.175), take 

S„(x) = — e ixt ~W n dt. 

J — OO 

Show that this reduces to («/7r)l/(l +n 2 A' 2 ),Eq. (1.174), and that 

S n (x)dx = 1. 


£ 


Note. In terms of integral transforms, the initial equation here may be interpreted as 
either a Fourier exponential transform of e~^' n or a Laplace transform of e lxt . 


32 Many other symbols are used for this function. This is the AMS-55 (see footnote 4 on p. 330 for the reference) notation: u for 
unit. 
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1 . 15.16 (a) The Dirac delta function representation given by Eq. (1.190), 

oo 

S(x-t) — T>„ (x)<p n jt), 

n=0 

is often called the closure relation. For an orthonormal set of real functions, 
(p n , show that closure implies completeness, that is, Eq. (1.191) follows from 
Eq. (1.190). 

Hint. One can take 

F(x) = J F(t)8(x — t)dt. 

(b) Following the hint of part (a) you encounter the integral f F(t)cp n (t) dt. How do 
you know that this integral is finite? 

1 . 15.17 For the finite interval write the Dirac delta function 8(x — t) as a series of 

sines and cosines: sin nx, cos bx, n — 0, 1,2,... . Note that although these functions 
are orthogonal, they are not normalized to unity. 

1 . 15.18 In the interval (—zr, n), S n (x) = -?= exp (—n 2 x 2 ). 

-y 71 


(a) Write 8 n (.r) as a Fourier cosine series. 

(b) Show that your Fourier series agrees with a Fourier expansion of 8(x ) in the limit 
as n —>• oo. 

(c) Confirm the delta function nature of your Fourier series by showing that for any 
f{x) that is finite in the interval [— n, tt] and continuous at x = 0, 


/ f(x )[Fourier expansion of SooG*)] dx = /(0). 

-71 


1 . 15.19 (a) Write 8,fx) — A= exp(— n 2 x 2 ) in the interval (—oo, oo) as a Fourier integral and 

compare the limit n —>■ oo with Eq. (1.193c). 

(b) Write 8 n ix) — n exp(— nx) as a Laplace transform and compare the limit n -> oo 
with Eq. (1.195). 

Hint. See Eqs. (15.22) and (15.23) for (a) and Eq. (15.212) for (b). 

1 . 15.20 (a) Show that the Dirac delta function Mx — a), expanded in a Fourier sine series in 

the half-interval (0, L), (0 < a < L), is given by 



Note that this series actually describes 

—<5(x + a) + Six — a) in the interval (— L, L). 

(b) By integrating both sides of the preceding equation from 0 to x, show that the 
cosine expansion of the square wave 


fix) = 


0 , 

1 , 


0 ^ x < a 
a < x < L, 
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is, for 0 ^ x < L, 



(c) Verify that the term 

2 1 / njra\ , , 1 f L 

is (/«) =zj 0 /<*>*• 

1.15.21 Verify the Fourier cosine expansion of the square wave. Exercise 1.15.20(b), by direct 
calculation of the Fourier coefficients. 


1.15.22 We may define a sequence 


8„(x) = 


n, 

0 , 


|x| < 1 /2 n, 
|x| > 1/2 n. 


(This is Eq. (1.172).) Express S n (x ) as a Fourier integral (via the Fourier integral theo¬ 
rem, inverse transform, etc.). Finally, show that we may write 


8(x)= lim 8 n (x) = 
n-^-oo 


1 

2 7T 



dk. 


1.15.23 Using the sequence 


show that 


8„(x) — exp(—n 2 x 2 ), 

y/Tt 


8(x) = — [' e~ ikx dk. 
J— oo 


Note. Remember that 8(x) is defined in terms of its behavior as part of an integrand — 
especially Eqs. (1.178) and (1.189). 

1.15.24 Derive sine and cosine representations of 8 (t — x) that are comparable to the exponential 
representation, Eq. (1.193c). 

'y roo 'y roo 

ANS. z: J 0 sin&ir sincnx dco, ^ J 0 cos cot cos wx da>. 


1.16 Helmholtz’s Theorem 

In Section 1.13 it was emphasized that the choice of a magnetic vector potential A was not 
unique. The divergence of A was still undetermined. In this section two theorems about the 
divergence and curl of a vector are developed. The first theorem is as follows: 

A vector is uniquely specified by giving its divergence and its curl within a simply con¬ 
nected region (without holes) and its normal component over the boundary. 
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Note that the subregions, where the divergence and curl are defined (often in terms of 
Dirac delta functions), are part of our region and are not supposed to be removed here or 
in Helmholtz’s theorem, which follows. Let us take 


V-Vi=s, 
V x V] = c, 


(1.196) 


where s may be interpreted as a source (charge) density and c as a circulation (current) 
density. Assuming also that the normal component V\ n on the boundary is given, we want 
to show that Vi is unique. We do this by assuming the existence of a second vector, V 2 , 
which satisfies Eq. (1.196) and has the same normal component over the boundary, and 
then showing that Vi — V 2 = 0. Let 

W = Vi - v 2 . 


Then 


V-W = 0 (1.197) 

and 

V x W = 0. (1.198) 

Since W is irrotational we may write (by Section (1.13)) 

W = -V<p. (1.199) 

Substituting this into Eq. (1.197), we obtain 

V • Vy> = 0, (1.200) 

Laplace’s equation. 

Now we draw upon Green’s theorem in the form given in Eq. (1.105), letting 11 and v 
each equal tp. Since 

W„ = v 1„-V2n=0 (1.201) 

on the boundary. Green’s theorem reduces to 

[ (V<p)- (V(p)dr = [ W • Wcfr = 0 
J v Jv 

The quantity W • W = W 2 is nonnegative and so we must have 

W = V! - v 2 = 0 

everywhere. Thus V 1 is unique, proving the theorem. 

For our magnetic vector potential A the relation B = VxA specifies the curl of A. 
Often for convenience we set V • A = 0 (compare Exercise 1.14.4). Then (with boundary 
conditions) A is fixed. 

This theorem may be written as a uniqueness theorem for solutions of Laplace’s equa¬ 
tion, Exercise 1.16.1. In this form, this uniqueness theorem is of great importance in solv¬ 
ing electrostatic and other Laplace equation boundary value problems. If we can find a 
solution of Laplace’s equation that satisfies the necessary boundary conditions, then our 
solution is the complete solution. Such boundary value problems are taken up in Sec¬ 
tions 12.3 and 12.5. 


( 1 . 202 ) 

(1.203) 
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Helmholtz’s Theorem 

The second theorem we shall prove is Helmholtz’s theorem. 

A vector V satisfying Eq. (1.196) with both source and circulation densities vanishing 
at infinity may be written as the sum of two parts, one of which is irrotational, the other of 
which is solenoidal. 

Note that our region is simply connected, being all of space, for simplicity. Helmholtz’s 
theorem will clearly be satisfied if we may write V as 

V = —V<p + V x A, (1.204a) 

—V< p being irrotational and V x A being solenoidal. We proceed to justify Eq. (1.204a). 

V is a known vector. We take the divergence and curl 

V ■ V = ,v (r ) (1.204b) 

V x V = c(r) (1.204c) 

with s(r) and c(r) now known functions of position. From these two functions we construct 
a scalar potential </>(ri), 

1 f s(r 2 ) 

<p(ri) = 7“ / ^~dx 2 , (1.205a) 

47T J r 12 

and a vector potential A(ri), 

1 f c(r 2 ) 

A(iq)=-— / ——dt 2 . (1.205b) 

4 n J r 12 

If s = 0, then V is solenoidal and Eq. (1.205a) implies (p — 0. From Eq. (1.204a), V = 

V x A, with A as given in Eq. (1.141), which is consistent with Section 1.13. Further, 
if c = 0, then V is irrotational and Eq. (1.205b) implies A = 0, and Eq. (1.204a) implies 

V = — V< p, consistent with scalar potential theory of Section 1.13. 

Here the argument iq indicates (xj , yi, zi), the field point; r 2 , the coordinates of the 
source point (x 2 , y 2 , z 2 ), whereas 

n 2 = [(xi - x 2 ) 2 + (vi - y 2 ) 2 + (zi - Z 2 ) 2 ] 1/2 - (1.206) 

When a direction is associated with ri 2 , the positive direction is taken to be away from 
the source and toward the field point. Vectorially, ri 2 = ri — r 2 , as shown in Fig. 1.42. 
Of course, s and c must vanish sufficiently rapidly at large distance so that the integrals 
exist. The actual expansion and evaluation of integrals such as Eqs. (1.205a) and (1.205b) 
is treated in Section 12.1. 

From the uniqueness theorem at the beginning of this section, V is uniquely specified 
by its divergence, s, and curl, c (and boundary conditions). Returning to Eq. (1.204a), we 
have 


V-V = -V-V<p, (1.207a) 

the divergence of the curl vanishing, and 


VxV = Vx(VxA) 


(1.207b) 
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the curl of the gradient vanishing. If we can show that 

-V-V^)(ri) = j(ri) (1.207c) 

and 

V x (V x A(rO) = c(ri), (1.207d) 


then V as given in Eq. (1.204a) will have the proper divergence and curl. Our description 
will be internally consistent and Eq. (1.204a) justified. 33 
First, we consider the divergence of V: 

1 f s(r 2 ) 

V • V = -V • v<p =-V • V / ———dx 2 . (1.208) 

47r J r 12 

The Laplacian operator, V • V, or V 2 , operates on the field coordinates (xi, vi, zi) and so 
commutes with the integration with respect to (x 2 , y 2 , z 2 ). We have 


V-V=- 




dr 2 . 


(1.209) 


We must make two minor modifications in Eq. (1.169) before applying it. First, our source 
is at r 2 , not at the origin. This means that a nonzero result from Gauss’ law appears if and 
only if the surface S includes the point r = r 2 . To show this, we rewrite Eq. (1.170): 


V 2 



= —47rS(ri — r 2 ). 


( 1 . 210 ) 


33 Alternatively, we could solve Eq. (1.207c), Poisson's equation, and compare the solution with the constructed potential, 
Eq. (1.205a). The solution of Poisson’s equation is developed in Section 9.7. 
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This shift of the source to r 2 may be incorporated in the defining equation (1.171b) as 

S(n-r 2 ) = 0, r!^r 2 , (1.211a) 

I f(r l )S(r l -r 2 )dT l = f(r 2 ). (1.211b) 

Second, noting that differentiating rp 1 twice with respect to x 2 , y 2 , Z 2 is the same as 
differentiating twice with respect to x\, y i, z\ , we have 

V ‘(m) = V i(nt) = _4 ’ ,a(ri " r2) 

= -4^5(r 2 -n). (1.212) 

Rewriting Eq. (1.209) and using the Dirac delta function, Eq. (1.212), we may integrate to 
obtain 

v. v = -T/ s(r2)vi (T), r2 

= -^ J s(r 2 )(-4n)S(r 2 -ri)dT 2 

= s(ti). (1.213) 


The final step follows from Eq. (1.211b), with the subscripts 1 and 2 exchanged. Our 
result, Eq. (1.213), shows that the assumed forms of V and of the scalar potential <p are in 
agreement with the given divergence (Eq. (1.204b)). 

To complete the proof of Helmholtz’s theorem, we need to show that our assumptions are 
consistent with Eq. (1.204c), that is, that the curl of V is equal to c(ri). From Eq. (1.204a), 


VxV=Vx(VxA) 

= VV • A — V 2 A. 


(1.214) 


The first term, V V • A, leads to 


4ttVV • A = 


/ 


c(r 2 ) • V j V i 



d r 2 


(1.215) 


by Eq. (1.205b). Again replacing the second derivatives with respect to x\, yi, zi by second 
derivatives with respect to x 2 , y 2 , Z 2 , we integrate each component 34 of Eq. (1.215) by 
parts: 


4ttVV -A\ x 


f 

/ 


c(r 2 ) • Vt — ( — ) 

ax 2 Vm/ 


d t 2 


v 2 • 


c(r 2 ) 


9x 2 \r l2 


dX2 


-/[ v !c( r 2) ]T(-L) 


dX2- 


(1.216) 


34 This avoids creating the tensor C('r 2 )V 2 . 
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The second integral vanishes because the circulation density c is solenoidal. 35 The first 
integral may be transformed to a surface integral by Gauss’ theorem. If c is bounded in 
space or vanishes faster that 1 /r for large r, so that the integral in Eq. (1.205b) exists, 
then by choosing a sufficiently large surface the first integral on the right-hand side of 
Eq. (1.216) also vanishes. 

With V V • A = 0, Eq. (1.214) now reduces to 

VxV=—V 2 A = —- [ c(r 2 )V?| — )c/r 2 . (1.217) 

4tr J ~ \rnj 

This is exactly like Eq. (1.209) except that the scalar ,s(r 2 ) is replaced by the vector circu¬ 
lation density c(r 2 ). Introducing the Dirac delta function, as before, as a convenient way 
of carrying out the integration, we find that Eq. (1.217) reduces to Eq. (1.196). We see that 
our assumed forms of V, given by Eq. (1.204a), and of the vector potential A, given by 
Eq. (1.205b), are in agreement with Eq. (1.196) specifying the curl of V. 

This completes the proof of Helmholtz’s theorem, showing that a vector may be re¬ 
solved into irrotational and solenoidal parts. Applied to the electromagnetic field, we have 
resolved our field vector V into an irrotational electric field E, derived from a scalar po¬ 
tential <p, and a solenoidal magnetic induction field B, derived from a vector potential A. 
The source density s( r) may be interpreted as an electric charge density (divided by elec¬ 
tric permittivity e), whereas the circulation density c(r) becomes electric current density 
(times magnetic permeability /x). 


Exercises 


1.16.1 Implicit in this section is a proof that a function \j/( r) is uniquely specified by requiring 
it to (1) satisfy Laplace’s equation and (2) satisfy a complete set of boundary conditions. 
Develop this proof explicitly. 

1.16.2 (a) Assuming that P is a solution of the vector Poisson equation, VyP(ri) = — V(ri), 

develop an alternate proof of Helmholtz’s theorem, showing that V may be written 
as 


V = — Wcp + V x A, 

where 


and 


A = V x P, 


<p = V • P. 

(b) Solving the vector Poisson equation, we find 

V(r 2 ) 


P(ri) = — 


4?r J v 


V r l2 


d r 2 . 


Show that this solution substituted into <p and A of part (a) leads to the expressions 
given for cp and A in Section 1.16. 


35 


Remember, c = V x V is known. 
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Chapter 2 


Vector Analysis in 
Curved Coordinates 
and Tensors 


In Chapter 1 we restricted ourselves almost completely to rectangular or Cartesian coordi¬ 
nate systems. A Cartesian coordinate system offers the unique advantage that all three unit 
vectors, x, y, and z, are constant in direction as well as in magnitude. We did introduce the 
radial distance r, but even this was treated as a function of x, y, and z. Unfortunately, not 
all physical problems are well adapted to a solution in Cartesian coordinates. For instance, 
if we have a central force problem, F = f F(r), such as gravitational or electrostatic force, 
Cartesian coordinates may be unusually inappropriate. Such a problem demands the use of 
a coordinate system in which the radial distance is taken to be one of the coordinates, that 
is, spherical polar coordinates. 

The point is that the coordinate system should be chosen to fit the problem, to exploit 
any constraint or symmetry present in it. Then it is likely to be more readily soluble than if 
we had forced it into a Cartesian framework. 

Naturally, there is a price that must be paid for the use of a non-Cartesian coordinate 
system. We have not yet written expressions for gradient, divergence, or curl in any of the 
non-Cartesian coordinate systems. Such expressions are developed in general form in Sec¬ 
tion 2.2. First, we develop a system of curvilinear coordinates, a general system that may 
be specialized to any of the particular systems of interest. We shall specialize to circular 
cylindrical coordinates in Section 2.4 and to spherical polar coordinates in Section 2.5. 

2.1 Orthogonal Coordinates in M 3 

In Cartesian coordinates we deal with three mutually perpendicular families of planes: 
x — constant, y = constant, and z = constant. Imagine that we superimpose on this system 
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three other families of surfaces r/, (x, y. z), i = 1.2,3. The surfaces of any one family q, 
need not be parallel to each other and they need not be planes. If this is difficult to visualize, 
the figure of a specific coordinate system, such as Fig. 2.3, may be helpful. The three new 
families of surfaces need not be mutually perpendicular, but for simplicity we impose this 
condition (Eq. (2.7)) because orthogonal coordinates are common in physical applications. 
This orthogonality has many advantages: Orthogonal coordinates are almost like Cartesian 
coordinates where infinitesimal areas and volumes are products of coordinate differentials. 

In this section we develop the general formalism of orthogonal coordinates, derive from 
the geometry the coordinate differentials, and use them for line, area, and volume elements 
in multiple integrals and vector operators. We may describe any point (x, y, z) as the inter¬ 
section of three planes in Cartesian coordinates or as the intersection of the three surfaces 
that form our new, curvilinear coordinates. Describing the curvilinear coordinate surfaces 
by qi = constant, q 2 = constant, q 3 = constant, we may identify our point by ( q\ , q 2 , < 73 ) 
as well as by (x, y, z). 


General curvilinear coordinates Circular cylindrical coordinates 
<?t, <72, <73 P,<P,Z 

x = x(qi, < 72 , < 73 ) — 00 < x — p cos (p < 00 

y = y{qi,qi,qi) -oo <y = psin</) <oo (2.1) 

Z = z(<7l, < 72 , < 73 ) -00<Z = Z<00 

specifying x, y, z in terms of q \, c/2, c/3 and the inverse relations 

qi=qi(x,y,z) 0 < p = (x 2 + y 2 ) 1/2 < 00 

qi = qi{x,y,z) 0 < (p — arctan(y/x) < 2 n (2.2) 

q 3 = qz(x,y,z ) — oo<z — z<oo. 


As a specific illustration of the general, abstract q\, c/ 2 , c/ 3 , the transformation equations 
for circular cylindrical coordinates (Section 2.4) are included in Eqs. (2.1) and (2.2). With 
each family of surfaces c/; = constant, we can associate a unit vector q, normal to the 
surface < 7 , = constant and in the direction of increasing c/,. In general, these unit vectors 
will depend on the position in space. Then a vector V may be written 


V = qi Vi + q2 V 2 + q3 V 3 , 


(2.3) 


but the coordinate or position vector is different in general. 


r ^Qi<7i +Q2<72 + q3<73, 


as the special cases r = rr for spherical polar coordinates and r = pp + zz for cylindri¬ 
cal coordinates demonstrate. The q, are normalized to qr = 1 and form a right-handed 
coordinate system with volume qi • (q? x q 3 ) > 0. 

Differentiation of x in Eqs. (2.1) leads to the total variation or differential 

, 9* , 9* , 9x 

dx=-—dqi + - — dq 2 + - — dq 3 , (2.4) 

dqi dq 2 oq 3 

and similarly for differentiation of y and z. In vector notation dr — JT ^ dq From 
the Pythagorean theorem in Cartesian coordinates the square of the distance between two 
neighboring points is 

ds 2 = dx 2 + dy 2 + dz 2 . 
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Substituting dr shows that in our curvilinear coordinate space the square of the distance 
element can be written as a quadratic form in the differentials dq/: 

o 9 ^, 3 r 3 r 

ds — dr-dr = dr-—) -•- dqjdq , 

dqj dqj 

— gndq\ + gu dqi dq 2 + g 13 dqi dq 3 
+ gl\dqi dq 1 + g 2 2 dq 2 + g 2 3 dq 2 dq 3 
+ g 31 dq$ dqi + g 32 dq 2 dq 2 + g 33 dq 2 

= 'Y^gijdqidq j , (2.5) 

ij 


where nonzero mixed terms dq,dqj with i ^ j signal that these coordinates are not or¬ 
thogonal, that is, that the tangential directions q, are not mutually orthogonal. Spaces for 
which Eq. (2.5) is a legitimate expression are called metric or Riemannian. 

Writing Eq. (2.5) more explicitly, we see that 


gij(q\ : q 2 ,qi) 


dx dx 3y 3 y 3 z 3 z 
dqi 3 q/ dqi dq j dqi dqj 


dr dr 

dqi dqj 


(2.6) 


are scalar products of the tangent vectors to the curves r for qj = const., j / i. These 
coefficient functions g/j , which we now proceed to investigate, may be viewed as speci¬ 
fying the nature of the coordinate system (q\, q 2 , q 3 ). Collectively these coefficients are 
referred to as the metric and in Section 2.10 will be shown to form a second-rank sym¬ 
metric tensor. 1 In general relativity the metric components are determined by the proper¬ 
ties of matter; that is, the gjj are solutions of Einstein’s field equations with the energy- 
momentum tensor as driving term; this may be articulated as “geometry is merged with 
physics.” 

At usual we limit ourselves to orthogonal (mutually perpendicular surfaces) coordinate 
systems, which means (see Exercise 2.1.1) 2 


gij = 0, i±j, (2.7) 

and q, • O7 = 8 U■ (Nonorthogonal coordinate systems are considered in some detail in 
Sections 2.10 and 2.11 in the framework of tensor analysis.) Now, to simplify the notation, 
we write ga = hj > 0, so 


ds 2 = (hi dqi ) 2 + (h 2 dq 2 ) 2 + (h 3 dq 3 ) 2 — dqi) 2 . 

i 


(2.8) 


*The tensor nature of the set of gij ’s follows from the quotient rule (Section 2.8). Then the tensor transformation law yields 
Eq. (2.5). 

2 In relativistic cosmology the nondiagonal elements of the metric gij are usually set equal to zero as a consequence of physical 
assumptions such as no rotation, as for d(pdt,d6 dt. 
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The specific orthogonal coordinate systems are described in subsequent sections by spec¬ 
ifying these (positive) scale factors hi, h 2 , and I it,. Conversely, the scale factors may be 
conveniently identified by the relation 

9r 

dst = hi dqt, — = hi(\i (2.9) 

dqi 

for any given dqt, holding all other q constant. Here, dsi is a differential length along the 
direction q,-. Note that the three curvilinear coordinates q\ . < 72 , qi need not be lengths. The 
scale factors /;, may depend on q and they may have dimensions. The product /;, dqt must 
have a dimension of length. The differential distance vector dr may be written 

dr=hidqi qi + h 2 dq 2 qi + h^dq^qj, = ^ h / dqi q,. 


Using this curvilinear component form, we find that a line integral becomes 


/ v '*=?/ 

I 


V,hi dqi. 


From Eqs. (2.9) we may immediately develop the area and volume elements 

doij = dsi dsj — hjh / dqi dqj ( 2 . 10 ) 

and 

dr — ds 1 dsjdsT, — /z 1 /z2^3 dqi dq2 dqj. (2.11) 

The expressions in Eqs. (2.10) and (2.11) agree, of course, with the results of using 
the transformation equations, Eq. (2.1), and Jacobians (described shortly; see also Exer¬ 
cise 2.1.5). 

From Eq. (2.10) an area element may be expanded: 

da = ds2 ds-i qi + dsj ds\ q? + ds 1 ds2 q3 
= /z2/z 3 dq2dqi qi + /z3/z 1 dq^ dqi q? 

+ hili2dqi dq2 q3. 


A surface integral becomes 


J\ da 


/ 


V\h 2 h-}dq 2 dq-} + 


I 


V 2 /z 3 /z 1 dqi, dqi 



V 3 /z 1 /z 2 dqi dq 2 - 


(Examples of such line and surface integrals appear in Sections 2.4 and 2.5.) 
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In anticipation of the new forms of equations for vector calculus that appear in the 
next section, let us emphasize that vector algebra is the same in orthogonal curvilinear 
coordinates as in Cartesian coordinates. Specifically, for the dot product. 


( 2 . 12 ) 

where the subscripts indicate curvilinear components. For the cross product. 


(2.13) 


as in Eq. (1.40). 

Previously, we specialized to locally rectangular coordinates that are adapted to special 
symmetries. Let us now briefly look at the more general case, where the coordinates are 
not necessarily orthogonal. Surface and volume elements are part of multiple integrals, 
which are common in physical applications, such as center of mass determinations and 
moments of inertia. Typically, we choose coordinates according to the symmetry of the 
particular problem. In Chapter 1 we used Gauss’ theorem to transform a volume integral 
into a surface integral and Stokes’ theorem to transform a surface integral into a line in¬ 
tegral. For orthogonal coordinates, the surface and volume elements are simply products 
of the line elements hj dq, (see Eqs. (2.10) and (2.11)). For the general case, we use the 
geometric meaning of 3r /dq, in Eq. (2.5) as tangent vectors. We start with the Cartesian 
surface element d.x dy, which becomes an infinitesimal rectangle in the new coordinates 
£ 71 , <72 formed by the two incremental vectors 

3 r 

dvi =r(qi+dq\, q 2 ) - r(^i, q 2 ) = - — dq \, 

aqi 

3 r 

<^ r 2 = r(gi, q 2 + dq 2 ) — r{qi, q 2 ) = - — dq 2 , (2.14) 

3 <72 

whose area is the /-component of their cross product, or 

, , , , | r 3 * 3 y 9 x dy 1 

dx dy — dr\ x dr 2 1 =- dq\dq 2 

1 \_dqi dq 2 dq 2 dq\\ 

dx dx 

^ dqidq 2 . (2.15) 

dqi 3 qi 

The transformation coefficient in determinant form is called the Jacobian. 

Similarly, the volume element dx dy dz becomes the triple scalar product of the three in¬ 
finitesimal displacement vectors dv\ = dq, along the q, directions qj, which, according 








108 Chapter 2 Vector Analysis in Curved Coordinates and Tensors 


to Section 1.5, takes on the form 



dx 

dx 

dx 



dq\ 

dqi 

dqi 


dx dy dz = 

dy_ 

dqi 

dy_ 

dqi 

dy_ 

dq3 

dqi dq 2 dq 2 . 


9 z 

-dz_ 

_dz_ 



dqi 

dqi 

dq3 



Here the determinant is also called the Jacobian, and so on in higher dimensions. 

For orthogonal coordinates the Jacobians simplify to products of the orthogonal vec¬ 
tors in Eq. (2.9). It follows that they are just products of the h;\ for example, the volume 
Jacobian becomes 


hih 2 hi(qi x q 2 ) • q3 = hih 2 h 2 , 


and so on. 


Example 2. 7.7 Jacobians for Polar Coordinates 


Let us illustrate the transformation of the Cartesian two-dimensional volume element dx dy 
to polar coordinates p, <p, with x = p cos cp, y — p sin<p. (See also Section 2.4.) Here, 



dx 

dx 


dxdy = 

dp 

dy_ 

d(p 

dy 

dp dcp = 


dp 

dcp 



—p sincp 
pcoscp 


dpdcp — pdpdcp. 


Similarly, in spherical coordinates (see Section 2.5) we get, from x — r sin 6 cos <p, y = 
r sin 6 sin cp, z = r cos 0, the Jacobian 


dx 

dr 

_ ?x 

dr 

dz 

dr 

dx dx 

dO dcp 

dy dy _ 

d 6 dcp 

dz dz 
d 9 dcp 

sin 0 cos cp r cos 0 cos cp 
sin 0 sin cp r cos 0 sin cp 
cos0 —r sin 0 

—r sin 0 sin cp 
rs\\\0coscp 

0 

= cos 6 

r cos 0 cos cp 
r cos 0 sin cp 

— rsi\\0sincp 
r sin 0 cos cp 

+ r sin 0 

sin 0 cos cp — r sin 0 sin<p 
sin 0 sin cp r sin 0 cos cp 

— r 2 (cos 2 0 sin 0 + sin 3 0 ) = r 2 sin 0 




by expanding the determinant along the third line. Hence the volume element becomes 
dx dy dz = r 2 dr sin 0 d6 dcp. The volume integral can be written as 

J f(x,y,z)dxdydz = J f(x(r, 0, cp), y(r, 0, cp), z(r, 6, cp))r 2 dr sin 0 dO dcp. g 

In summary, we have developed the general formalism for vector analysis in orthogonal 
curvilinear coordinates in R 3 . For most applications, locally orthogonal coordinates can 
be chosen for which surface and volume elements in multiple integrals are products of line 
elements. For the general nonorthogonal case, Jacobian determinants apply. 
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Exercises 


2.1.1 Show that limiting our attention to orthogonal coordinate systems implies that gjj — 0 
for i 7 ^ j (Eq. ( 2 . 7 )). 

Hint. Construct a triangle with sides ds\, dsi, and dsi ■ Equation (2.9) must hold regard¬ 
less of whether gjj = 0. Then compare ds 2 from Eq. (2.5) with a calculation using the 
law of cosines. Show that cos$i 2 = gn/\/gng 22 - 

2.1.2 In the spherical polar coordinate system, q\ = r. qi = 9, = q>. The transformation 

equations corresponding to Eq. (2.1) are 

x — r sin0 cosip, y = r sin# sin^>, z = rcos9. 

(a) Calculate the spherical polar coordinate scale factors: h r , hg, and h v . 

(b) Check your calculated scale factors by the relation c/.v,- = hi dq ;. 

2.1.3 The u-, v-, z-coordinate system frequently used in electrostatics and in hydrodynamics 
is defined by 

2 2 

xy — u, x — y — v, z = z. 

This u-, v-, z-system is orthogonal. 

(a) In words, describe briefly the nature of each of the three families of coordinate 
surfaces. 

(b) Sketch the system in the xy-plane showing the intersections of surfaces of constant 
u and surfaces of constant v with the .ry-plane. 

(c) Indicate the directions of the unit vector u and v in all four quadrants. 

(d) Finally, is this u-, v-, z-system right-handed (u x v = +z) or left-handed (uxv = 
-£)? 

2.1.4 The elliptic cylindrical coordinate system consists of three families of surfaces: 


1 ) 


y 


i 2 cosh 2 u a 2 sinh 2 u 


= 1 ; 


2 ) 


? • 2 
a z sin v 


= 1 ; 


3) z = z. 


Sketch the coordinate surfaces u — constant and v — constant as they intersect the first 
quadrant of the .ry-plane. Show the unit vectors u and v. The range of u is 0 ^ u < oo. 
The range of v is 0 ^ ^ 27r. 

2.1.5 A two-dimensional orthogonal system is described by the coordinates <71 and qi. Show 
that the Jacobian 


J 


x.y 3 (x,y) _ dx 3y dx 3 y 

qi,q2/ d{qi,qi) dqidqi dqidqt 


h 1 h 2 


is in agreement with Eq. (2.10). 

Hint. It’s easier to work with the square of each side of this equation. 
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2.1.6 In Minkowski space we define x\ — x, X2 = y, xj, = Z, and a'o = ct. This is done so that 
the metric interval becomes ds 2 = dx^-dxf-dx^ - dx^ (with c— velocity of light). 
Show that the metric in Minkowski space is 

/10 0 0 

0—1 0 0 

{ gl j } ~ 0 0-10 
v 0 0 0 -1 

We use Minkowski space in Sections 4.5 and 4.6 for describing Lorentz transformations. 



2.2 Differential Vector Operators 

We return to our restriction to orthogonal coordinate systems. 

Gradient 


The starting point for developing the gradient, divergence, and curl operators in curvilinear 
coordinates is the geometric interpretation of the gradient as the vector having the mag¬ 
nitude and direction of the maximum space rate of change (compare Section 1.6). From 
this interpretation the component of Vi//-(< 7 i, < 72 . < 73 ) in the direction normal to the family 
of surfaces q\ — constant is given by 3 

„ 3i lr 1 dilr 

qi -Vtfr = Vtfr \ l = JL= JL, (2.17) 

oil h 1 aq 1 

since this is the rate of change of 1 p for varying q\, holding qi and <73 fixed. The quantity 
ds\ is a differential length in the direction of increasing q\ (compare Eqs. (2.9)). In Sec¬ 
tion 2.1 we introduced a unit vector qi to indicate this direction. By repeating Eq. (2.17) 
for q 2 and again for <73 and adding vectorially, we see that the gradient becomes 


(2.18) 

Exercise 2.2.4 offers a mathematical alternative independent of this physical interpretation 
of the gradient. The total variation of a function, 



df = Vt/f dr = v-p-dsj = ^ P~ d< H 

rli 0(Ji OQi 


is consistent with Eq. (2.18), of course. 
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Divergence 


The divergence operator may be obtained from the second definition (Eq. (1.98)) of Chap¬ 
ter 1 or equivalently from Gauss’ theorem. Section 1.11. Let us use Eq. (1.98), 


V-Vfol, ? 2 ,? 3 )= lim 

fdr^O 


/ V do 

Idr 


(2.19) 


with a differential volume hihih^dqi dq 2 dqi (Fig. 2.1). Note that the positive directions 
have been chosen so that (qi, qo, q 3 ) form a right-handed set, qi x q 2 = {J 3 . 

The difference of area integrals for the two faces q \ — constant is given by 


Vih 2 >i 3 + —(V\h 2 hi)dq l ^ dq 2 dq 3 - Vih 2 h 3 dq 2 dq$ 

9 

= -—(V 1 A 2 A 3 ) dq\ dq 2 dq^, (2.20) 

oq 1 


exactly as in Sections 1.7 and 1.10 . 4 Here, V; = V • q, is the projection of V onto the 
q, -direction. Adding in the similar results for the other two pairs of surfaces, we obtain 


J V0/i,92,<73) - da 

" 9 9 3 1 

= -—(Vi«2«3) + -— (V2«3«l)+- —(V 3 /z 1 / 12 ) dq\dq 2 dq'i. 
_oq 1 aq2 9 ® 
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Now, using Eq. (2.19), division by our differential volume yields 


V -Y(qi,q 2 ,q 3 ) = 


1 


h[li 2 h 3 


3 3 3 

--(Vl/t2^3) + -- (V 2 h 3 h[) + -— (V 3 h 1 / 12 ) 

aq 1 dq 2 oq 3 


( 2 . 21 ) 


We may obtain the Laplacian by combining Eqs. (2.18) and (2.21), using V = 
V \[r(qi , q 2l q 3 ). This leads to 


V ■S'ir(q l ,q2,q 2 ) 


1 

r 9 

^h 2 h 3 d^r \ 

h\h 2 h 3 

Mi 

l hi dqi) 


9 t 

^ h 3 h[ 

9 r/r A 


ih\h 2 dir\ 

dq 2' 

V h 2 

dq 2 J 

' dq 3 ' 

K h 3 dq 3 )_ 


( 2 . 22 ) 


Curl 


Finally, to develop V x V, let us apply Stokes’ theorem (Section 1.12) and, as with the 
divergence, take the limit as the surface area becomes vanishingly small. Working on one 
component at a time, we consider a differential surface element in the curvilinear surface 
q\ — constant. From 

V x V • do — qi • (V x Y)h 2 h 3 clq 2 dq 3 (2.23) 

(mean value theorem of integral calculus), Stokes’ theorem yields 


qi-(Vx \)h 2 h 3 dq 2 dq 3 = 


V- dr. 


(2.24) 


with the line integral lying in the surface q\ — constant. Following the loop (1,2, 3, 4) of 
Fig. 2.2, 


V(<7i, <?2.<?3) • dr — v 2 h 2 dq 2 + 


F 3/23 + -—(V 3 / 23 ) dq 2 
oq 2 


V 2 h 2 + - —( V 2 h 2 )dq 3 


3 3 

-—(/Z3V3) - -—(/22V2) 
oq 2 dq 3 


dq 3 

dq 2 - V 3 h 3 dq 3 
dq 2 dq 3 . 


(2.25) 


We pick up a positive sign when going in the positive direction on parts 1 and 2 and 
a negative sign on parts 3 and 4 because here we are going in the negative direction. 
(Higher-order terms in Maclaurin or Taylor expansions have been omitted. They will van¬ 
ish in the limit as the surface becomes vanishingly small (dq 2 -> 0 , dq 3 -> 0 ).) 

From Eq. (2.24), 


V x V|i = 


h 2 h 3 


9 

dq 2 


(/ 23 V 3 ) - 


9 

-— (h 2 V 2 ) 

dq 3 


(2.26) 
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Figure 2.2 Curvilinear surface element with q\ — constant. 


The remaining two components of V x V may be picked up by cyclic permutation of the 
indices. As in Chapter 1, it is often convenient to write the curl in determinant form: 

qt/'l Q 2^2 <13^3 

V x V = —-— J_ J_ J_ . (2.27) 

«lrt2«3 Qq j Qq 2 Qq 2 

h\Vi h 2 V 2 /i 3 V 3 

Remember that, because of the presence of the differential operators, this determinant must 
be expanded from the top down. Note that this equation is not identical with the form for 
the cross product of two vectors, Eq. (2.13). V is not an ordinary vector; it is a vector 

operator. 

Our geometric interpretation of the gradient and the use of Gauss’ and Stokes’ theorems 
(or integral definitions of divergence and curl) have enabled us to obtain these quantities 
without having to differentiate the unit vectors q,. There exist alternate ways to deter¬ 
mine grad, div, and curl based on direct differentiation of the q,. One approach resolves the 
q, of a specific coordinate system into its Cartesian components (Exercises 2.4.1 and 2.5.1) 
and differentiates this Cartesian form (Exercises 2.4.3 and 2.5.2). The point here is that the 
derivatives of the Cartesian x, y, and z vanish since x, y, and z are constant in direction 
as well as in magnitude. A second approach [L. J. Kijewski, Am. J. Phys. 33: 816 (1965)] 
assumes the equality of 3 2 r/3 qi dqj and 3 2 r/3 q/ 3 q, and develops the derivatives of q, in 
a general curvilinear form. Exercises 2.2.3 and 2.2.4 are based on this method. 

Exercises 

2.2.1 Develop arguments to show that dot and cross products (not involving V) in orthogonal 
curvilinear coordinates in R 3 proceed, as in Cartesian coordinates, with no involvement 
of scale factors. 


2 . 2.2 


With qi a unit vector in the direction of increasing q 1 , show that 
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(a) 


V • qi = 


1 d(h 2 h 3 ) 
hihihi dq\ 


(b) V x qi = — 
hi 


Q 2 


1 9/ii 


Q3 


1 din 


hi dqi h 2 dq2 


2.2.3 


Note that even though qi is a unit vector, its divergence and curl do not necessarily 
vanish. 


Show that the orthogonal unit vectors q ,• may be defined by 


1 9r 
hi dqi' 


(a) 


2.2.4 


In particular, show that q,- • q, = 1 leads to an expression for hi in agreement with 
Eqs. (2.9). 

Equation (a) may be taken as a starting point for deriving 


and 


9q,- „ 1 dhj 
dqj q ' hj dqi 


dqi „ 1 dhj 

dqt tfj* 1 ' hj hqj' 


Derive 


Vl/r = Ql 


1 dl[r 
h i dqi 


+ q2 


l 9iA 
hi dq2 


„ 1 9i Jr 

+ qs- 

h 3 dq 3 


by direct application of Eq. (1.97), 


Vl/r = 


lim 

f dz^-0 


f do 
fdr 


Hint. Evaluation of the surface integral will lead to terms like (liihihi)- 1 (d/dq\) x 
(< 11 / 12 / 13 ). The results listed in Exercise 2.2.3 will be helpful. Cancellation of unwanted 
terms occurs when the contributions of all three pairs of surfaces are added together. 


2.3 Special Coordinate Systems: Introduction 

There are at least 11 coordinate systems in which the three-dimensional Helmholtz equa¬ 
tion can be separated into three ordinary differential equations. Some of these coordinate 
systems have achieved prominence in the historical development of quantum mechanics. 
Other systems, such as bipolar coordinates, satisfy special needs. Partly because the needs 
are rather infrequent but mostly because the development of computers and efficient pro¬ 
gramming techniques reduce the need for these coordinate systems, the discussion in this 
chapter is limited to (1) Cartesian coordinates, (2) spherical polar coordinates, and (3) cir¬ 
cular cylindrical coordinates. Specifications and details of the other coordinate systems 
will be found in the first two editions of this work and in Additional Readings at the end of 
this chapter (Morse and Feshbach, Margenau and Murphy). 
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2.4 Circular Cylinder Coordinates 


In the circular cylindrical coordinate system the three curvilinear coordinates (q\, qi, < 73 ) 
are relabeled (p,<p,z). We are using p for the perpendicular distance from the ’-axis and 
saving r for the distance from the origin. The limits on p, <p and z are 

0 ^ p < 00 , 0 ^ (p ^ 2 7T, and — 00 < z < 00 . 

For p — 0, (p is not well defined. The coordinate surfaces, shown in Fig. 2.3, are: 


1. Right circular cylinders having the /-axis as a common axis, 

/ 2 2 \ 1 /2 

p — [x~ + y ) ~ — constant. 

2. Half-planes through the z-axis. 


q> = tan 



= constant. 


3. Planes parallel to the v v-plane, as in the Cartesian system. 


Z = constant. 



Figure 2.3 Circular cylinder coordinates. 
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Figure 2.4 Circular cylindrical 
coordinate unit vectors. 


Inverting the preceding equations for p and <p (or going directly to Fig. 2.3), we obtain 
the transformation relations 

x — pcoscp, }’ = p sin cp, z = z. (2.28) 

The z-axis remains unchanged. This is essentially a two-dimensional curvilinear system 
with a Cartesian z-axis added on to form a three-dimensional system. 

According to Eq. (2.5) or from the length elements dst, the scale factors are 

h\ = h p =\, h.2 = h (p = p, Ii3 = h z = 1. (2.29) 

The unit vectors qi, q 2 , q 3 are relabeled (p, tp, z), as in Fig. 2.4. The unit vector p is normal 
to the cylindrical surface, pointing in the direction of increasing radius p. The unit vector 
q> is tangential to the cylindrical surface, perpendicular to the half plane <p = constant and 
pointing in the direction of increasing azimuth angle (p. The third unit vector, z, is the usual 
Cartesian unit vector. They are mutually orthogonal, 

p ■ <p — <p ■ z — z ■ p — 0, 

and the coordinate vector and a general vector V are expressed as 
r—pp + zz, \ — pV p + 0V (p + zV z . 

A differential displacement dr may be written 

dr = p ds p + (p ds v +zdz 

— pdp + <ppdcp + zdz- (2.30) 


Example 2.4.1 area law for planetary motion 

First we derive Kepler’s law in cylindrical coordinates, saying that the radius vector sweeps 
out equal areas in equal time, from angular momentum conservation. 
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We consider the sun at the origin as a source of the central gravitational force F = f(r) r. 
Then the orbital angular momentum L = mr x v of a planet of mass m and velocity v is 
conserved, because the torque 


d L dr dr d\ 

— — in — x- |-rxw — = rxF = 

dt clt dt dt 


fir) 


r x r = 


0 . 


r 


Hence L = const. Now we can choose the z-axis to lie along the direction of the orbital 
angular momentum vector, L = Li, and work in cylindrical coordinates r = (p, <p, z) = pp 
with z = 0. The planet moves in the xy-plane because r and v are perpendicular to L. Thus, 
we expand its velocity as follows: 


From 


dr 


dp 


y =di = PP + P fL- 


p = (cos cp, sin, — = (— sin (p, cos cp) — (p, 

d(p 


we find that ^7 = j 2 77 — <P<P using the chain mle, so v = pp + p^ — pp + pf<P- When 
we substitute the expansions of p and v in polar coordinates, we obtain 

L = mp x v = mp{p<p)ip x <p) = mp 2 (pz — constant. 


The triangular area swept by the radius vector p in the time dt (area law), when inte¬ 
grated over one revolution, is given by 

A = \ j Pip dtp) = ] - J p 2 (pdt — J dt= (2.31) 

if we substitute mp 2 <p = L — const. Here r is the period, that is, the time for one revolution 
of the planet in its orbit. 

Kepler’s first law says that the orbit is an ellipse. Now we derive the orbit equation 
picp) of the ellipse in polar coordinates, where in Fig. 2.5 the sun is at one focus, which is 
the origin of our cylindrical coordinates. From the geometrical construction of the ellipse 
we know that p' + p — 2a, where a is the major half-axis; we shall show that this is 
equivalent to the conventional form of the ellipse equation. The distance between both foci 
is 0 < 2ae < 2a, where 0 < e < 1 is called the eccentricity of the ellipse. For a circle e = 0 
because both foci coincide with the center. There is an angle, as shown in Fig. 2.5, where 
the distances p’ — p — a are equal, and Pythagoras’ theorem applied to this right triangle 



Figure 2.5 Ellipse in polar coordinates. 
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gives b 2 + a 2 e 2 = a 2 . As a result, Vl — e 2 = b/a is the ratio of the minor half-axis ( b ) to 
the major half-axis, a. 

Now consider the triangle with the sides labeled by p', p, 2aa in Fig. 2.5 and angle 
opposite p' equal to 7 T — q>. Then, applying the law of cosines, gives 

p' 2 — p 2 + 4a 2 e 2 + 4pae cos <p. 

Now substituting p' — 2a — p , canceling p 2 on both sides and dividing by 4a yields 

p(l + ecos^>) = a(\ — e 2 ) = p, (2.32) 

the Kepler orbit equation in polar coordinates. 

Alternatively, we revert to Cartesian coordinates to find, from Eq. (2.32) with x = 
pcoscp , that 

p 2 = x 2 + y 2 — (p — xe) 2 — p 2 + x 2 e 2 — 2 pxe, 


so the familiar ellipse equation in Cartesian coordinates, 




pe 

l-€ : 


+ r 


2 2 

P 2 + 


1 — e 2 1 — e 


2 ’ 


obtains. If we compare this result with the standard form of the ellipse, 

(x - x 0 ) 2 y 2 _ 

a 2 b 2 ~ ’ 

we confirm that 

, p r — 3 - p 

VY^e 2 1-e 2 

and that the distance xo between the center and focus is ae, as shown in Fig. 2.5. ■ 

The differential operations involving V follow from Eqs. (2.18), (2.21), (2.22), and 
(2.27): 
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Finally, for problems such as circular wave guides and cylindrical cavity resonators the 
vector Laplacian V 2 V resolved in circular cylindrical coordinates is 


1 2 3 VC 

V-V|„ = v~v p --v p ---^, 

p z p z dip 


9 9 l 2 dv p 

V 2 V|^ = V’V^-^ + —-A (2.37) 

p z p dtp 

v 2 v| z = v 2 v z , 

which follow from Eq. (1.85). The basic reason for this particular form of the ’-component 
is that the ’-axis is a Cartesian axis; that is, 

V 2 0 oV p + tpV ip + zV z ) = V 2 (pV p + $V v ) + zV 2 V z 

= P.ny p , V v ) + <pg{v p , V v ) + zv 2 y z . 

Finally, the operator V 2 operating on the p, (j> unit vectors stays in the pyi-plane. 


Example 2.4.2 a navier-StokesTerm 

The Navier-Stokes equations of hydrodynamics contain a nonlinear term 

V x [v x (V x v)], 

where v is the fluid velocity. For fluid flowing through a cylindrical pipe in the ’-direction, 

v = ZD (p). 

From Eq. (2.36), 

P P<P z 

Vxv=i A ± 1 =-v- 

P dp dtp d z dp 

0 0 V(p) 


v x (V x v) = 


p tp z 

0 0 v 3d 

— p V ( p )——. 

3d dp 

0-0 

dp 


Finally, 


V x (v x (V x v)) = - 


so, for this particular case, the nonlinear term vanishes. 


p 

PV 

z 

3 

3 

3 

Tp 

dtp 

dz 

3d 



D- 

0 

0 

dp 
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Exercises 


2 . 4.1 Resolve the circular cylindrical unit vectors into their Cartesian components (Fig. 2.6). 

ANS. p — xcos^) + ysin<p, 
tp — — xsiny? + ycos^>, 
z = z. 

2 . 4.2 Resolve the Cartesian unit vectors into their circular cylindrical components (Fig. 2.6). 

ANS. x = p cos ip — tpsitup, 
y = psivup + ip cos ip, 

Z—Z. 


2 . 4.3 


2 . 4.4 


2 . 4.5 


From the results of Exercise 2.4.1 show that 


dp „ d<p 

— = ip. — 

d(p dip 


~P 


and that all other first derivatives of the circular cylindrical unit vectors with respect to 
the circular cylindrical coordinates vanish. 


Compare V • V (Eq. (2.34)) with the gradient operator 


„ .3 ,13 ,3 

V = p -h ip -h z — 

dp pdip 3 z 


(Eq. (2.33)) dotted into V. Note that the differential operators of V differentiate both 
the unit vectors and the components of V. 

Hint. ip(\/p){d/dq>) ■ pV p becomes ip ■ ^^-(pV p ) and does not vanish. 

(a) Show that r = pp + zz. 



Figure 2.6 Plane polar coordinates. 
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2 . 4.6 


2 . 4.7 


2 . 4.8 


(b) Working entirely in circular cylindrical coordinates, show that 

V r = 3 and V xr = 0. 

(a) Show that the parity operation (reflection through the origin) on a point ( p . cp . z ) 
relative to fixed x-, y-, z-axes consists of the transformation 

p-*P, (p^-(p±7t , Z -» — Z. 

(b) Show that p and <p have odd parity (reversal of direction) and that z has even 
parity. 

Note. The Cartesian unit vectors x, y, and z remain constant. 

A rigid body is rotating about a fixed axis with a constant angular velocity to. Take oj to 
lie along the "-axis. Express the position vector r in circular cylindrical coordinates and 
using circular cylindrical coordinates, 

(a) calculate v = co x r, (b) calculate V x v. 

ANS. (a) v = ip top. 

(b) V x v = 2u>. 

Find the circular cylindrical components of the velocity and acceleration of a moving 
particle, 

v p = p, a p = p- pip 2 . 

v<p = pip, a<p = pip + 2p(p, 

Vz = z. a z = z. 

Hint. 


r (f) = p(t)p(t)+zz(t ) 

= [xcos<p(f) + ysin<p(r)]p(f) +z z(t). 

Note, p — dp/dt, p — d 2 p/dt 2 . and so on. 

2 . 4.9 Solve Laplace’s equation, V"i// = 0, in cylindrical coordinates for i// = \lr(p). 

ANS. f = k In—. 

Po 

2 . 4.10 In right circular cylindrical coordinates a particular vector function is given by 

V(p, (p) = pVp(p. <p) + <pVy{p, <p). 

Show that V x V has only a z-component. Note that this result will hold for any vector 
confined to a surface c /3 = constant as long as the products /; i V[ and hi V 2 are each 
independent of c/3. 

2 . 4.11 For the flow of an incompressible viscous fluid the Navier-Stokes equations lead to 

-V x (v x (V x v)) = — V 2 (V x v). 

Po 

Here ij is the viscosity and po is the density of the fluid. For axial flow in a cylindrical 
pipe we take the velocity v to be 


v = zu(p). 
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From Example 2.4.2, 


for this choice of v. 
Show that 


V x (v x (V x v)) = 0 


V 2 (V x v) = 0 


leads to the differential equation 

1 

pdpY'dp 2 ) p 2 dp 


1 d ( d 2 v\ 1 dv 
--77 PTT )--TT7=° 


and that this is satisfied by 


v = vo + aip “ 


2.4.12 A conducting wire along the z-axis carries a current 1. The resulting magnetic vector 
potential is given by 

A = z — in ( — 

2 n V P 

Show that the magnetic induction B is given by 

.. - H-I 

B = <p -. 

2n p 


2.4.13 A force is described by 


„ v „ x 

F = -x y „ +y 


x 2 + y 2 x 2 + y 2 ' 


(a) Express F in circular cylindrical coordinates. 

Operating entirely in circular cylindrical coordinates for (b) and (c). 


(b) calculate the curl of F and 

(c) calculate the work done by F in travers the unit circle once counterclockwise. 

(d) How do you reconcile the results of (b) and (c)? 

2.4.14 A transverse electromagnetic wave (TEM) in a coaxial waveguide has an electric field 
E = E(p, and a magnetic induction field of B = B (p, (p)e ,( ' kz ~ a>, \ Since the 

wave is transverse, neither E nor B has a z component. The two fields satisfy the vector 
Laplacian equation 

V 2 E(p,«9) = 0 
V 2 B(p,«9) = 0. 


(a) Show that E = pEoia/p)e l(kz and B = (pBo(a/p)e ,(kz wt) are solutions. Here 

a is the radius of the inner conductor and Eq and Bq are constant amplitudes. 
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(b) Assuming a vacuum inside the waveguide, verify that Maxwell’s equations are 
satisfied with 

Bq/Eq — k/co — noso(ca/k) — 1/c. 

2.4.15 A calculation of the magnetohydrodynamic pinch effect involves the evaluation of 
(B • V)B. If the magnetic induction B is taken to be B = <p B v (p), show that 

(B-V)B = -pB 2 Jp. 

2.4.16 The linear velocity of particles in a rigid body rotating with angular velocity co is given 

by 

v = <ppco. 

Integrate <f x ■ dX around a circle in the xy-plane and verify that 


= v x v| z . 


2.4.17 A proton of mass m, charge +e, and (asymptotic) momentum p — mv is incident on 
a nucleus of charge +Ze at an impact parameter b. Determine the proton’s distance of 
closest approach. 


2.5 Spherical Polar Coordinates 

Relabeling (< 71 , q 2 , < 73 ) as (r, 0, (p), we see that the spherical polar coordinate system con¬ 
sists of the following: 

1. Concentric spheres centered at the origin, 

r — (x 2 + y 2 + z 2 ) 1/1 ~ = constant. 

2. Right circular cones centered on the z-(polar) axis, vertices at the origin, 

„ z 

0 — arccos —„- n = constant. 

(x 2 + y 2 + z 2 ) 1 ' 2 

3. Half-planes through the z-(polar) axis, 

<p — arctan — = constant. 

x 

By our arbitrary choice of definitions of 0, the polar angle, and cp, the azimuth angle, the 
Z-axis is singled out for special treatment. The transformation equations corresponding to 
Eq. (2.1) are 

x = r sin0 coscp, y = r sind sin^), z = r cos0, (2.38) 
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z 



Figure 2.7 Spherical polar coordinate area 
elements. 

measuring 9 from the positive 7 -axis and q> in the vy-plane from the positive x-axis. The 
ranges of values are 0 ^ r < oo, 0 ^ 0 ^ n, and 0 ^ (p ^ 27t. At r — 0, 9 and cp are 
undefined. From differentiation of Eq. (2.38), 

hi = h r = 1 , 

h 2 = h e = r, (2.39) 

h 3 = h v = r sin 0 . 

This gives a line element 

clr — r dr + Or d6 + tpr sin 0 d<p, 
so 

ds 2 — dr-dr — dr 2 + r 2 d0 2 + r 2 sin 2 9 dcp 1 , 

the coordinates being obviously orthogonal. In this spherical coordinate system the area 
element (for r = constant) is 

dA = dag (p = r 2 sm9d9d(p, (2.40) 

the light, unshaded area in Fig. 2.7. Integrating over the azimuth <p, we find that the area 
element becomes a ring of width d9, 

dAe=2jtr 2 sm9d9. (2.41) 

This form will appear repeatedly in problems in spherical polar coordinates with azimuthal 
symmetry, such as the scattering of an unpolarized beam of particles. By definition of solid 
radians, or steradians, an element of solid angle d£2 is given by 

dA 

d£2 — —= sin 9 d9 d(p. 
r- 


(2.42) 



2.5 Spherical Polar Coordinates 


125 





Figure 2.8 Spherical polar coordinates. 

Integrating over the entire spherical surface, we obtain 

J dQ = 

From Eq. (2.11) the volume element is 

dr — r 2 dr sind dO dq> = r 2 dr d£2. (2.43) 

The spherical polar coordinate unit vectors are shown in Fig. 2.8. 

It must be emphasized that the unit vectors f, 0, and <p vary in direction as the angles 
6 and <p vary. Specifically, the 6 and (p derivatives of these spherical polar coordinate unit 
vectors do not vanish (Exercise 2.5.2). When differentiating vectors in spherical polar (or 
in any non-Cartesian system), this variation of the unit vectors with position must not be 
neglected. In terms of the fixed-direction Cartesian unit vectors x, y and z (cp. Eq. (2.38)), 

r = xsind cos<p + y sin0 sin<p + zcos0, 

- „ , , 3r 

0 = x cos 6 cos <p + y cos 0 sin <p — z sin 0 — —, (2.44) 

3 0 

13? 

(p = —x sin <p + y cos <p — -, 

sin@ 3 <p 

3r 2 3r 3r 2 3r 

— = 2 ? • —, 0 = — = 2 ?-—. 

3 6 3 9 dcp 3 cp 


which follow from 
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Note that Exercise 2.5.5 gives the inverse transformation and that a given vector can 
now be expressed in a number of different (but equivalent) ways. For instance, the position 
vector r may be written 

r = rr — r (x 2 + y 2 + z 2 ) 1/2 
= xx + y y + z z 

= xr sin 0 cos <p + yr sin 9 sin <p + z r cos 9 . (2.45) 

Select the form that is most useful for your particular problem. 

From Section 2.2, relabeling the curvilinear coordinate unit vectors qi, q 2 , and % as r, 
6 , and (p gives 



Occasionally, the vector Laplacian V 2 V is needed in spherical polar coordinates. It is 
best obtained by using the vector identity (Eq. (1.85)) of Chapter 1. For reference 


/ 2 2 3 9 2 cos 9 9 1 9 2 1 9 2 \ 

\ r 2 + r dr dr 2 r 2 sin0 d9 r 2 d9 2 r 2 sin 2 0 dq> 2 ) ' 


/ 2 9 2cos 9\ / 2 9 \ 

\ r 2 39 r 2 sin 9 ) e \ r 2 sin 9 d(p ) v 

2 2 dV e 2cost) 2 dV v 

Vr - Vr --- Vr - - 

r 2 r 2 39 r 2 sin0 r 2 sin0 3(p 


V 2 V| e = 
V 2 V|^ 


1 2 3V r 2cost) 3V v 

r 2 sin 2 0 6 r 2 39 r 2 sin 2 0 3cp 

1 2 3V r 2cos 9 3V 0 

r 2 sin 2 9 t ° + r 2 sin0 3q> + r 2 sin 2 0 d<p 


(2.50) 

(2.51) 

(2.52) 


These expressions for the components of V 2 V are undeniably messy, but sometimes they 
are needed. 
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Example 2.5.1 v, v •, v x for a central force 


Using Eqs. (2.46) to (2.49), we can reproduce by inspection some of the results derived in 
Chapter 1 by laborious application of Cartesian coordinates. 

From Eq. (2.46), 


A df 

V/(r) = r-f, 
dr 

Vr" = r nr" -1 . 


(2.53) 


For the Coulomb potential V — Ze/(4nsor ), the electric field is E = — V V = 4 ^ f f , r. 
From Eq. (2.47), 


2 df 

V-r/(r)= -/(r)+-f 
r dr 

V r r n = (n+2)r n ~ l . 


(2.54) 


For r > 0 the charge density of the electric field of the Coulomb potential is p — V • E = 
ir^— V • 4ir = 0 because n = —2. 

Attsq r l 

From Eq. (2.48), 


V 


2 2 df d z f 

f{r) =-rTr + ^' 
VV = n(n + l)r"“ 2 , 


(2.55) 

(2.56) 


in contrast to the ordinary radial second derivative of r" involving n — 1 instead of n + 1. 
Finally, from Eq. (2.49), 


V x rf(r) = 0. 


(2.57) 


Example 2.5.2 magnetic vector potential 


The computation of the magnetic vector potential of a single current loop in the v v-plane 
uses Oersted’s law, V x H = J, in conjunction with /roH = B = V x A (see Examples 1.9.2 
and 1.12.1), and involves the evaluation of 

Mo J = V x ['V x q>A v (r, 0)\ 


In spherical polar coordinates this reduces to 


MoJ = V x 



f 

9 

dr 

0 


rO rs\\\0(j) 

9 9 

39 dtp 

0 rsm9A,p(r,9) 


= V x 


\ 3 - d 

r—(r sin 9A V ) - rO — (r sin0A„) 
30 dr 
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Taking the curl a second time, we obtain 


MoJ = 


1 


r 

9 

dr 

(rsmQA v ) 


8 


1 


rO 

r sin 9q> 

8 

8 

89 

d(p 


r 2 s\n9 89' v ' rsinddr 

By expanding the determinant along the top row, we have 

1 9 


0 r sin@A„) 


/toJ = -q> 


~<P 


1 9 2 19 

~r i^ 2 {rA ^ + J 2 d 0 


V 2 A v (r,9)~ 


1 


? • 2 

r A sin i 


sin0 86 
-A p (r,0) 


(sin0A^) 


(2.58) 


Exercises 

2 . 5.1 Express the spherical polar unit vectors in Cartesian unit vectors. 

ANS. f = x sin 9 cos (p + y sin 6 sin (p + zcosf?, 
0 — x cos 6 cos (p + y cos 9 sin <p — z sin 9 , 
(p — —xsinyi + y cos tp. 

2 . 5.2 (a) From the results of Exercise 2.5.1, calculate the partial derivatives of f, 0, and <p 

with respect to r, 9, and <p. 

(b) With V given by 

„ 9 4 9 ,1 9 

r-1- 0 -h w - 

dr r 86 r sinfl dcp 

(greatest space rate of change), use the results of part (a) to calculate V • Vi/r. This 
is an alternate derivation of the Laplacian. 

Note. The derivatives of the left-hand V operate on the unit vectors of the right-hand V 
before the unit vectors are dotted together. 

2 . 5.3 A rigid body is rotating about a fixed axis with a constant angular velocity u>. Take u> to 
be along the z-axis. Using spherical polar coordinates, 

(a) Calculate 

v = co x r. 

(b) Calculate 


V x v. 


ANS. (a) v = <pcor sin 6, 
(b) V x v = 2co. 
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2.5.4 The coordinate system (x , y, z) is rotated through an angle <l> counterclockwise about an 
axis defined by the unit vector n into system (x', y', z'). In terms of the new coordinates 
the radius vector becomes 

r' = rcos T> + r x nsin$ + n(n • r)(l — cosO). 


(a) Derive this expression from geometric considerations. 

(b) Show that it reduces as expected for n = z. The answer, in matrix form, appears in 
Eq. (3.90). 

(c) Verify that r' 1 = r 2 . 

2.5.5 Resolve the Cartesian unit vectors into their spherical polar components: 

x = r sin 0 cos <p + 0 cos 6 coscp — (p sin <p, 
y = r sin 0 sin 95 + 6 cosO sin^) + <pcos <p, 
z = r cos 9 — 6 sin 9. 

2.5.6 The direction of one vector is given by the angles 0\ and (p \. For a second vector the 
corresponding angles are 62 and (pj. Show that the cosine of the included angle y is 
given by 

cosy = coscos 02 + sin0i sin 02 cos(^i — ^ 2 )- 

See Fig. 12.15. 

2.5.7 A certain vector V has no radial component. Its curl has no tangential components. 
What does this imply about the radial dependence of the tangential components of V? 

2.5.8 Modern physics lays great stress on the property of parity — whether a quantity remains 
invariant or changes sign under an inversion of the coordinate system. In Cartesian 
coordinates this means x —» — x, y —> —y, and z —> —Z- 


(a) Show that the inversion (reflection through the origin) of a point (r, 0, q>) relative 
to fixed x-, y-, z-axes consists of the transformation 

r —> r, 0 — > it — 0 , ip — > cp zb tv. 

(b) Show that f and <p have odd parity (reversal of direction) and that 0 has even parity. 

2.5.9 With A any vector, 

A Vr = A. 

(a) Verify this result in Cartesian coordinates. 

(b) Verify this result using spherical polar coordinates. (Equation (2.46) provides V.) 
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2.5.10 


2.5.11 


2.5.12 


2.5.13 


2.5.14 


Find the spherical coordinate components of the velocity and acceleration of a moving 
particle: 

v r = r , 

Vg = rd, 

v v = r sin dtp, 

a r = r — rd 2 — r sin 2 dtp 2 , 

ag = rd + 2rd — r sind cos dtp 2 , 

a v =r sin dip + 2 r sin dip + 2r cos ddtp. 

Hint. 


r (0 = r (t)r(t) 

= [xsin0(r) cos tp(t) + y sin@(r) sin^)(r) + zcos0(f)]r(f). 

Note. Using the Lagrangian techniques of Section 17.3, we may obtain these results 
somewhat more elegantly. The dot in r,d,tp means time derivative, r = dr/dt,d — 
dd/dt, <p = dcp/dt. The notation was originated by Newton. 

A particle m moves in response to a central force according to Newton’s second law, 

mr — r fir). 

Show that r x r = c, a constant, and that the geometric interpretation of this leads to 
Kepler’s second law. 


Express d/dx, 3/3 y, 3/3 z in spherical polar coordinates 

ANS 


Hint. Equate N xyz ana \ r g v . 


3 3 13 

— = sin d cos w -1- cos d cos tp - 

dx r dr r r dd 


sini/) 3 
r sin0 dtp ’ 
cos <p 3 


3 3 13 

— = sin d sin (p -1 - cos d sin w -h 

3y dr r dd rsin0 dtp 

3 3 13 

— = cos d -sin d - . 

3 z dr r dd 


and V, 

From Exercise 2.5.12 show that 


dy 


■y 


dx 


dtp 


This is the quantum mechanical operator corresponding to the ’-component of orbital 
angular momentum. 


With the quantum mechanical orbital angular momentum operator defined as L = 
—/(r x V), show that 
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2.5.15 


2.5.16 


2.5.17 


2.5.18 


2.5.19 


9 9 

(b) L x — iL v = — e~ ,<p l — — i cot 9^— 


89 


3 (p 


(These are the raising and lowering operators of Section 4.3.) 

Verify that L x L = iL in spherical polar coordinates. L = —i (r x V), the quantum 
mechanical orbital angular momentum operator. 

Hint. Use spherical polar coordinates for L but Cartesian components for the cross 
product. 


(a) From Eq. (2.46) show that 


L = —i (r x V) = i( 0 


1 3 


<P: 


3 


sind dip 3d 


(b) Resolving 0 and ip into Cartesian components, determine L x , L v , and L- in terms 
of 9, q>, and their derivatives. 

(c) From L 2 = L 2 + L 1 + L 2 show that 


L 2 = 


1 3 

sind 3 6 


3 

sind — 
89 


1 3 2 
n 2 9 dip 2 


= -r 2 V 2 + —I r~— ). 


3 


dr 


d 


dr 


This latter identity is useful in relating orbital angular momentum and Legendre’s dif¬ 
ferential equation. Exercise 9.3.8. 

With L = — zr x V, verify the operator identities 


,3 r x L 

(a) V = r -- i — 2 > 

dr r z 


(b) rV 2 -V( 1+r— ) =iV x L. 


Show that the following three forms (spherical coordinates) of V 2 xj/(r) are equivalent: 


n 1 d 
(a) r 2 dr 


,djr(r) 

dr 


Id 2 r n 


(c) 


d~4 r ( r ) 2d\j/(r) 


dr 2 


r dr 


The second form is particularly convenient in establishing a correspondence between 
spherical polar and Cartesian descriptions of a problem. 

One model of the solar corona assumes that the steady-state equation of heat flow, 

v- otvr) = o, 

is satisfied. Here, k, the thermal conductivity, is proportional to 7’^ 2 . Assuming that 
the temperature T is proportional to r", show that the heat flow equation is satisfied by 
T = Toiro/r) 2 ' 1 . 
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2.5.20 A certain force field is given by 

,2Pcos0 ~ P 

F = r- 5 -b<?-rsin0, r^P/2 

r i r i 

(in spherical polar coordinates). 


(a) Examine V x F to see if a potential exists. 

(b) Calculate <^F • dX for a unit circle in the plane 9 = 7 r/ 2 . What does this indicate 
about the force being conservative or nonconservative? 

(c) If you believe that F may be described by F = — Vi jr, find i jr. Otherwise simply 
state that no acceptable potential exists. 


2.5.21 


(a) Show that A = —tpcotO/r is a solution of V x A = r/r 2 . 

(b) Show that this spherical polar coordinate solution agrees with the solution given 
for Exercise 1.13.6: 

. , yz , xz 

A. —— x-— y-. 

r(x 2 + y 2 ) r(x 2 + y 2 ) 

Note that the solution diverges for 0 = 0, n corresponding to x, y — 0. 

(c) Finally, show that A = — 6<p sin 9/r is a solution. Note that although this solution 
does not diverge (r ^ 0), it is no longer single-valued for all possible azimuth 
angles. 


2.5.22 A magnetic vector potential is given by 


ixo m x r 

A = 3-5—■ 

Arc r 3 

Show that this leads to the magnetic induction B of a point magnetic dipole with dipole 
moment m. 

ANS. for m = z m, 

„ no 2m cos 9 ~ /j.q m s i n 0 

V x A = r--r- \-0- - - —. 

Arc Arc r i 

Compare Eqs. (12.133) and (12.134) 


2.5.23 


At large distances from its source, electric dipole radiation has fields 

gi(kr—o)t ) ^ gi(kr—cot) 

E = fl£sin6>- 0, B = a#sin@- <p. 

r r 

Show that Maxwell’s equations 


9B 

V x E =- 

dt 


9E 

and VxB = eoHo -z~ 
at 


are satisfied, if we take 


co 

cib k 

Hint. Since r is large, terms of order r 


= c = (soH o) 1/2 . 
" 2 may be dropped. 
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2.5.24 


2.5.25 


The magnetic vector potential for a uniformly charged rotating spherical shell is 

.IIqci 4 cjcl> sind 


A = 


<P 


<P- 


3 

/xoacrw 


yZ. 

■ rcosO, 


r > a 

r < a. 


(i a — radius of spherical shell, cr = surface charge density, and a> = angular velocity.) 
Find the magnetic induction B = V x A. 


ANS. B r (r,6>) = 
Bo(r,d) = 


2/xofl 4 erft> 

COS0 

y 

> a 

3 

r 3 

f 

lioa 4 oco 

sin 0 

y 

> a 

3 

r 3 

l 

^2/j.qcioco 
z-. 


r 

< a 


B — z 


(a) Explain why V 2 in plane polar coordinates follows from V 2 in circular cylindrical 
coordinates with z = constant. 

(b) Explain why taking V 2 in spherical polar coordinates and restricting 0 to 7r/2 does 
not lead to the plane polar form of V. 

Note. 


2 , 3 2 13 1 3 2 

^ {p ' (p) ~W i + ~pYp + 7-W 


2.6 Tensor Analysis 

Introduction, Definitions 

Tensors are important in many areas of physics, including general relativity and electrody¬ 
namics. Scalars and vectors are special cases of tensors. In Chapter 1, a quantity that did not 
change under rotations of the coordinate system in three-dimensional space, an invariant, 
was labeled a scalar. A scalar is specified by one real number and is a tensor of rank 0. 
A quantity whose components transformed under rotations like those of the distance of a 
point from a chosen origin (Eq. (1.9), Section 1.2) was called a vector. The transformation 
of the components of the vector under a rotation of the coordinates preserves the vector as 
a geometric entity (such as an arrow in space), independent of the orientation of the refer¬ 
ence frame. In three-dimensional space, a vector is specified by 3 = 3 1 real numbers, for 
example, its Cartesian components, and is a tensor of rank 1. A tensor of rank n has 3" 
components that transform in a definite way. 5 This transformation philosophy is of central 
importance for tensor analysis and conforms with the mathematician’s concept of vector 
and vector (or linear) space and the physicist’s notion that physical observables must not 
depend on the choice of coordinate frames. There is a physical basis for such a philosophy: 
We describe the physical world by mathematics, but any physical predictions we make 


5 In N -dimensional space a tensor of rank n has N n components. 
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must be independent of our mathematical conventions, such as a coordinate system with 
its arbitrary origin and orientation of its axes. 

There is a possible ambiguity in the transformation law of a vector 

/\; = £> 7 A ; -. (2.59) 

j 


in which a,j is the cosine of the angle between the x ( --axis and the xy-axis. 

If we start with a differential distance vector dr, then, taking dx\ to be a function of the 
unprimed variables. 


^ dx- 

dx i = dx J 


(2.60) 


by partial differentiation. If we set 


dx- 

dxj’ 


(2.61) 


Eqs. (2.59) and (2.60) are consistent. Any set of quantities A J transforming according to 


A 


ri 



(2.62a) 


is defined as a contravariant vector, whose indices we write as superscript; this includes 
the Cartesian coordinate vector x' — x, from now on. 

However, we have already encountered a slightly different type of vector transformation. 
The gradient of a scalar Vcp, defined by 


„ „d(p d(p d(p 

v '' =x a? + y S? +z S? 


(using x, x 2 , x 3 for x, y, z ), transforms as 


(2.63) 



] 


dcp dx^ 
dxd dx' 1 ’ 


(2.64) 


using (p — q>(x, y, z) = (p(x', y', z!) = <p', (p defined as a scalar quantity. Notice that this 
differs from Eq. (2.62) in that we have dx J /dx' 1 instead of dx' l /dx J . Equation (2.64) 
is taken as the definition of a covariant vector, with the gradient as the prototype. The 
covariant analog of Eq. (2.62a) is 

, dxj 

A i = H^n A i- < 2 - 62b ) 


Only in Cartesian coordinates is 
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so that there no difference between contravariant and covariant transformations. In other 
systems, Eq. (2.65) in general does not apply, and the distinction between contravariant 
and covariant is real and must be observed. This is of prime importance in the curved 
Riemannian space of general relativity. 

In the remainder of this section the components of any contravariant vector are denoted 
by a superscript. A', whereas a subscript is used for the components of a covariant 
vector A,-. 6 


Definition of Tensors of Rank 2 


Now we proceed to define contravariant, mixed, and covariant tensors of rank 2 by the 

following equations for their components under coordinate transformations: 


=£ 


kl 


dx" dx'j 
dx k dx 1 


■ A u , 


v dx' 1 dx 1 u 

B" i = > - J - r B k U 

J ^ dx k dx'j 
kl 

, dx k dx 1 

‘j Q x ii fl x ij kl 


( 2 . 66 ) 


Id 


Clearly, the rank goes as the number of partial derivatives (or direction cosines) in the de¬ 
finition: 0 for a scalar, 1 for a vector, 2 for a second-rank tensor, and so on. Each index 
(subscript or superscript) ranges over the number of dimensions of the space. The number 
of indices (equal to the rank of tensor) is independent of the dimensions of the space. We 
see that A kI is contravariant with respect to both indices, Cki is covariant with respect to 
both indices, and B k i transforms contravariantly with respect to the first index k but covari- 
antly with respect to the second index /. Once again, if we are using Cartesian coordinates, 
all three forms of the tensors of second rank contravariant, mixed, and covariant are — the 
same. 

As with the components of a vector, the transformation laws for the components of a 
tensor, Eq. (2.66), yield entities (and properties) that are independent of the choice of ref¬ 
erence frame. This is what makes tensor analysis important in physics. The independence 
of reference frame (invariance) is ideal for expressing and investigating universal physical 
laws. 

The second-rank tensor A (components A kl ) may be conveniently represented by writing 
out its components in a square array (3 x 3 if we are in three-dimensional space): 


A 11 

A 12 

a 13 \ 


A 21 

A 22 

A 23 . 

(2.67) 

A 31 

A 32 

A 33 / 



This does not mean that any square array of numbers or functions forms a tensor. The 
essential condition is that the components transform according to Eq. (2.66). 


6 This means that the coordinates (x, y, z) are written (x 1 , jt 2 , * 3 ) since r transforms as a contravariant vector. The ambiguity of 
x 2 representing both .t squared and y is the price we pay. 
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In the context of matrix analysis the preceding transformation equations become (for 
Cartesian coordinates) an orthogonal similarity transformation; see Section 3.3. A geomet¬ 
rical interpretation of a second-rank tensor (the inertia tensor) is developed in Section 3.5. 

In summary, tensors are systems of components organized by one or more indices that 
transform according to specific rules under a set of transformations. The number of in¬ 
dices is called the rank of the tensor. If the transformations are coordinate rotations in 
three-dimensional space, then tensor analysis amounts to what we did in the sections on 
curvilinear coordinates and in Cartesian coordinates in Chapter 1. In four dimensions of 
Minkowski space-time, the transformations are Lorentz transformations, and tensors of 
rank 1 are called four-vectors. 


Addition and Subtraction of Tensors 

The addition and subtraction of tensors is defined in terms of the individual elements, just 
as for vectors. If 


A + B = C, 


( 2 . 68 ) 


then 


A ij + /I”' = C ij . 


Of course, A and B must be tensors of the same rank and both expressed in a space of the 
same number of dimensions. 


Summation Convention 


In tensor analysis it is customary to adopt a summation convention to put Eq. (2.66) and 
subsequent tensor equations in a more compact form. As long as we are distinguishing 
between contravariance and covariance, let us agree that when an index appears on one side 
of an equation, once as a superscript and once as a subscript (except for the coordinates 
where both are subscripts), we automatically sum over that index. Then we may write the 
second expression in Eq. (2.66) as 


B j = 


dx n dx 


dx k dx'J 


— B k i, 
r i 


(2.69) 


with the summation of the right-hand side over k and / implied. This is Einstein’s summa¬ 
tion convention . 7 The index i is superscript because it is associated with the contravariant 
x likewise j is subscript because it is related to the covariant gradient. 

To illustrate the use of the summation convention and some of the techniques of tensor 
analysis, let us show that the now-familiar Kronecker delta. Ski, is really a mixed tensor 


7 In this context dx'*/dx k might better be written as aj, and dx /dx'-l as //. 
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of rank 2, 8 k i, 8 The question is: Does 8 k i transform according to Eq. (2.66)? This is our 
criterion for calling it a tensor. We have, using the summation convention. 


ok dx 

8 l 


dx' 


dx" dx k 


dx k dx'j dx k dx'j 


(2.70) 


by definition of the Kronecker delta. Now, 

dx fi dx k _ dx" 
dx k dx'j dx'j 


(2.71) 


by direct partial differentiation of the right-hand side (chain rule). However, x" and x J 
are independent coordinates, and therefore the variation of one with respect to the other 
must be zero if they are different, unity if they coincide; that is. 


Hence 


dx ri 

dx'J 



(2.72) 



dx dx k 

-;- -8*1, 

dx k dx’J 


showing that the 8 k i are indeed the components of a mixed second-rank tensor. Notice that 
this result is independent of the number of dimensions of our space. The reason for the 
upper index i and lower index j is the same as in Eq. (2.69). 

The Kronecker delta has one further interesting property. It has the same components in 
all of our rotated coordinate systems and is therefore called isotropic. In Section 2.9 we 
shall meet a third-rank isotropic tensor and three fourth-rank isotropic tensors. No isotropic 
first-rank tensor (vector) exists. 


Symmetry-Antisymmetry 

The order in which the indices appear in our description of a tensor is important. In general, 
A mn is independent of A nm , but there are some cases of special interest. If, for all m and n, 

A mn — A nm , (2.73) 

we call the tensor symmetric. If, on the other hand, 

A mn _ — A" m , (2.74) 

the tensor is antisymmetric. Clearly, every (second-rank) tensor can be resolved into sym¬ 
metric and antisymmetric parts by the identity 

A mn = \{A mn + A nm ) + \(A mn - A nm ), (2.75) 

the first term on the right being a symmetric tensor, the second, an antisymmetric tensor. 
A similar resolution of functions into symmetric and antisymmetric parts is of extreme 
importance to quantum mechanics. 


8 It is common practice to refer to a tensor A by specifying a typical component, Ajj. As long as the reader refrains from writing 
nonsense such as A = Ajj, no harm is done. 
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Spinors 

It was once thought that the system of scalars, vectors, tensors (second-rank), and so on 
formed a complete mathematical system, one that is adequate for describing a physics 
independent of the choice of reference frame. But the universe and mathematical physics 
are not that simple. In the realm of elementary particles, for example, spin zero particles 9 
(it mesons, a particles) may be described with scalars, spin 1 particles (deuterons) by 
vectors, and spin 2 particles (gravitons) by tensors. This listing omits the most common 
particles: electrons, protons, and neutrons, all with spin These particles are properly 
described by spinors. A spinor is not a scalar, vector, or tensor. A brief introduction to 
spinors in the context of group theory (/ = 1/2) appears in Section 4.3. 


Exercises 


2.6.1 


2.6.2 


2.6.3 


2.6.4 

2.6.5 


Show that if all the components of any tensor of any rank vanish in one particular 
coordinate system, they vanish in all coordinate systems. 

Note. This point takes on special importance in the four-dimensional curved space of 
general relativity. If a quantity, expressed as a tensor, exists in one coordinate system, it 
exists in all coordinate systems and is not just a consequence of a choice of a coordinate 
system (as are centrifugal and Coriolis forces in Newtonian mechanics). 

The components of tensor A are equal to the corresponding components of tensor B in 
one particular coordinate system, denoted by the superscript 0; that is, 

<0 _ n0 

A ij - ’ 

Show that tensor A is equal to tensor B, Ajj = Bjj, in all coordinate systems. 

The last three components of a four-dimensional vector vanish in each of two reference 
frames. If the second reference frame is not merely a rotation of the first about the xo 
axis, that is, if at least one of the coefficients a,-o 0 = 1,2, 3) ^ 0, show that the zeroth 
component vanishes in all reference frames. Translated into relativistic mechanics this 
means that if momentum is conserved in two Lorentz frames, then energy is conserved 
in all Lorentz frames. 

From an analysis of the behavior of a general second-rank tensor under 90° and 180° 
rotations about the coordinate axes, show that an isotropic second-rank tensor in three- 
dimensional space must be a multiple of <5, ;. 

The four-dimensional fourth-rank Riemann-Christoffel curvature tensor of general rel¬ 
ativity, Rjkim , satisfies the symmetry relations 

Riklm — Rjkml — Rkilm- 

With the indices running from 0 to 3, show that the number of independent components 
is reduced from 256 to 36 and that the condition 

Riklm — Rlmik 


'’The particle spin is intrinsic angular momentum (in units of h). It is distinct from classical, orbital angular momentum due to 
motion. 
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further reduces the number of independent components to 21. Finally, if the components 
satisfy an identity Rikim + Rilmk + Rimkl — 0, show that the number of independent 
components is reduced to 20. 

Note. The final three-term identity furnishes new information only if all four indices are 
different. Then it reduces the number of independent components by one-third. 

2.6.6 Tjkl m is antisymmetric with respect to all pairs of indices. How many independent com¬ 
ponents has it (in three-dimensional space)? 


2.7 Contraction, Direct Product 
C ontraction 


When dealing with vectors, we formed a scalar product (Section 1.3) by summing products 
of corresponding components: 

A B — AjBi (summation convention). (2.76) 


The generalization of this expression in tensor analysis is a process known as contraction. 
Two indices, one covariant and the other contravariant, are set equal to each other, and then 
(as implied by the summation convention) we sum over this repeated index. For example, 
let us contract the second-rank mixed tensor B" j, 


dx" dx l k dx' k 

B i = — 7 - ;B k i = —rB l i 

dx k dx ' 1 dx k 


(2.77) 


using Eq. (2.71), and then by Eq. (2.72) 

B ,i i =8 l k B k i = B k k . (2.78) 


Our contracted second-rank mixed tensor is invariant and therefore a scalar. 10 This is ex¬ 
actly what we obtained in Section 1.3 for the dot product of two vectors and in Section 1.7 
for the divergence of a vector. In general, the operation of contraction reduces the rank of 
a tensor by 2. An example of the use of contraction appears in Chapter 4. 


Direct Product 


The components of a covariant vector (first-rank tensor) a, and those of a contravariant vec¬ 
tor (first-rank tensor) b J may be multiplied component by component to give the general 
term a, b ] . This, by Eq. (2.66) is actually a second-rank tensor, for 


• dx k dx' j , dx k dx' j 
a ’ b = —tr a k^r-r b = \ a k b )• 


dx' 


dx 1 


dx" dx 1 


Contracting, we obtain 


a':b" = a k b k . 


(2.79) 


(2.80) 


10 


In matrix analysis this scalar is the trace of the matrix. Section 3.2. 
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as in Eqs. (2.77) and (2.78), to give the regular scalar product. 

The operation of adjoining two vectors a, and b J as in the last paragraph is known as 
forming the direct product. For the case of two vectors, the direct product is a tensor of 
second rank. In this sense we may attach meaning to VE, which was not defined within 
the framework of vector analysis. In general, the direct product of two tensors is a tensor 
of rank equal to the sum of the two initial ranks; that is, 

A i j B kl = C i j kl , (2.81a) 

where C l j kl is a tensor of fourth rank. From Eqs. (2.66), 


C 


ii kl 
j 


dx" dx n dx' k dx' 1 
dx m 3 x'j dxP 3 xl 


C m P‘1 

n 


(2.81b) 


The direct product is a technique for creating new, higher-rank tensors. Exer¬ 
cise 2.7.1 is a form of the direct product in which the first factor is V. Applications appear 
in Section 4.6. 

When T is an nth-rank Cartesian tensor, (3/3 x l )Tjki... , a component of VT, is a 
Cartesian tensor of rank n + 1 (Exercise 2.7.1). However, (d/dx')Tj^i ... is not a tensor 
in more general spaces. In non-Cartesian systems d/dx" will act on the partial derivatives 
dx p /dx rq and destroy the simple tensor transformation relation (see Eq. (2.129)). 

So far the distinction between a covariant transformation and a contravariant transfor¬ 
mation has been maintained because it does exist in non-Euclidean space and because it is 
of great importance in general relativity. In Sections 2.10 and 2.11 we shall develop differ¬ 
ential relations for general tensors. Often, however, because of the simplification achieved, 
we restrict ourselves to Cartesian tensors. As noted in Section 2.6, the distinction between 
contravariance and covariance disappears. 


Exercises 


2.7.1 


2.7.2 

2.7.3 


If T...j is a tensor of rank n, show that 37’.../ /dx 1 is a tensor of rank n + 1 (Cartesian 
coordinates). 

Note. In non-Cartesian coordinate systems the coefficients a, ; are, in general, functions 
of the coordinates, and the simple derivative of a tensor of rank n is not a tensor except 
in the special case of n = 0. In this case the derivative does yield a covariant vector 
(tensor of rank 1) by Eq. (2.64). 

If Tjjk... is a tensor of rank n, show that dTij^.^/dx 1 is a tensor of rank n — 1 
(Cartesian coordinates). 

The operator 


E 



may be written as 
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using x\ — ict. This is the four-dimensional Laplacian, sometimes called the d’Alem- 
bertian and denoted by D 2 . Show that it is a scalar operator, that is, is invariant under 
Lorentz transformations. 

2.8 Quotient Rule 

If A, and B j are vectors, as seen in Section 2.7, we can easily show that A , B ,• is a second- 
rank tensor. Here we are concerned with a variety of inverse relations. Consider such equa¬ 
tions as 


KjAj = B 

(2.82a) 

Kj j A j = Bi 

(2.82b) 

KijAjk — B ik 

(2.82c) 

KijklAjj = B k i 

(2.82d) 

KijA k — Bij k . 

(2.82e) 


Inline with our restriction to Cartesian systems, we write all indices as subscripts and, 
unless specified otherwise, sum repeated indices. 

In each of these expressions A and B are known tensors of rank indicated by the number 
of indices and A is arbitrary. In each case K is an unknown quantity. We wish to establish 
the transformation properties of K. The quotient rule asserts that if the equation of interest 
holds in all (rotated) Cartesian coordinate systems, K is a tensor of the indicated rank. The 
importance in physical theory is that the quotient rule can establish the tensor nature of 
quantities. Exercise 2.8.1 is a simple illustration of this. The quotient rule (Eq. (2.82b)) 
shows that the inertia matrix appearing in the angular momentum equation L = Iu>, Sec¬ 
tion 3.5, is a tensor. 

In proving the quotient rule, we consider Eq. (2.82b) as a typical case. In our primed 
coordinate system 

K'ijA'j = B[ = a ik B k , (2.83) 

using the vector transformation properties of B. Since the equation holds in all rotated 
Cartesian coordinate systems, 

a ik Bk — OilciK^l A)). (2.84) 

Now, transforming A back into the primed coordinate system 11 (compare Eq. (2.62)), we 
have 

K'ijA'j =a ik K k iajiA[ .. (2.85) 

Rearranging, we obtain 

(K' ij -a ik aj,K kl )A'j = 0. (2.86) 

1 'Note the order of the indices of the direction cosine aj/ in this inverse transformation. We have 

A i = T.^r A 'j = H a B A 'i- 

j J j 
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This must hold for each value of the index i and for every primed coordinate system. Since 
the A'. is arbitrary, 12 we conclude 

K^OikOjtKu, (2.87) 

which is our definition of second-rank tensor. 

The other equations may be treated similarly, giving rise to other forms of the quotient 
rule. One minor pitfall should be noted: The quotient rule does not necessarily apply if B 
is zero. The transformation properties of zero are indeterminate. 


Example 2.8.1 Equations of Motion and Field Equations 

In classical mechanics, Newton’s equations of motion m\ = F tell us on the basis of the 
quotient rule that, if the mass is a scalar and the force a vector, then the acceleration a = v 
is a vector. In other words, the vector character of the force as the driving term imposes its 
vector character on the acceleration, provided the scale factor m is scalar. 

The wave equation of electrodynamics d 2 A 11 = J 11 involves the four-dimensional ver- 
sion of the Laplacian 3“ = fjjjj — V , a Lorentz scalar, and the external four-vector current 
J l> as its driving term. From the quotient rule, we infer that the vector potential A 1 ' is a 
four-vector as well. If the driving current is a four-vector, the vector potential must be of 
rank 1 by the quotient rule. ■ 

The quotient rule is a substitute for the illegal division of tensors. 


Exercises 

2.8.1 The double summation KjjAjBj is invariant for any two vectors A, and If . Prove that 
Kjj is a second-rank tensor. 

Note. In the form ds 2 (invariant) = gjj dx l dxf this result shows that the matrix gij is 
a tensor. 

2.8.2 The equation KijAjk = Ihk holds for all orientations of the coordinate system. If A and 
B are arbitrary second-rank tensors, show that K is a second-rank tensor also. 

2.8.3 The exponential in a plane wave is exp[i(k • r — cut)]. We recognize x^ — (ct,x i,X 2 ,xi) 
as a prototype vector in Minkowski space. If k • r — cot is a scalar under Lorentz transfor¬ 
mations (Section 4.5), show that k M = iu>/c, k\ , kj, kf) is a vector in Minkowski space. 
Note. Multiplication by h yields (E/c, p) as a vector in Minkowski space. 

2.9 Pseudotensors, Dual Tensors 

So far our coordinate transformations have been restricted to pure passive rotations. We 
now consider the effect of reflections or inversions. 


12 We might, for instance, take Aj = 1 and A' m = 0 for m/1. Then the equation K'.^ = a^axiK^i follows immediately. The 
rest of Eq. (2.87) comes from other special choices of the arbitrary A'j. 
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Figure 2.9 Inversion of Cartesian coordinates — polar vector. 


If we have transformation coefficients = —8jj, then by Eq. (2.60) 

x‘=-x'\ (2.88) 

which is an inversion or parity transformation. Note that this transformation changes our 
initial right-handed coordinate system into a left-handed coordinate system. 13 Our proto¬ 
type vector r with components (x l , x 2 , x 3 ) transforms to 

r’ = (x'\x' 2 ,x'l) = (-x\-x 2 ,- x 3 ). 

This new vector r' has negative components, relative to the new transformed set of axes. 
As shown in Fig. 2.9, reversing the directions of the coordinate axes and changing the 
signs of the components gives r' = r. The vector (an arrow in space) stays exactly as it 
was before the transformation was carried out. The position vector r and all other vectors 
whose components behave this way (reversing sign with a reversal of the coordinate axes) 
are called polar vectors and have odd parity. 

A fundamental difference appears when we encounter a vector defined as the cross prod¬ 
uct of two polar vectors. Let C = A x B, where both A and B are polar vectors. From 
Eq. (1.33), the components of C are given by 

C 1 = A 2 B 3 - A 3 B 2 (2.89) 

and so on. Now, when the coordinate axes are inverted. A' —> —A ", Bj —> — B ', but from 
its definition C k —> +C ,k ; that is, our cross-product vector, vector C, does not behave like 
a polar vector under inversion. To distinguish, we label it a pseudovector or axial vector 
(see Fig. 2.10) that has even parity. The term axial vector is frequently used because these 
cross products often arise from a description of rotation. 


13 


This is an inversion of the coordinate system or coordinate axes, objects in the physical world remaining fixed. 
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Figure 2.10 Inversion of Cartesian coordinates — axial vector. 


Examples are 


angular velocity. 

v = co x r, 

orbital angular momentum. 

L = rxp, 

torque, force = F, 

N = rxF, 

magnetic induction field B , 

9B 

— = —V x E 
dt 


In v = w x r, the axial vector is the angular velocity (o, and r and v = dr/ dt are polar 
vectors. Clearly, axial vectors occur frequently in physics, although this fact is usually 
not pointed out. In a right-handed coordinate system an axial vector C has a sense of 
rotation associated with it given by a right-hand rule (compare Section 1.4). In the inverted 
left-handed system the sense of rotation is a left-handed rotation. This is indicated by the 
curved arrows in Fig. 2.10. 

The distinction between polar and axial vectors may also be illustrated by a reflection. 
A polar vector reflects in a mirror like a real physical arrow. Fig. 2.1 la. In Figs. 2.9 and 2.10 
the coordinates are inverted; the physical world remains fixed. Here the coordinate axes 
remain fixed; the world is reflected — as in a mirror in the xz-plane. Specifically, in this 
representation we keep the axes fixed and associate a change of sign with the component 
of the vector. For a mirror in the xz-plane, P y —> — !\ . We have 

P = (P X , Py, P Z ) 

P' = (P x , —Py,P z ) polar vector. 

An axial vector such as a magnetic field H or a magnetic moment fi (— current x area 
of current loop) behaves quite differently under reflection. Consider the magnetic field 
H and magnetic moment fi to be produced by an electric charge moving in a circular path 
(Exercise 5.8.4 and Example 12.5.3). Reflection reverses the sense of rotation of the charge. 




irror in jcz-plane; (b) mirror 
xz-plane. 
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If we agree that the universe does not care whether we use a right- or left-handed coor¬ 
dinate system, then it does not make sense to add an axial vector to a polar vector. In the 
vector equation A = B, both A and B are either polar vectors or axial vectors. 14 Similar 
restrictions apply to scalars and pseudoscalars and, in general, to the tensors and pseudoten¬ 
sors considered subsequently. 

Usually, pseudoscalars, pseudovectors, and pseudotensors will transform as 


S' = JS, Cj — J cijjCj, A^j — J a ik a j\A kl , (2.90) 

where / is the determinant 15 of the array of coefficients a mn , the Jacobian of the parity 
transformation. In our inversion the Jacobian is 


J = 


-10 0 
0-10 
o o 


For a reflection of one axis, the x-axis, 

/ = 




-10 0 
0 1 0 

0 0 1 


= -1, 


(2.91) 


(2.92) 


and again the Jacobian / = — 1. On the other hand, for all pure rotations, the Jacobian J is 
always +1. Rotation matrices discussed further in Section 3.3. 

In Chapter 1 the triple scalar product S = A x B • C was shown to be a scalar (un¬ 
der rotations). Now by considering the parity transformation given by Eq. (2.88), we see 
that S -> —.S', proving that the triple scalar product is actually a pseudoscalar: This be¬ 
havior was foreshadowed by the geometrical analogy of a volume. If all three parameters 
of the volume — length, depth, and height — change from positive distances to negative 
distances, the product of the three will be negative. 


Levi-Civita Symbol 

For future use it is convenient to introduce the three-dimensional Levi-Civita symbol Sjjk, 
defined by 

£123 = £231 = £312 = 1, 

£132 = £213 = £321 =—1, (2.93) 

all other Sijk — 0. 

Note that s/jk is antisymmetric with respect to all pairs of indices. Suppose now that we 
have a third-rank pseudotensor S^k, which in one particular coordinate system is equal to 
£ijk- Then 

^ ij k — \®\®ip® jq®kr£ pqr (2.94) 


1 ^The big exception to this is in beta decay, weak interactions. Here the universe distinguishes between right- and left-handed 
systems, and we add polar and axial vector interactions. 

^Determinants are described in Section 3.1. 
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by definition of pseudotensor. Now, 

&lp&2qQ3r£pqr = 1^1 (2.95) 

by direct expansion of the determinant, showing that <5' 123 = \a\ 2 = 1 = £ 123 - Considering 
the other possibilities one by one, we find 

^2.96) 

for rotations and reflections. Hence Sjjk is a pseudotensor. 16 ’ 17 Furthermore, it is seen to 
be an isotropic pseudotensor with the same components in all rotated Cartesian coordinate 
systems. 

Dual Tensors 

With any antisymmetric second-rank tensor C (in three-dimensional space) we may asso¬ 
ciate a dual pseudovector C, defined by 

Ci - \sij k C jk . (2.97) 

Here the antisymmetric C may be written 

/ 0 C 12 -C 31 \ 

C= -C 12 0 C 23 . (2.98) 

V C 31 -C 23 0 ) 

We know that C, must transform as a vector under rotations from the double contraction of 
the fifth-rank (pseudo) tensor SjjkC mn but that it is really a pseudovector from the pseudo 
nature of e,^. Specifically, the components of C are given by 

(Ci,C 2 ,C 3 ) = (C 23 ,C 31 ,C 12 ). (2.99) 

Notice the cyclic order of the indices that comes from the cyclic order of the components 
of Sijk- Eq. (2.99) means that our three-dimensional vector product may literally be taken 
to be either a pseudovector or an antisymmetric second-rank tensor, depending on how we 
choose to write it out. 

If we take three (polar) vectors A, B, and C, we may define the direct product 

V ijk = A‘B j C k . (2.100) 

By an extension of the analysis of Section 2.6, V ljk is a tensor of third rank. The dual 
quantity 

v =^£ijk vijk (2.101) 

*°The usefulness of e p q r extends far beyond this section. For instance, the matrices M & of Exercise 3.2.16 are derived from 
( M r )pq = —ispqr . Much of elementary vector analysis can be written in a very compact form by using sij^ and the identity of 
Exercise 2.9.4 See A. A. Evett, Permutation symbol approach to elementary vector analysis. Am. J. Phys. 34: 503 (1966). 

17 The numerical value of e p q r is given by the triple scalar product of coordinate unit vectors: 

Xp -Xq X X r . 

From this point of view each element of e P q r is a pseudoscalar, but the s P q r collectively form a third-rank pseudotensor. 
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is clearly a pseudoscalar. By expansion it is seen that 


V = 


A 1 
A 2 
A 3 


B 1 C 1 
B 2 C 2 
B 3 C 3 


( 2 . 102 ) 


is our familiar triple scalar product. 

For use in writing Maxwell’s equations in covariant form. Section 4.6, we want to extend 
this dual vector analysis to four-dimensional space and, in particular, to indicate that the 
four-dimensional volume element dx° dx 1 dx 2 dx 3 is a pseudoscalar. 

We introduce the Levi-Civita symbol Sjjku the four-dimensional analog of Sjjk- This 
quantity Sjjki is defined as totally antisymmetric in all four indices. If ( ijkl ) is an even 
permutation 18 of (0, 1, 2, 3), then Sjjki is defined as +1; if it is an odd permutation, 
then Sijki is —1, and 0 if any two indices are equal. The Levi-Civita Sijki may be proved a 
pseudotensor of rank 4 by analysis similar to that used for establishing the tensor nature of 
Sjjk . Introducing the direct product of four vectors as fourth-rank tensor with components 

H ijkl = A‘B j C k D\ (2.103) 


built from the polar vectors A, B, C, and D, we may define the dual quantity 

II = i Sijk,H ijkl , 


4! 


(2.104) 


a pseudoscalar due to the quadruple contraction with the pseudotensor Sjjki- Now we let 
A, B, C, and D be infinitesimal displacements along the four coordinate axes (Minkowski 
space). 


A = (dx°, 0,0,0) 

(2.105) 

B = (0, dx 1 ,0, 0), and so on, 

H — dx° dx 1 dx 2 dx 3 . (2.106) 


The four-dimensional volume element is now identified as a pseudoscalar. We use this 
result in Section 4.6. This result could have been expected from the results of the special 
theory of relativity. The Lorentz-Fitzgerald contraction of dx 1 dx 2 dx 3 just balances the 
time dilation of dx°. 

We slipped into this four-dimensional space as a simple mathematical extension of the 
three-dimensional space and, indeed, we could just as easily have discussed 5-, 6-, or N- 
dimensional space. This is typical of the power of the component analysis. Physically, this 
four-dimensional space may be taken as Minkowski space, 

(v 0 , x l , x 2 , x 3 ) — (cf, x, y, z)i (2.107) 

where t is time. This is the merger of space and time achieved in special relativity. The 
transformations that describe the rotations in four-dimensional space are the Lorentz trans¬ 
formations of special relativity. We encounter these Lorentz transformations in Section 4.6. 


IS A permutation is odd if it involves an odd number of interchanges of adjacent indices, such as (0 1 2 3) —*■ (0 2 1 3). Even 
permutations arise from an even number of transpositions of adjacent indices. (Actually the word adjacent is unnecessary.) 
«0123 =+l- 
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Irreducible Tensors 

For some applications, particularly in the quantum theory of angular momentum, our Carte¬ 
sian tensors are not particularly convenient. In mathematical language our general second- 
rank tensor A,j is reducible, which means that it can be decomposed into parts of lower 
tensor rank. In fact, we have already done this. From Eq. (2.78), 

A — A' i (2.108) 

is a scalar quantity, the trace of A,/. 19 
The antisymmetric portion, 

- \( A ij ~ A//). (2.109) 

has just been shown to be equivalent to a (pseudo) vector, or 

Bij — Ck cyclic permutation of;, j, k. (2.110) 

By subtracting the scalar A and the vector Ck from our original tensor, we have an irre¬ 
ducible, symmetric, zero-trace second-rank tensor, Sjj , in which 

Sij = \{Aij + A ji )-\A8 ij , (2.111) 

with five independent components. Then, finally, our original Cartesian tensor may be writ¬ 
ten 

A i j = ±A8 ij + C k + S i j. (2.112) 

The three quantities A, C k , and .S ',j form spherical tensors of rank 0, 1, and 2, respec¬ 
tively, transforming like the spherical harmonics Y 21 (Chapter 12) for L — 0, 1, and 2. 
Further details of such spherical tensors and their uses will be found in Chapter 4 and the 
books by Rose and Edmonds cited there. 

A specific example of the preceding reduction is furnished by the symmetric electric 
quadrupole tensor 

Qij — J (3xiXj - r 2 8jj)p(xi,X2,X3)d 3 x. 

The —r 2 Sjj term represents a subtraction of the scalar trace (the three i — j terms). The 
resulting <2// h as zero trace. 


Exercises 


2.9.1 An antisymmetric square array is given by 

/ 0 c 3 -c 2 \ ( o c 12 c 13 \ 

-C 3 0 Cl = -C 12 0 c 23 , 

\ C 2 -Cl 0 / \-C 13 -C 23 0 ) 


l9 An alternate approach, using matrices, is given in Section 3.3 (see Exercise 3.3.9). 
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where (Ci, C2, C3) form a pseudovector. Assuming that the relation 

Ci - l>ij k C- ik 

holds in all coordinate systems, prove that C^ k is a tensor. (This is another form of the 
quotient theorem.) 

2.9.2 Show that the vector product is unique to three-dimensional space; that is, only in three 
dimensions can we establish a one-to-one correspondence between the components of 
an antisymmetric tensor (second-rank) and the components of a vector. 

2.9.3 Show that in R 3 

(a) S;,-=3, 

(b) S ij e i j k = 0, 

(c) SjpqEjpq — 2.8jj , 

(d) SijkSijk — 6 . 

2.9.4 Show that in R 3 

Sijk^pqk — ^ip&jq <5 iq^jp- 

2.9.5 (a) Express the components of a cross-product vector C, C = A x B, in terms of sij k 

and the components of A and B. 

(b) Use the antisymmetry of Sjjk to show that A-AxB = 0. 

ANS. (a) C i =e ijk AjB k . 

2.9.6 (a) Show that the inertia tensor (matrix) may be written 

Iij — m(xixj8ij - XiXj ) 

for a particle of mass m at (x] , X2, X 3 ). 

(b) Show that 

Ijj = Mil Mlj — mSilkXkSljmXm, 

where Mu — m l ' 2 snkXk . This is the contraction of two second-rank tensors and is 
identical with the matrix product of Section 3.2. 

2.9.7 Write V • V x A and V x Vcp in tensor (index) notation in R 3 so that it becomes obvious 
that each expression vanishes. 

3 3 t 

ANS. V • V xA = eiik —r—r A\ 
1 dx‘ dxJ 

2.9.8 Expressing cross products in terms of Levi-Civita symbols ( Sjj k ), derive the BAC-CAB 
rule, Eq. (1.55). 

Hint. The relation of Exercise 2.9.4 is helpful. 
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2.9.9 Verify that each of the following fourth-rank tensors is isotropic, that is, that it has the 
same form independent of any rotation of the coordinate systems. 

(a) Ajjki — Si j Ski, 

(b) Bijki — SikS ji + SnSjk, 

(c) Cijki — &ik&jl ~ SnSjk- 

2.9.10 Show that the two-index Levi-Civita symbol s,j is a second-rank pseudotensor (in two- 
dimensional space). Does this contradict the uniqueness of S/j (Exercise 2.6.4)? 

2.9.11 Represent s,j by a 2 x 2 matrix, and using the 2x2 rotation matrix of Section 3.3 show 
that Sjj is invariant under orthogonal similarity transformations. 

2.9.12 Given Ak = \SjjkB with B‘J — — B ]l , antisymmetric, show that 

B mn = £ mnk Ak 

2.9.13 Show that the vector identity 

(A x B) • (C x D) = (A ■ C)(B • D) - (A • D)(B • C) 

(Exercise 1.5.12) follows directly from the description of a cross product with Sjjk and 
the identity of Exercise 2.9.4. 

2.9.14 Generalize the cross product of two vectors to n -dimensional space for n = 4,5, _ 

Check the consistency of your construction and discuss concrete examples. See Exer¬ 
cise 1.4.17 for the case n — 2. 

2.10 General Tensors 

The distinction between contravariant and covariant transformations was established in 
Section 2.6. Then, for convenience, we restricted our attention to Cartesian coordinates 
(in which the distinction disappears). Now in these two concluding sections we return to 
non-Cartesian coordinates and resurrect the contravariant and covariant dependence. As in 
Section 2.6, a superscript will be used for an index denoting contravariant and a subscript 
for an index denoting covariant dependence. The metric tensor of Section 2.1 will be used 
to relate contravariant and covariant indices. 

The emphasis in this section is on differentiation, culminating in the construction of 
the covariant derivative. We saw in Section 2.7 that the derivative of a vector yields a 
second-rank tensor—in Cartesian coordinates. In non-Cartesian coordinate systems, it is 
the covariant derivative of a vector rather than the ordinary derivative that yields a second- 
rank tensor by differentiation of a vector. 


Metric Tensor 

Let us start with the transformation of vectors from one set of coordinates (q , <? , g 3 ) 
to another r = (x , x 2 , x 3 ). The new coordinates are (in general nonlinear) functions 
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x 1 (q l , q 2 , q 3 ) of the old, such as spherical polar coordinates (r, 0, <p). But their differ¬ 
entials obey the linear transformation law 

• dx* 

dx 1 — - — rdq J , (2.113a) 


dr = e jdqJ (2.113b) 

in vector notation. For convenience we take the basis vectors g\ — (|^r- |^j), £ 2 , 

and £3 to form a right-handed set. These vectors are not necessarily orthogonal. Also, a 
limitation to three-dimensional space will be required only for the discussions of cross 
products and curls. Otherwise these £, may be in /V-dimensional space, including the 
four-dimensional space-time of special and general relativity. The basis vectors £, may 
be expressed by 

3r 

£/ = —, (2.114) 

dq' 

as in Exercise 2.2.3. Note, however, that the £, here do not necessarily have unit magnitude. 
From Exercise 2.2.3, the unit vectors are 

1 3r 
hi dqi 

and therefore 

Gj — hj£j 


(no summation). 


(no summation). (2.115) 


The G, are related to the unit vectors e, by the scale factors hi of Section 2.2. The e, have no 
dimensions; the £, have the dimensions of h ,. In spherical polar coordinates, as a specific 
example, 

e r =e r =r, eg =re# =r0, g v = rsinfle^ = r sinBip. (2.116) 


In Euclidean spaces, or in Minkowski space of special relativity, the partial derivatives in 
Eq. (2.113) are constants that define the new coordinates in terms of the old ones. We used 
them to define the transformation laws of vectors in Eq. (2.59) and (2.62) and tensors in 
Eq. (2.66). Generalizing, we define a contravariant vector V‘ under general coordinate 
transformations if its components transform according to 

V" = — rV J , (2.117a) 

3 qJ 

or 


V=V j Gj 


(2.117b) 


in vector notation. For covariant vectors we inspect the transformation of the gradient 
operator 

3 _ dq ' 3 
dx 1 dx 1 dqi 


(2.118) 
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using the chain rule. From 


dx' dqi 
dq j dx k 


(2.119) 


it is clear that Eq. (2.118) is related to the inverse transformation of Eq. (2.113), 


3 q 1 

dq J — - -dx . 

dx 1 


Hence we define a covariant vector V) if 


holds or, in vector notation. 


. dqJ 
V = — Vi 
' dx 1 1 


V' = Vje j , 

where e J are the contravariant vectors g ]l Ej = e J . 
Second-rank tensors are defined as in Eq. (2.66), 


A n > 


dx‘ dx j u 
dq k dq l 


and tensors of higher rank similarly. 

As in Section 2.1, we construct the square of a differential displacement 


( 2 . 120 ) 


(2.121a) 


(2.121b) 


( 2 . 122 ) 


( ds) 2 = dr ■ dr — (e,- dq')° = e,- • ej dq' dq'. (2.123) 

Comparing this with (ds) 2 of Section 2.1, Eq. (2.5), we identify e, ■ ej as the covariant 
metric tensor 


e/ • e j — gij- (2.124) 

Clearly, y, ; is symmetric. The tensor nature of follows from the quotient rule. Exer¬ 
cise 2.8.1. We take the relation 

g ik gkj = 8 i j (2.125) 

to define the corresponding contravariant tensor g' k . Contravariant g lk enters as the in¬ 
verse 20 of covariant gkj. We use this contravariant g lk to raise indices, converting a co¬ 
variant index into a contravariant index, as shown subsequently. Likewise the covariant gkj 
will be used to lower indices. The choice of g' k and gkj for this raising-lowering operation 
is arbitrary. Any second-rank tensor (and its inverse) would do. Specifically, we have 

g lJ e j = e l relating covariant and 

contravariant basis vectors, (2 126) 

g‘j Fj = F‘ relating covariant and 

contravariant vector components. 


- (1 1F the tensor gkj is written as a matrix, the tensor g‘ k is given by the inverse matrix. 
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Then 


gijS 1 — Si as the corresponding index 
gij F J = Fj lowering relations. 


(2.127) 


It should be emphasized again that the e, and e 1 do not have unit magnitude. This may 
be seen in Eqs. (2.116) and in the metric tensor gjj for spherical polar coordinates and its 
inverse g ,J : 


(10 0 \ 

(gij) = 0 r 2 0 

\0 0 r 2 sin 2 6 ) 


C) 


/I 

0 


0 

1 

72 


0 0 


° \ 

0 

1 

r 2 sin 2 0 / 


Christoffel Symbols 


Let us form the differential of a scalar i//, 


Bf • 
dx// = —7 dq . 
dq l 1 


(2.128) 


Since the dq' are the components of a contravariant vector, the partial derivatives 
dxlr/dq' must form a covariant vector—by the quotient rule. The gradient of a scalar be¬ 
comes 


3i (r . 


(2.129) 


Note that dxjf/dq' are not the gradient components of Section 2.2—because e' ^ e ; - of 
Section 2.2. 

Moving on to the derivatives of a vector, we find that the situation is much more compli¬ 
cated because the basis vectors e ( are in general not constant. Remember, we are no longer 
restricting ourselves to Cartesian coordinates and the nice, convenient x, y, z! Direct dif¬ 
ferentiation of Eq. (2.117a) yields 


dV’ k Bx k dV d 2 x k 

- = -7 -7+ -7-7 V 1 , 

dqJ dq 1 3 q J dq'dq' 

or, in vector notation, 

3V' _ 3V ! ,■ 3e ; 

3 qj 3 qj e ' ^ dqj ’ 


(2.130a) 


(2.130b) 


The right side of Eq. (2.130a) differs from the transformation law for a second-rank mixed 
tensor by the second term, which contains second derivatives of the coordinates xr. The 
latter are nonzero for nonlinear coordinate transformations. 

Now, 3e,- /dq 1 will be some linear combination of the e^, with the coefficient depending 
on the indices i and j from the partial derivative and index k from the base vector. We 
write 


dej 

dq 1 


T k jS k . 


(2.131a) 
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Multiplying by e m and using s'" ■ = S'f from Exercise 2.10.2, we have 


rip- 

f'" = s m --. (2.131b) 

,J dqJ 

The rf . is a Christoffel symbol of the second kind. It is also called a coefficient of con- 

V 

nection. These rf. are not third-rank tensors and the 3 V/i)q J of Eq. (2.130a) are not 
second-rank tensors. Equations (2.131) should be compared with the results quoted in Ex¬ 
ercise 2.2.3 (remembering that in general e, f e, ). In Cartesian coordinates, T k j = 0 for all 
values of the indices i, j , and k. These Christoffel three-index symbols may be computed 
by the techniques of Section 2.2. This is the topic of Exercise 2.10.8. Equation (2.138) 
offers an easier method. Using Eq. (2.114), we obtain 


8ej_ = 9 2 r _ dej _ k 

dqj dqJ 3 q' 3 q' k> 


(2.132) 


Hence these Christoffel symbols are symmetric in the two lower indices: 


r-'/C _ t^/C 

>j ~ ji ’ 


(2.133) 


Christoffel Symbols as Derivatives of the Metric Tensor 


It is often convenient to have an explicit expression for the Christoffel symbols in terms of 
derivatives of the metric tensor. As an initial step, we define the Christoffel symbol of the 
first kind [i j , k] by 


[ij,k] = g mk l (2.134) 

from which the symmetry [ij,k] = [ ji, k] follows. Again, this [ij,k] is not a third-rank 
tensor. From Eq. (2.131b), 


... ,, m 
lIJ, k] = gmkS ■ ~-j 
dqj 

8e, 

— Ek ' -r. 

dqJ 

Now we differentiate gij = e ; • e j, Eq. (2.124): 

dgij _ 3 ei_ 8sj 

dq k dq k ' ' dq k 


= [ ik , j] + [ jk , i] 


(2.135) 


(2.136) 


by Eq. (2.135). Then 


and 


Uj,k] 


1 

2 


dgik 

dq-i 


d Sjk 

dq' 


dgif] 
dq k J ’ 


E s ij = g ks [ij,k] 

= [ ks 3 Sik dgjk 

2 8 dqi dq' 


dj!i\ 

dq k J ' 


(2.137) 


(2.138) 
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These Christoffel symbols are applied in the next section. 


Covariant Derivative 


With the Christoffel symbols, Eq. (2.130b) may be rewritten 


av' 

3 qi 


dV' , , 

w ei+vr ‘ jSk - 


(2.139) 


Now, i and k in the last term are dummy indices. Interchanging i and k (in this one term), 
we have 


av' 

dqj 


dV' 

dqJ 


V 



Si- 


(2.140) 


The quantity in parenthesis is labeled a covariant derivative, V!.. We have 

dV‘ , ■ 

v 'j = W + vr ' kj - (2 - 141) 

The ; j subscript indicates differentiation with respect to q 1 . The differential c/V' becomes 

av' . 

dV = -r dq J =[V. l i dq J ]e i . (2.142) 

a q J ,J 

A comparison with Eq. (2.113) or (2.122) shows that the quantity in square brackets is 
the /th contravariant component of a vector. Since dq J is the /th contravariant component 
of a vector (again, Eq. (2.113)), V'. must be the i /th component of a (mixed) second-rank 
tensor (quotient rule). The covariant derivatives of the contravariant components of a vector 
form a mixed second-rank tensor, V'-. 

Since the Christoffel symbols vanish in Cartesian coordinates, the covariant derivative 
and the ordinary partial derivative coincide: 

dV 

- - — V. j (Cartesian coordinates). (2.143) 

dq- 1 ,J 

The covariant derivative of a covariant vector V) is given by (Exercise 2.10.9) 

%-0-nrj. o-m 

Like V! ; , Vi- ; is a second-rank tensor. 

The physical importance of the covariant derivative is that “A consistent replacement 
of regular partial derivatives by covariant derivatives carries the laws of physics (in com¬ 
ponent form) from flat space-time into the curved (Riemannian) space-time of general 
relativity. Indeed, this substitution may be taken as a mathematical statement of Einstein’s 
principle of equivalence.” 21 


21 C. W. Misner, K. S. Thome, and J. A. Wheeler, Gravitation. San Francisco: W. H. Freeman (1973), p. 3S7. 
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The covariant derivative of vectors, tensors, and the Christoffel symbols may also be ap¬ 
proached from geodesics. A geodesic in Euclidean space is a straight line. In general, it is 
the curve of shortest length between two points and the curve along which a freely falling 
particle moves. The ellipses of planets are geodesics around the sun, and the moon is in 
free fall around the Earth on a geodesic. Since we can throw a particle in any direction, a 
geodesic can have any direction through a given point. Hence the geodesic equation can 
be obtained from Fermat’s variational principle of optics (see Chapter 17 for Euler’s equa¬ 
tion). 


'/ 


8 ds = 0, 


where ds 2 is the metric, Eq. (2.123), of our space. Using the variation of ds 2 , 
2ds 8 ds = dq' dq J 8 gij + gj/ dq‘ 8 dq J + gij dq J 8 dq' 
in Eq. (2.145) yields 
1 

2 , 


/ 


dq' dq 1 dq' d ■ dq J d 

— ~T S Sij + gij — — 8 dq J + g u — —8 dq 
ds ds ds ds ds ds 


ds = 0, 


(2.145) 


(2.146) 


(2.147) 


where ds measures the length on the geodesic. Expressing the variations 

8g i j = J^8dq k = (hg ij )8dq k 

in terms of the independent variations 8dq k , shifting their derivatives in the other two 
terms of Eq. (2.147) upon integrating by parts, and renaming dummy summation indices, 
we obtain 


1 

2 


/ 


dq' dq 1 
ds ds 


dkgij ~ 


d 

ds 


( dq 1 
\ 8ik ~ds +8k} 



8dq k ds = 0. 


(2.148) 


The integrand of Eq. (2.148), set equal to zero, is the geodesic equation. It is the Euler 
equation of our variational problem. Upon expanding 


dgik , a dq J 
= 


d 8kj „ dq 1 
ds ~ ( ,gkj ) ds 


along the geodesic we find 


1 dq 1 dq' d 2 q‘ 

2 ~d^~d7 {dk8ij ~ dj8ik ~ digkj) ~ 8ik ~d^ ~ °- 


(2.149) 


(2.150) 


Multiplying Eq. (2.150) with g k and using Eq. (2.125), we find the geodesic equation 


d z q l dq 1 dq J 1 uj 


(2.151) 


where the coefficient of the velocities is the Christoffel symbol T?. of Eq. (2.138). 

Geodesics are curves that are independent of the choice of coordinates. They can be 
drawn through any point in space in various directions. Since the length ds measured along 
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the geodesic is a scalar, the velocities dq' /ds (of a freely falling particle along the geodesic, 
for example) form a contravariant vector. Hence Vkdq k /ds is a well-defined scalar on 
any geodesic, which we can differentiate in order to define the covariant derivative of any 
covariant vector 14 . Using Eq. (2.151) we obtain from the scalar 

d / dq k \ dVk dq k drq k 
ds \ k ds ) ds ds k ds 2 


314 dq' dq k ^ dq' dq } 
dq' ds ds lJ ds ds 


dq' dq k 
ds ds 


= ^=7- 


dVk 

dq' 


(2.152) 


When the quotient theorem is applied to Eq. (2.152) it tells 


us that 


dV k , 
v k q = - r k Vi 


(2.153) 


is a covariant tensor that defines the covariant derivative of 14 , consistent with Eq. (2.144). 
Similarly, higher-order tensors may be derived. 

The second term in Eq. (2.153) defines the parallel transport or displacement, 

8V k = r l ki Vi8q‘, (2.154) 


of the covariant vector 14 from the point with coordinates q' to q' + Sq’. The parallel 
transport, 8U k , of a contravariant vector JJ k may be found from the invariance of the scalar 
product U k 14 under parallel transport, 

8(U k V k ) = 8U k V k + U k 8V k = 0, (2.155) 


in conjunction with the quotient theorem. 

In summary, when we shift a vector to a neighboring point, parallel transport prevents it 
from sticking out of our space. This can be clearly seen on the surface of a sphere in spher¬ 
ical geometry, where a tangent vector is supposed to remain a tangent upon translating it 
along some path on the sphere. This explains why the covariant derivative of a vector or 
tensor is naturally defined by translating it along a geodesic in the desired direction. 


Exercises 

2.10.1 Equations (2.115) and (2.116) use the scale factor hi, citing Exercise 2.2.3. In Sec¬ 
tion 2.2 we had restricted ourselves to orthogonal coordinate systems, yet Eq. (2.115) 
holds for nonorthogonal systems. Justify the use of Eq. (2.115) for nonorthogonal sys¬ 
tems. 

2.10.2 (a) Show that s' ■ ej = 8'-. 

(b) From the result of part (a) show that 

F' —F ■ e' and F t =F-e ( . 



2.10 General Tensors 


159 


2.10.3 

2.10.4 

2.10.5 

2.10.6 

2.10.7 

2.10.8 

2.10.9 

2.10.10 

2.10.11 


For the special case of three-dimensional space (e\, ei, 63 defining a right-handed co¬ 
ordinate system, not necessarily orthogonal), show that 

e j x e k 

e = — ; -, i. j , k— 1, 2, 3 and cyclic permutations. 

ej x e k ■ e, 

AVfe. These contravariant basis vectors e' define the reciprocal lattice space of Sec¬ 
tion 1.5. 

Prove that the contravariant metric tensor is given by 

g'i = e‘ ■ e J . 

If the covariant vectors e ( - are orthogonal, show that 

(a) gjj is diagonal, 

(b) g“ = 1 /ga (no summation), 

(C) |e'| = l/|ff;|- 


Derive the covariant and contravariant metric tensors for circular cylindrical coordi¬ 
nates. 


Transform the right-hand side of Eq. (2.129), 


Via = 



into the e, basis, and verify that this expression agrees with the gradient developed in 
Section 2.2 (for orthogonal coordinates). 

Evaluate dei/dq' for spherical polar coordinates, and from these results calculate rf. 
for spherical polar coordinates. 

Note. Exercise 2.5.2 offers a way of calculating the needed partial derivatives. Remem¬ 
ber, 


e 1 = r but 


e 2 = r0 


and ei, = rsm9(p. 


Show that the covariant derivative of a covariant vector is given by 


Hint. Differentiate 


Vi;j - 


dVi_ 

dq-i 


nr*. 


e' • e j — S'j. 


Verify that Vyj = gikV. k j by showing that 
dVi 

w~ VtT1j=g,k 


dv k 

dqi 


+ v'"r 


mj 


From the circular cylindrical metric tensor ga, calculate the rf for circular cylindrical 
coordinates. 

Note. There are only three nonvanishing T. 
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2.10.12 Using the T k j from Exercise 2.10.11, write out the covariant derivatives V' ■ of a vector 
V in circular cylindrical coordinates. 

2.10.13 A triclinic crystal is described using an oblique coordinate system. The three covariant 
base vectors are 

e\ — 1.5x, 
e 2 — 0.4x+ 1.6y, 

«3 = 0.2x + 0.3y + 1.0z. 


(a) Calculate the elements of the covariant metric tensor g,j. 

(b) Calculate the Christoffel three-index symbols, T k j. (This is a “by inspection” cal¬ 
culation.) 

(c) From the cross-product form of Exercise 2.10.3 calculate the contravariant base 
vector e 3 . 

(d) Using the explicit forms e ] and e, , verify that e 3 • e, = <5 3 ,-. 


Note. If it were needed, the contravariant metric tensor could be determined by finding 
the inverse of gjj or by finding the e' and using g lJ — s' ■ e J . 


2.10.14 Verify that 


[O'.*] =2 


dgik 

dq' 


d 8jk 
3 q' 


d 8ij 
3 q k 


Hint. Substitute Eq. (2.135) into the right-hand side and show that an identity results. 


2.10.15 Show that for the metric tensor gjj.j — 0, g' J -j. — 0. 

2.10.16 Show that parallel displacement Sdq 1 = d 2 q l along a geodesic. Construct a geodesic 
by parallel displacement of S dq'. 


2.10.17 Construct the covariant derivative of a vector V' by parallel transport starting from the 
limiting procedure 


V i (qJ +dqj)-V i (qj) 

lim -;- 

dqj-* 0 dqJ 


2.11 Tensor Derivative Operators 

In this section the covariant differentiation of Section 2.10 is applied to rederive the vector 
differential operations of Section 2.2 in general tensor form. 


Divergence 

Replacing the partial derivative by the covariant derivative, we take the divergence to be 

dV' u ■ 

V • V = v‘. = —r- + V k T) k . 

’ l dq 1 lk 


(2.156) 
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Expressing F',. by Eq. (2.138), we have 


r 


ik ' 


dgitn 

dq k 


9 Skm 
3 q' 


dgik | 
dq"< }' 


(2.157) 


When contracted with g" n the last two terms in the curly bracket cancel, since 

im ^8km _ m j dgki _ j m dgjk 

8 dq' ~ 8 dq m ~ 8 3 q m ' 


Then 


p/ _ \ im ^§im 

ik ~ 2° 3 q k ' 

From the theory of determinants. Section 3.1, 

d 8 _ im d 8im 

3 q k 88 3 q k ’ 


(2.158) 


(2.159) 


(2.160) 


where g is the determinant of the metric, g — det (gij). Substituting this result into 
Eq. (2.158), we obtain 


This yields 


1 dg _ 1 dg 1 / 2 

2g 3 q k g 1 / 2 3 q k 


V • V = Vlj 


1 3 

g 1 / 2 3 q k 


(g 1 / 2 v k ). 


(2.161) 


(2.162) 


To compare this result with Eq. (2.21), note that /z i/? 2^3 = g l/2 and V 1 (contravariant 
coefficient of e,) = VJhj (no summation), where V, is Section 2.2 coefficient of e, . 


Laplacian 


In Section 2.2, replacement of the vector V in V • V by Vi/r led to the Laplacian V ■ V >//. 
Here we have a contravariant V' . Using the metric tensor to create a contravariant Vi/r, we 
make the substitution 


V‘ 


ik d± 

8 dq k ' 


Then the Laplacian V • V i/r becomes 


V • Vl/r = 


1 3 

g 1 / 2 dq' 


1/2 JkW_\ 

8 dq k ) 


(2.163) 


For the orthogonal systems of Section 2.2 the metric tensor is diagonal and the contravari¬ 
ant g" (no summation) becomes 


g" = c hir 2 . 
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Equation (2.163) reduces to 


V-Vi !r = 


1 9 

/z 1 /z 23 dq' 


h i /?2^ 3 9Vr\ 

hf 9 <? ! / ’ 


in agreement with Eq. (2.22). 


Curl 


The difference of derivatives that appears in the curl (Eq. (2.27)) will be written 


d_v L _dv l 

dq’ dq 1 ' 

Again, remember that the components V, here are coefficients of the contravariant 
(nonunit) base vectors s'. The V, of Section 2.2 are coefficients of unit vectors e, . Adding 
and subtracting, we obtain 


9 ^ 

dqj 


dVj dVi u 9 V j , 

—= —- - v k r k - - J - + \4r A . 

dq' 8qJ L lJ dq' * }l 


= Vfj - V J 


J,‘ 


(2.164) 


using the symmetry of the Christoffel symbols. The characteristic difference of derivatives 
of the curl becomes a difference of covariant derivatives and therefore is a second-rank 
tensor (covariant in both indices). As emphasized in Section 2.9, the special vector form of 
the curl exists only in three-dimensional space. 

From Eq. (2.138) it is clear that all the Christoffel three index symbols vanish in 
Minkowski space and in the real space-time of special relativity with 


(1 

0 

0 

o\ 

0 

-1 

0 

0 

0 

0 

-1 

0 

^0 

0 

0 

-v 


Here 


xq — ct, xi = x, X 2 — y, 


and *3 — z. 


This completes the development of the differential operators in general tensor form. (The 
gradient was given in Section 2.10.) In addition to the fields of elasticity and electromag¬ 
netism, these differentials find application in mechanics (Lagrangian mechanics, Hamil¬ 
tonian mechanics, and the Euler equations for rotation of rigid body); fluid mechanics; and 
perhaps most important of all, the curved space-time of modern theories of gravity. 


Exercises 


2 . 11.1 


Verify Eq. (2.160), 


= im 3 Sim 

dq k dq k ’ 

for the specific case of spherical polar coordinates. 
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2 . 11.2 Starting with the divergence in tensor notation, Eq. (2.162), develop the divergence of a 
vector in spherical polar coordinates, Eq. (2.47). 

2 . 11.3 The covariant vector A, is the gradient of a scalar. Show that the difference of covariant 
derivatives A, ;/ — Aj j vanishes. 

Additional Readings 


Dirac, P. A. M., General Theory of Relativity. Princeton, NJ: Princeton University Press (1996). 
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Jeffreys, H., Cartesian Tensors. Cambridge: Cambridge University Press (1952). This is an excellent discussion 
of Cartesian tensors and their application to a wide variety of fields of classical physics. 

Lawden, D. F., An Introduction to Tensor Calculus, Relativity and Cosmology, 3rd ed. New York: Wiley (1982). 

Margenau, H., and G. M. Murphy, The Mathematics of Physics and Chemistry, 2nd ed. Princeton, NJ: Van Nos¬ 
trand (1956). Chapter 5 covers curvilinear coordinates and 13 specific coordinate systems. 

Misner, C. W., K. S. Thorne, and J. A. Wheeler, Gravitation. San Francisco: W. H. Freeman (1973), p. 387. 

Moller, C., The Theory of Relativity. Oxford: Oxford University Press (1955). Reprinted (1972). Most texts on 
general relativity include a discussion of tensor analysis. Chapter 4 develops tensor calculus, including the 
topic of dual tensors. The extension to non-Cartesian systems, as required by general relativity, is presented in 
Chapter 9. 

Morse, P. M., and H. Feshbach, Methods of Theoretical Physics. New York: McGraw-Hill (1953). Chapter 5 in¬ 
cludes a description of several different coordinate systems. Note that Morse and Feshbach are not above using 
left-handed coordinate systems even for Cartesian coordinates. Elsewhere in this excellent (and difficult) book 
there are many examples of the use of the various coordinate systems in solving physical problems. Eleven ad¬ 
ditional fascinating but seldom-encountered orthogonal coordinate systems are discussed in the second (1970) 
edition of Mathematical Methods for Physicists. 

Ohanian, H. C., and R. Ruffini, Gravitation and Spacetime, 2nd ed. New York: Norton & Co. (1994). A well- 
written introduction to Riemannian geometry. 

Sokolnikoff, I. S., Tensor Analysis — Theory and Applications, 2nd ed. New York: Wiley (1964). Particularly 
useful for its extension of tensor analysis to non-Euclidean geometries. 

Weinberg, S., Gravitation and Cosmology. Principles and Applications of the General Theory of Relativity. New 
York: Wiley (1972). This book and the one by Misner, Thorne, and Wheeler are the two leading texts on 
general relativity and cosmology (with tensors in non-Cartesian space). 

Young, E. C., Vector and Tensor Analysis, 2nd ed. New York: Marcel Dekker (1993). 
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Chapter 3 


Determinants and 
Matrices 


3.1 Determinants 

We begin the study of matrices by solving linear equations that will lead us to determi¬ 
nants and matrices. The concept of determinant and the notation were introduced by the 
renowned German mathematician and philosopher Gottfried Wilhelm von Leibniz. 

Homogeneous Linear Equations 

One of the major applications of determinants is in the establishment of a condition for 
the existence of a nontrivial solution for a set of linear homogeneous algebraic equations. 
Suppose we have three unknowns x\ . at. A3 (or n equations with n unknowns): 

a lA'l + 02x2 + 03x3 = 0, 

b\x\ + b2X2 + b3X3 — 0 , ( 3 . 1 ) 

C\X\ + C 2 X 2 + C3X3 = 0 . 

The problem is to determine under what conditions there is any solution, apart from 
the trivial one x\ = 0 , X2 — 0 , X3 = 0 . If we use vector notation x = (x\,X2, X3) for the 
solution and three rows a = (a\, 02, C13), b = (b\ , b2, £>3), c = (c 1, C2, C3) of coefficients, 
then the three equations, Eqs. ( 3 . 1 ), become 

ax = 0, b-x = 0, c-x = 0. (3.2) 

These three vector equations have the geometrical interpretation that x is orthogonal to 
a, b, and c. If the volume spanned by a, b, c given by the determinant (or triple scalar 
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product, see Eq. (1.50) of Section 1.5) 

a i A2 £73 

I>3 = (a x b) • c = det(a, b, c) = b\ b 2 b 2 ( 3 . 3 ) 

C] Cl C3 

is not zero, then there is only the trivial solution x = 0. 

Conversely, if the aforementioned determinant of coefficients vanishes, then one of the 
row vectors is a linear combination of the other two. Let us assume that c lies in the plane 
spanned by a and b, that is, that the third equation is a linear combination of the first 
two and not independent. Then x is orthogonal to that plane so that x ~ a x b. Since 
homogeneous equations can be multiplied by arbitrary numbers, only ratios of the x; are 
relevant, for which we then obtain ratios of 2 x 2 determinants 

xi aib 2 — £73(72 
x 3 a l b 2 -a 2 bi 
x 2 a\b 2 — a 2 b\ 

X3 a\b 2 — a 2 b[ 

from the components of the cross product a x b, provided X3 ~ a\h 2 — ci 2 b\ / 0. This is 
Cramer’s rule for three homogeneous linear equations. 

Inhomogeneous Linear Equations 

The simplest case of two equations with two unknowns, 

£ 71 X 1 +£ 72 X 2 =£73, b{X\ + b 2 x 2 — (73, ( 3 . 5 ) 

can be reduced to the previous case by imbedding it in three-dimensional space with a so¬ 
lution vectorx = (xi,X2, —1) and row vectors a = ( 771 , £ 72 , £ 73 ), b = {b\, b 2 , b 2 ). As before, 
Eqs. ( 3 . 5 ) in vector notation, a ■ x = 0 and b • x = 0, imply that x ~ a x b, so the analog of 
Eqs. ( 3 . 4 ) holds. For this to apply, though, the third component of a x b must not be zero, 
that is, aib 2 — a 2 b\ ^ 0, because the third component of x is —1 ^ 0. This yields the x. 


(3.6a) 


(3.6b) 


The determinant in the numerator of xi(x 2 ) is obtained from the determinant of the co¬ 
efficients \b\b 2 \ by replacing the first (second) column vector by the vector (^ 3 ) of the 
inhomogeneous side of Eq. (3.5). This is Cramer’s rule for a set of two inhomogeneous 
linear equations with two unknowns. 
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These solutions of linear equations in terms of determinants can be generalized to n 
dimensions. The determinant is a square array 

Cl | Cl 2 a n 

b\ b 2 ■■■ b n 

Cl C2 * * * C n 

of numbers (or functions), the coefficients of n linear equations in our case here. The 
number n of columns (and of rows) in the array is sometimes called the order of the 
determinant. The generalization of the expansion in Eq. (1.48) of the triple scalar product 
(of row vectors of three linear equations) leads to the following value of the determinant 
£>„ in n dimensions, 

D n — ^ ' £ijk--- a ibjCk • • • , (3.8) 

UX - 

where analogous to the Levi-Civita symbol of Section 2.9, is +1 for even permuta¬ 
tions 1 (i jk ■ • ■) of (123 • • • n ), —1 for odd permutations, and zero if any index is repeated. 

Specifically, for the third-order determinant £>3 of Eq. (3.3), Eq. (3.8) leads to 

£>3 = +flli>2C3 - aib 2 C 2 - a 2 b\C 3 + <72^3^1 + Ct 3 b[C 2 - Cl 3 b 2 C\ • (3.9) 

The third-order determinant, then, is this particular linear combination of products. Each 
product contains one and only one element from each row and from each column. Each 
product is added if the columns (indices) represent an even permutation of (123) and sub¬ 
tracted if we have an odd permutation. Equation (3.3) may be considered shorthand no¬ 
tation for Eq. (3.9). The number of terms in the sum (Eq. (3.8)) is 24 for a fourth-order 
determinant, «! for an nth-order determinant. Because of the appearance of the negative 
signs in Eq. (3.9) (and possibly in the individual elements as well), there may be consider¬ 
able cancellation. It is quite possible that a determinant of large elements will have a very 
small value. 

Several useful properties of the nth-order determinants follow from Eq. (3.8). Again, to 
be specific, Eq. (3.9) for third-order determinants is used to illustrate these properties. 


(3.7) 



Laplacian Development by Minors 

Equation (3.9) may be written 

£>3 = ai(b 2 C 3 - b 2 c 2 ) - a 2 {b\c 2 - b 2 c\) + ci 3 (b l c 2 - b 2 c\) 


b 2 

b 2 

b] 

b3 

b\ 

b 2 



- a 2 


+ 03 


c 2 

C3 

Cl 

C3 

c\ 

c 2 


In general, the nth-order determinant may be expanded as a linear combination of the 
products of the elements of any row (or any column) and the (n — l)th-order determinants 


1 In a linear sequence abed • • •, any single, simple transposition of adjacent elements yields an odd permutation of the original 
sequence: abed. —> bacd. Two such transpositions yield an even permutation. In general, an odd number of such interchanges of 
adjacent elements results in an odd permutation; an even number of such transpositions yields an even permutation. 
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formed by striking out the row and column of the original determinant in which the element 
appears. This reduced array (2x2 in this specific example) is called a minor. If the element 
is in the ith row and the /th column, the sign associated with the product is (— 1)' + / . The 
minor with this sign is called the cofactor. If Mjj is used to designate the minor formed by 
omitting the ith row and the /th column and C,y is the corresponding cofactor, Eq. (3.10) 
becomes 

3 3 

D 3 = £(-l ) i+1 ajMij = J2 a J C 'J- (3.H) 

7=1 7=1 

In this case, expanding along the first row, we have i — 1 and the summation over j, the 

columns. 

This Laplace expansion may be used to advantage in the evaluation of high-order de¬ 
terminants in which a lot of the elements are zero. For example, to find the value of the 
determinant 

0 10 0 

-10 0 0 

0 0 0 1 

0 0-10 

we expand across the top row to obtain 

-10 0 

D = (—1) 1+2 • (1) 0 0 1. (3.13) 

0-10 

Again, expanding across the top row, we get 

D — (—1) • (—1) 1+1 • (—1) _°j J = _°j J =1. (3.14) 

(This determinant D (Eq. (3.12)) is formed from one of the Dirac matrices appearing in 
Dirac’s relativistic electron theory in Section 3.4.) 

Antisymmetry 

The determinant changes sign if any two rows are interchanged or if any two columns are 
interchanged. This follows from the even-odd character of the Levi-Civita e in Eq. (3.8) 
or explicitly from the form of Eqs. (3.9) and (3.10). 2 

This property was used in Section 2.9 to develop a totally antisymmetric linear combina¬ 
tion. It is also frequently used in quantum mechanics in the construction of a many-particle 
wave function that, in accordance with the Pauli exclusion principle, will be antisymmetric 
under the interchange of any two identical spin 3 particles (electrons, protons, neutrons, 
etc.). 

-The sign reversal is reasonably obvious for the interchange of two adjacent rows (or columns), this clearly being an odd 
permutation. Show that the interchange of any two rows is still an odd permutation. 


(3.12) 
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• As a special case of antisymmetry, any determinant with two rows equal or two 
columns equal equals zero. 

• If each element in a row or each element in a column is zero, the determinant is equal 
to zero. 

• If each element in a row or each element in a column is multiplied by a constant, the 
determinant is multiplied by that constant. 

• The value of a determinant is unchanged if a multiple of one row is added (column by 
column) to another row or if a multiple of one column is added (row by row) to another 
column . 3 


We have 


fll 

ai 

«3 


a 1 + kai 

ai 

ai 

bl 

bi 

bi 

= 

b\ + kbi 

bi 

bi 

Cl 

C2 

Cl 


ci + kci 

Cl 

Cl 


Using the Laplace development on the right-hand side, we obtain 


a 1 + kai 

ai 

ai 


a\ 

ai 

ai 


ai 

02 

ai 

bi + kbi 

bi 

bi 

— 

bi 

bi 

bi 

+ k 

bi 

bi 

bi 

ci + kci 

Cl 

Cl 


c\ 

Cl 

Cl 


Cl 

Cl 

Cl 


(3.15) 


(3.16) 


then by the property of antisymmetry the second determinant on the right-hand side of 
Eq. (3.16) vanishes, verifying Eq. (3.15). 

As a special case, a determinant is equal to zero if any two rows are proportional or any 
two columns are proportional. 

Some useful relations involving determinants or matrices appear in Exercises of Sec¬ 
tions 3.2 and 3.4. 

Returning to the homogeneous Eqs. (3.1) and multiplying the determinant of the coef¬ 
ficients by X ], then adding X 2 times the second column and xj times the third column, we 
can directly establish the condition for the presence of a nontrivial solution for Eqs. (3.1): 



a 1 

ai 

ai 


a 1 x 1 

ai 

ai 


a\x\ + aiX2 + aixi 

«2 

«3 

Xl 

bi 

bi 

bl 

— 

bixi 

b 2 

bi 

— 

bixi + bixi + bixi 

bl 

bl 


Cl 

Cl 

Cl 


Cl AT 

Cl 

Cl 


Cl Aj + C2A2 + C3A3 

Cl 

Cl 


0 

ai 

ai 

0 

bi 

bi 

0 

Cl 

Cl 


(3.17) 


Therefore at (and X 2 and . 13 ) must be zero unless the determinant of the coefficients 
vanishes. Conversely (see text below Eq. (3.3)), we can show that if the determinant of the 
coefficients vanishes, a nontrivial solution does indeed exist. This is used in Section 9.6 to 
establish the linear dependence or independence of a set of functions. 


’This derives from the geometric meaning of the determinant as the volume of the parallelepiped spanned by its column vectors. 
Pulling it to the side without changing its height leaves the volume unchanged. 
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If our linear equations are inhomogeneous, that is, as in Eqs. (3.5) if the zeros on 
the right-hand side of Eqs. (3.1) are replaced by < 74 , b 4 , and C 4 , respectively, then from 
Eq. (3.17) we obtain, instead. 


04 

«2 

CI3 

b 4 

b 2 

63 

C 4 

C 2 

C 3 

a 1 

02 

«3 

b\ 

b2 

£3 

Cl 

C 2 

C 3 


which generalizes Eq. (3.6a) to n — 3 dimensions, etc. If the determinant of the coefficients 
vanishes, the inhomogeneous set of equations has no solution — unless the numerators also 
vanish. In this case solutions may exist but they are not unique (see Exercise 3.1.3 for 
a specific example). 

For numerical work, this determinant solution, Eq. (3.18), is exceedingly unwieldy. The 
determinant may involve large numbers with alternate signs, and in the subtraction of two 
large numbers the relative error may soar to a point that makes the result worthless. Also, 
although the determinant method is illustrated here with three equations and three un¬ 
knowns, we might easily have 200 equations with 200 unknowns, which, involving up to 
200! terms in each determinant, pose a challenge even to high-speed computers. There 
must be a better way. 

In fact, there are better ways. One of the best is a straightforward process often called 
Gauss elimination. To illustrate this technique, consider the following set of equations. 


Example 3.1.1 Gauss Elimination 
Solve 

3x + 2y + z = 11 

2x + 3y + z=13 (3.19) 

x + y +4z= 12 . 

The determinant of the inhomogeneous linear equations (3.19) is 18, so a solution exists. 

For convenience and for the optimum numerical accuracy, the equations are rearranged 
so that the largest coefficients run along the main diagonal (upper left to lower right). This 
has already been done in the preceding set. 

The Gauss technique is to use the first equation to eliminate the first unknown, x, from 
the remaining equations. Then the (new) second equation is used to eliminate y from the 
last equation. In general, we work down through the set of equations, and then, with one 
unknown determined, we work back up to solve for each of the other unknowns in succes¬ 
sion. 

Dividing each row by its initial coefficient, we see that Eqs. (3.19) become 

x "I - \y + 3 Z = T 
x + \y + \z = -y 
x + y +4 z= 12. 


(3.20) 
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Now, using the first equation, we eliminate .r from the second and third equations: 

x + \y+ \z = y 

b + b= l i (3-21) 

I v+ ii 7 _ 25 
3 y ^ 3 z ~ 3 

and 

a '+3)' + 3£=T 

7 + b = % (3.22) 

7 + llz = 25. 

Repeating the technique, we use the new second equation to eliminate y from the third 
equation: 

x + jy + b = t 

y + ^ = t (3-23) 

54z = 108, 


or 


z = 2. 


Finally, working back up, we get 


or 


V + i X 2 = ±2 


y = 3. 


Then with z and y determined. 


i + I x 3 + I x2 = -T-, 


and 


x = 1. 


The technique may not seem so elegant as Eq. (3.18), but it is well adapted to computers 
and is far faster than the time spent with determinants. 

This Gauss technique may be used to convert a determinant into triangular form: 


£> = 


a t 
0 
0 


b\ ci 
b >2 c 2 

0 C 3 


for a third-order determinant whose elements are not to be confused with those in Eq. (3.3). 
In this form D — a\ Incy. For an nth-order determinant the evaluation of the triangular 
form requires only n — 1 multiplications, compared with the n! required for the general 


case. 
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A variation of this progressive elimination is known as Gauss-Jordan elimination. We 
start as with the preceding Gauss elimination, but each new equation considered is used to 
eliminate a variable from all the other equations, not just those below it. If we had used 
this Gauss-Jordan elimination, Eq. (3.23) would become 

* + 5 z= 5 

y + 5Z = T ( 3 . 24 ) 

z = 2, 

using the second equation of Eqs. (3.22) to eliminate y from both the first and third equa¬ 
tions. Then the third equation of Eqs. (3.24) is used to eliminate z from the first and second, 
giving 

x =1 

y — 3 (3.25) 

z — 2 . 

We return to this Gauss-Jordan technique in Section 3.2 for inverting matrices. 

Another technique suitable for computer use is the Gauss-Seidel iteration technique. 
Each technique has its advantages and disadvantages. The Gauss and Gauss-Jordan meth¬ 
ods may have accuracy problems for large determinants. This is also a problem for ma¬ 
trix inversion (Section 3.2). The Gauss-Seidel method, as an iterative method, may have 
convergence problems. The IBM Scientific Subroutine Package (SSP) uses Gauss and 
Gauss-Jordan techniques. The Gauss-Seidel iterative method and the Gauss and Gauss- 
Jordan elimination methods are discussed in considerable detail by Ralston and Wilf and 
also by Pennington . 4 Computer codes in FORTRAN and other programming languages 
and extensive literature for the Gauss-Jordan elimination and others are also given by 
Press et al. 5 ■ 

Linear Dependence of Vectors 

Two nonzero two-dimensional vectors 

ai = («^)^°‘ ,2= te)*° 

are defined to be linearly dependent if two numbers x\, X 2 can be found that are not both 
zero so that the linear relation xi a; + *282 = 0 holds. They are linearly independent if 
x\ = 0 = X 2 is the only solution of this linear relation. Writing it in Cartesian components, 
we obtain two homogeneous linear equations 

a\\X\ + <721*2 = 0, fll2-*l + 0-22X2 — 0 

1 A. Ralston and H. Wilf, eds., Mathematical Methods for Digital Computers. New York: Wiley (1960); R. H. Pennington, 
Introductory Computer Methods and Numerical Analysis. New York: Macmillan (1970). 

5 W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, Numerical Recipes , 2nd ed. Cambridge, UK: Cambridge 
University Press (1992), Chapter 2. 
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from which we extract the following criterion for linear independence of two vectors using 
Cramer’s rule. If ai, a 2 span a nonzero area, that is, their determinant \ a a \\ “H | / 0, 
then the set of homogeneous linear equations has only the solution xi = 0 = X 2 - If 
the determinant is zero, then there is a nontrivial solution x\, xi, and our vectors are 
linearly dependent. In particular, the unit vectors in the x- and v-directions are linearly 
independent, the linear relation x\x\ + X2X2 = (^.*) = (q) having only the trivial solution 
X\ = 0 = X 2 - 

Three or more vectors in two-dimensional space are always linearly dependent. Thus, 
the maximum number of linearly independent vectors in two-dimensional space is 2. For 
example, given ai, a 2 , 83 , the linear relation A | a 1 +X 2 *i 2 +^383 = 0 always has nontrivial 
solutions. If one of the vectors is zero, linear dependence is obvious because the coefficient 
of the zero vector may be chosen to be nonzero and that of the others as zero. So we assume 
all of them as nonzero. If aj and a 2 are linearly independent, we write the linear relation 

flllVl + @ 21 X 2 — -a 31 X 3 , ( 712^1 + ( 722 X 2 = -(732X3, 

as a set of two inhomogeneous linear equations and apply Cramer’s rule. Since the determi¬ 
nant is nonzero, we can find a nontrivial solution xi, X 2 for any nonzero X 3 . This argument 
goes through for any pair of linearly independent vectors. If all pairs are linearly depen¬ 
dent, any of these linear relations is a linear relation among the three vectors, and we are 
finished. If there are more than three vectors, we pick any three of them and apply the fore¬ 
going reasoning and put the coefficients of the other vectors, xj — 0 , in the linear relation. 

• Mutually orthogonal vectors are linearly independent. 

Assume a linear relation YL, CiXi = 0. Dotting v ; into this using Xj ■ v,- = 0 for j Y- i, we 
obtain cjXj ■ \j — 0 , so every cj — 0 because v^ ^ 0 . 

It is straightforward to extend these theorems to n or more vectors in n -dimensional 
Euclidean space. Thus, the maximum number of linearly independent vectors in 
n -dimensional space is n. The coordinate unit vectors are linearly independent be¬ 
cause they span a nonzero parallelepiped in n -dimensional space and their determinant 
is unity. 


Gram-Schmidt Procedure 


In an n-dimensional vector space with an inner (or scalar) product, we can always construct 
an orthonormal basis of n vectors w, with w, -Wj = 8jj starting from n linearly independent 


vectors v,, i = 0,1,.. *, n — 1. 

We start by normalizing vo to unity, defining wo = —Then we project vo from vi, 

^vir 

forming ui = Vi + fliowo, with the admixture coefficient «io chosen so that vo • ui = 0. 
Dotting vo into ui yields a\o — —ISAl = _ Vl . w (l . Again, we normalize ui defining wi = 

V v o 

-j=. Here, uj ^ 0 because vq, vj are linearly independent. This first step generalizes to 


U; = Xj + djOXVO + djlXVl H- djj-lWj-l, 

with coefficients a,-,- = —v; • w,-. Normalizing w; = -'j- completes our construction. 
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It will be noticed that although this Gram-Schmidt procedure is one possible way of 
constructing an orthogonal or orthonormal set, the vectors w, are not unique. There is an 
infinite number of possible orthonormal sets. 

As an illustration of the freedom involved, consider two (nonparallel) vectors A and B 
in the xv-plane. We may normalize A to unit magnitude and then form B' = a A + B so 
that B' is perpendicular to A. By normalizing B' we have completed the Gram-Schmidt 
orthogonalization for two vectors. But any two perpendicular unit vectors, such as x and y, 
could have been chosen as our orthonormal set. Again, with an infinite number of possible 
rotations of x and y about the --axis, we have an infinite number of possible orthonormal 
sets. 


Example 3.1.2 Vectors by Gram-Schmidt Orthogonalization 


To illustrate the method, we consider two vectors 

1 


vo 


V] = 


which are neither orthogonal nor normalized. Normalizing the first vector wo = vo/x/2, 
we then construct m = Vi + flioWo so as to be orthogonal to Vo. This yields 

010 9 l~ 

ui • vo = 0 = vi • vo + — -1 + flioV2, 

v 2 

so the adjustable admixture coefficient a\o — 1 /As a result, 

-OKO-IW' 

so the second orthonormal vector becomes 

We check that wo • wi = 0. The two vectors wo, wi form an orthonormal set of vectors, 
a basis of two-dimensional Euclidean space. ■ 


Exercises 

3.1.1 Evaluate the following determinants: 



1 

0 

1 


1 

2 

0 

(a) 

0 

1 

0 

(b) 

3 

1 

2 


1 

0 

0 


0 

3 

1 


3.1.2 


(c, i 


0 V3 
V3 0 
0 2 
0 


Test the set of linear homogeneous equations 

x + 3y + 3z = 0, x — y + z = 0, 


0 V3 


0 V3 0 

2x + y + 3z = 0 


to see if it possesses a nontrivial solution, and find one. 



3.1 Determinants 


175 


3.1.3 Given the pair of equations 

x+2y = 3, 2x + 4y = 6, 

(a) Show that the determinant of the coefficients vanishes. 

(b) Show that the numerator determinants (Eq. (3.18)) also vanish. 

(c) Find at least two solutions. 

3.1.4 Express the components of A x B as 2 x 2 determinants. Then show that the dot product 
A-(A x B) yields a Laplacian expansion of a 3 x 3 determinant. Finally, note that two 
rows of the 3x3 determinant are identical and hence that A • (A x B) = 0. 

3.1.5 If Cjj is the cofactor of element a, / (formed by striking out the ;th row and jth column 
and including a sign (— 1 )' _l_ - / ), show that 

(a) JT ajjCjj = cijjC/i — |A|, where |A| is the determinant with the elements cijj, 

(b) «/.jCa — J 2 i a jiCki — 0 ,j^k. 

3.1.6 A determinant with all elements of order unity may be surprisingly small. The Hilbert 

determinant //,•/ = (i + j — 1) , j — 1 , 2 ,..., n is notorious for its small values. 

(a) Calculate the value of the Hilbert determinants of order n for n — 1,2, and 3. 

(b) If an appropriate subroutine is available, find the Hilbert determinants of order n 
for n — 4, 5, and 6 . 

ANS. n Det (H n ) 

T“ T 

2 8.33333 x 10 “ 2 

3 4.62963 x 10 “ 4 

4 1.65344 x 10 “ 7 

5 3.74930 x 10 “ 12 

6 5.36730 x 10 “ 18 

3.1.7 Solve the following set of linear simultaneous equations. Give the results to five decimal 
places. 

1 . 0 .ri + 0 . 9 x 2 + 0 . 8 x 3 + 0 . 4 x 4 + 0 . 1 x 5 = 1.0 

0.9xi + 1 - 0 x 2 + 0 . 8 x 3 + 0 . 5 x 4 + 0 . 2 x 5 + 0.1x6 = 0.9 

0.8xi + 0 . 8 x 2 + 1 - 0 x 3 + 0 . 7 x 4 + 0 . 4 x 5 + 0.2x6 = 0.8 

0.4xi + 0 . 5 x 2 + 0 . 7 x 3 + 1. 0 x 4 + 0 . 6 x 5 + 0.3x6 = 0.7 

O.lxi + 0 . 2 x 2 + 0 . 4 x 3 + 0 . 6 x 4 + 1 - 0 x 5 + 0.5x6 = 0.6 

0.1x2 + 0 . 2 x 3 + 0.3x4 + 0.5x5 + 1.0x6 = 0.5. 

Note. These equations may also be solved by matrix inversion. Section 3.2. 
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3.1.8 Solve the linear equations a • x = c, axx + b = 0forx = (x i. x 2 , X 3 ) with constant 
vectors a ^ 0 , b and constant c. 

ANS. x = ^a + (a x b )/a 2 . 

3.1.9 Solve the linear equations a - x = d, b • x = e, c-x = /, for x = (x 1 , x 2 , X 3 ) with constant 
vectors a, b, c and constants d, e, f such that (axblc/ 0 . 

ANS. [(a x b) • c]x = d(b x c) + e(c x a) + /(a x b). 

3.1.10 Express in vector form the solution (x\ , x-i, X 3 ) of a.t'i + b.t '2 + CX 3 + d = 0 with constant 
vectors a, b, c, d so that (axb)c/0. 

3.2 Matrices 

Matrix analysis belongs to linear algebra because matrices are linear operators or maps 
such as rotations. Suppose, for instance, we rotate the Cartesian coordinates of a two- 
dimensional space, as in Section 1.2, so that, in vector notation, 

x 1 cos ^ + x 2 sin \ _ (12 j a ij x j \ (396) 

\x ' 2 ) \ — a '2 sin (p + X 2 cos (p ) V I] / a 2 jXj ) ’ 

We label the array of elements («*] all) a 2 x 2 matrix A consisting of two rows and two 
columns and consider the vectors x, x’ as 2 x 1 matrices. We take the summation of 
products in Eq. (3.26) as a definition of matrix multiplication involving the scalar 
product of each row vector of A with the column vector x. Thus, in matrix notation 
Eq. (3.26) becomes 

x’ = Ax. (3.27) 

To extend this definition of multiplication of a matrix times a column vector to the prod¬ 
uct of two 2 x 2 matrices, let the coordinate rotation be followed by a second rotation given 
by matrix B such that 

x" = Ex’. (3.28) 

In component form, 

x” = Y,bjjx'j = ’Y^b i j ^2ajkXk = Ti y^bjjUjk JXk. (3.29) 

j j k k ^ j ' 

The summation over j is matrix multiplication defining a matrix C = BA such that 

x-' = J2 c ik x k, (3.30) 

k 

or x" = C.r in matrix notation. Again, this definition involves the scalar products of row 
vectors of B with column vectors of A. This definition of matrix multiplication generalizes 
to m x n matrices and is found useful; indeed, this usefulness is the justification for its 
existence. The geometrical interpretation is that the matrix product of the two matrices BA 
is the rotation that carries the unprimed system directly into the double-primed coordinate 
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system. Before passing to formal definitions, the your should note that operator A is de¬ 
scribed by its effect on the coordinates or basis vectors. The matrix elements a\j constitute 
a representation of the operator, a representation that depends on the choice of a basis. 

The special case where a matrix has one column and n rows is called a column vector, 
|x), with components x,, i = 1,2,If A is an n x n matrix, \x) an n-component 
column vector, A \x) is defined as in Eqs. (3.27) and (3.26). Similarly, if a matrix has one 
row and n columns, it is called a row vector, (x with components x,-, i = 1,2 
Clearly, (x| results from |x) by interchanging rows and columns, a matrix operation called 
transposition, and transposition for any matrix A, A is called 6 “A transpose” with matrix 
elements (A),-^ = A^. Transposing a product of matrices AB reverses the order and gives 
BA; similarly A|x) transpose is (x|A. The scalar product takes the form (x|_y) = JT x,-y,- 
(x* in a complex vector space). This Dirac bra-ket notation is used in quantum mechanics 
extensively and in Chapter 10 and here subsequently. 

More abstractly, we can define the dual space V of linear functionals F on a vector 
space V, where each linear functional F of V assigns a number F(\) so that 

F (ci v i + C 2 V 2 ) = ci F(vi) + C 2 F(y 2 ) 

for any vectors vi, V 2 from our vector space V and numbers ci, C 2 . If we define the sum 
of two functionals by linearity as 

(Fi + F 2 )(v) = Fi(y) + F 2 (v), 
then V is a linear space by construction. 

Riesz’ theorem says that there is a one-to-one correspondence between linear function¬ 
als F in V and vectors f in a vector space V that has an inner (or scalar) product (f|v) 
defined for any pair of vectors f, v. 

The proof relies on the scalar product by defining a linear functional F for any vector f 
of V as F(\) — (f|v) for any v of V. The linearity of the scalar product in f shows that these 
functionals form a vector space (contained in V necessarily). Note that a linear functional 
is completely specified when it is defined for every vector v of a given vector space. 

On the other hand, starting from any nontrivial linear functional F of V we now con¬ 
struct a unique vector f of V so that F(y) — f • v is given by an inner product. We start 
from an orthonormal basis w; of vectors in V using the Gram-Schmidt procedure (see 
Section 3.2). Take any vector v from V and expand it as v = w / ' vvv, . Then the 
linear functional F(\) = JT w; • vF(w,-) is well defined on V. If we define the spe¬ 
cific vector f = F(\Vi)\Vi, then its inner product with an arbitrary vector v is given 
by (f|v) = f • v = JT F (w/)w,- • v = F(v), which proves Riesz’ theorem. 

Basic Definitions 

A matrix is defined as a square or rectangular array of numbers or functions that obeys 
certain laws. This is a perfectly logical extension of familiar mathematical concepts. In 
arithmetic we deal with single numbers. In the theory of complex variables (Chapter 6) we 
deal with ordered pairs of numbers, (1,2) = 1 + 2i, in which the ordering is important. We 


6 Some texts (including ours sometimes) denote A transpose by A 1 . 
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now consider numbers (or functions) ordered in a square or rectangular array. For conve¬ 
nience in later work the numbers are distinguished by two subscripts, the first indicating 
the row (horizontal) and the second indicating the column (vertical) in which the number 
appears. For instance, a \3 is the matrix element in the first row, third column. Hence, if A 
is a matrix with m rows and n columns. 


( flu 

«12 ' ' 

U\ n ^ 


fl21 

fl22 • • 

' &2n 

(3.31) 

\ ^ml 

Am2 

* &mn ) 



Perhaps the most important fact to note is that the elements cijj are not combined with 
one another. A matrix is not a determinant. It is an ordered array of numbers, not a single 
number. 

The matrix A, so far just an array of numbers, has the properties we assign to it. Literally, 
this means constructing a new form of mathematics. We define that matrices A, B, and C, 
with elements aij , bij, and r,y, respectively, combine according to the following rules. 

Rank 

Looking back at the homogeneous linear Eqs. (3.1), we note that the matrix of coefficients, 
A, is made up of three row vectors that each represent one linear equation of the set. If 
their triple scalar product is not zero, than they span a nonzero volume and are linearly 
independent, and the homogeneous linear equations have only the trivial solution. In this 
case the matrix is said to have rank 3. In n dimensions the volume represented by the 
triple scalar product becomes the determinant, det(A), for a square matrix. If det(A) / 0, 
the n x n matrix A has rank n. The case of Eqs. (3.1), where the vector c lies in the plane 
spanned by a and b, corresponds to rank 2 of the matrix of coefficients, because only two 
of its row vectors (a, b corresponding to two equations) are independent. In general, the 
rank r of a matrix is the maximal number of linearly independent row or column 
vectors it has, with 0 < r < n. 

Equality 

Matrix A = Matrix B if and only if a,j — bjj for all values of i and j . This, of course, 
requires that A and B each be m x n arrays (m rows, n columns). 

Addition, Subtraction 

A ± B = C if and only if cijj ± bij = Cjj for all values of i and j , the elements combining 
according to the laws of ordinary algebra (or arithmetic if they are simple numbers). This 
means that A + B = B + A, commutation. Also, an associative law is satisfied (A + B) + 
C = A + (B + C). If all elements are zero, the matrix, called the null matrix, is denoted 
by O. For all A, 


A + 0 = 0 + A = A, 
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with 

(3.32) 


Such m x n matrices form a linear space with respect to addition and subtraction. 

Multiplication (by a Scalar) 

The multiplication of matrix A by the scalar quantity a is defined as 

a A = (aA), (3.33) 

in which the elements of a A are acijj ; that is, each element of matrix A is multiplied by the 
scalar factor. This is in striking contrast to the behavior of determinants in which the factor 
a multiplies only one column or one row and not every element of the entire determinant. 
A consequence of this scalar multiplication is that 

aA = Ao\ commutation. 

If A is a square matrix, then 

det(aA) = a" det(A). 

Matrix Multiplication, Inner Product 


o 

II 

CD 

< 

if and only if 7 

c ij — ^ ' ttikbkj • 

(3.34) 



k 



The i j element of C is formed as a scalar product of the /th row of A with the / th column 
of B (which demands that A have the same number of columns (n) as B has rows). The 
dummy index k takes on all values 1, 2 ,..., n in succession; that is, 

cij = anbij + anb2j + anbij (3.35) 

for n i = 3. Obviously, the dummy index k may be replaced by any other symbol that is 
not already in use without altering Eq. (3.34). Perhaps the situation may be clarified by 
stating that Eq. (3.34) defines the method of combining certain matrices. This method of 
combination, to give it a label, is called matrix multiplication. To illustrate, consider two 
(so-called Pauli) matrices 

= (j and a 3 = ^ (3.36) 

7 Some authors follow the summation convention here (compare Section 2.6). 


/0 0 0 
0 0 0 
0 0 0 

v • • 
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The 11 element of the product, (< 7103)11 is given by the sum of the products of elements of 
the first row of 01 with the corresponding elements of the first column of 03 : 


Continuing, we have 



0 - 1 + 1 - 0 = 0 . 


/0-1 + 1-0 0-0+ 1 • (-1)\ _ fO -1\ 

V1 -1 + 0-0 1 o+o- (-i)J - Vi 0 )' 


Here 


(3.37) 


On a$)ij =oi n o 3iy +oi i2 03 2j .. 

Direct application of the definition of matrix multiplication shows that 



and by Eq. (3.37) 


0301 = — 0103. 

Except in special cases, matrix multiplication is not commutative : 8 


(3.38) 

(3.39) 


AB ^ BA. 


(3.40) 


However, from the definition of matrix multiplication we can show 9 that an associative law 
holds, (AB)C = A(BC). There is also a distributive law, A(B + C) = AB + AC. 

The unit matrix 1 has elements 5,y, Kronecker delta, and the property that 1A = A1 = A 
for all A, 


1 = 


/l 0 0 0 • • \ 

0 1 0 0 • • • 

0 0 1 0 • ■ • 

0 0 0 1 • ■ • 

v./ 


(3.41) 


It should be noted that it is possible for the product of two matrices to be the null matrix 
without either one being the null matrix. For example, if 


A = 


1 1 
0 0 


and 




AB = O. This differs from the multiplication of real or complex numbers, which form 
a field, whereas the additive and multiplicative structure of matrices is called a ring by 
mathematicians. See also Exercise 3.2.6(a), from which it is evident that, if AB = 0, at 


^Commutation or the lack of it is conveniently described by the commutator bracket symbol. [A. B] = AB — BA. Equation (3.40) 
becomes [A. B] / 0. 

Note that the basic definitions of equality, addition, and multiplication are given in terms of the matrix elements, the a/j. All our 
matrix operations can be carried out in terms of the matrix elements. However, we can also treat a matrix as a single algebraic 
operator, as in Eq. (3.40). Matrix elements and single operators each have their advantages, as will be seen in the following 
section. We shall use both approaches. 
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least one of the matrices must have a zero determinant (that is, be singular as defined after 
Eq. (3.50) in this section). 

If A is an n x n matrix with determinant |A| ^ 0, then it has a unique inverse A -1 
satisfying AA ~~ 1 = A -1 A = 1. If B is also an n x n matrix with inverse B 1 , then the 
product AB has the inverse 

(AB ) -1 = B - 1 A -1 (3.42) 

because ABB -1 A -1 = 1 = B -1 A -1 AB (see also Exercises 3.2.31 and 3.2.32). 

The product theorem, which says that the determinant of the product, |AB|, of two n x n 
matrices A and B is equal to the product of the determinants, | A| | B|, links matrices with de¬ 
terminants. To prove this, consider the n column vectors c* = (J] ■ a/jb jk, i = 1,2,..., n) 
of the product matrix C = AB for k = 1,2,..., n. Each c a- = ^2j k bj k k&j k is a sum of n 
column vectors a j k = (ciij k , i — 1,2 ,...,«). Note that we are now using a different prod¬ 
uct summation index jk for each column cSince any determinant /)(7?iai + = 

b\D(a\) + foi/Aai) is linear in its column vectors, we can pull out the summation sign in 
front of the determinant from each column vector in C together with the common column 
factor bj k k so that 

l C l = J2 b h' b hi •'' b M’i det(a ;i a h ,..., a ; „). (3.43) 

i'k s 

If we rearrange the column vectors a j k of the determinant factor in Eq. (3.43) in the proper 
order, then we can pull the common factor det(ai, a 2 .a„) = |A| in front of the n sum¬ 

mation signs in Eq. (3.43). These column permutations generate just the right sign £j t j 2 --j n 
to produce in Eq. (3.43) the expression in Eq. (3.8) for |B| so 

|C| = |A| J2 s hj2-jn b hi b j22---bj nn = |A||B 1 , (3.44) 

Jk s 

which proves the product theorem. 


Direct Product 

A second procedure for multiplying matrices, known as the direct tensor or Kronecker 
product, follows. If A is an m x in matrix and B is an n x n matrix, then the direct product 
is 


A <g> B = C. (3.45) 

C is an mn x ran matrix with elements 

Cap — AijBki, (3.46) 


with 


a — m(i — 1) + k, /3 = n(j — 1) + /. 
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For instance, if A and B are both 2x2 matrices, 

A ® B — “ ,2 r) 

\«2iB a 2 2D J 


f ci\\bn 

a\\b\ 2 

a\ 2 b\ i 

a\ 2 b\ 2 ^ 

a\\b 2 i 

anb 22 

a\ 2 b 2 \ 

012^22 

a 2 \bn 

a 2 \bi 2 

a 22 b\\ 

fl22^12 

\a 2 \b 2 i 

a 2 \b 22 

a 22 b 2 \ 

a 22 b 22 y 


The direct product is associative but not commutative. As an example of the direct prod¬ 
uct, the Dirac matrices of Section 3.4 may be developed as direct products of the Pauli 
matrices and the unit matrix. Other examples appear in the construction of groups (see 
Chapter 4) and in vector or Hilbert space in quantum theory. 


Example 3.2.1 Direct Product of Vectors 


The direct product of two two-dimensional vectors is a four-component vector. 



while the direct product of three such vectors. 


( xoyo^ 

-t'O.Vl 

xiyo 

\xiyij 


( XQ 
\X\ 


<E> 




^ xoyozo^ 
•*oyozi 
-Toy t^o 

Toyizi 

Tiyozo 

Tiyozt 

Tiytzo 

\Tiytzi 


is a (2 3 = 8 )-dimensional vector. 


Diagonal Matrices 

An important special type of matrix is the square matrix in which all the nondiagonal 
elements are zero. Specifically, if a 3 x 3 matrix A is diagonal, then 

(an 0 0 \ 

A = I 0 022 0 I . 

\ 0 0 033 / 

A physical interpretation of such diagonal matrices and the method of reducing matrices to 
this diagonal form are considered in Section 3.5. Here we simply note a significant property 
of diagonal matrices — multiplication of diagonal matrices is commutative, 

AB = BA, if A and B are each diagonal. 
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Multiplication by a diagonal matrix [di, tfe,..., d n ] that has only nonzero elements in the 
diagonal is particularly simple: 


1 0 
0 2 


1 2 
3 4 


1 2 
2-3 2-4 


1 2 
6 8 


while the opposite order gives 

1 2\/l 0\_/T 2-2\ 

3 4j{o 2J-V3 2- 4 ) 



Thus, a diagonal matrix does not commute with another matrix unless both are diag¬ 
onal, or the diagonal matrix is proportional to the unit matrix. This is borne out by the 

more general form 



(d 1 0 

■ ■■ o\ 

a\2 


[d\,d2, d„] A = 

0 d2 

... 0 

«21 «22 

^2 n 


v 0 0 

* ■ * d n J 

\ 1 &n2 

' ' ' ttyin / 


/ d\a\ 1 d[Cii2 

d\Cl\ n ^ 


— 

d2Cl2\ 

d2Cl22 

diain 



\dn&n\ 

dn&n2 

dn^nn J 



whereas 



^flll (712 ••• 

®\n ^ 

/di 0 ■■ 

• 0 \ 

A[r/i, d2, ■. ., d, ,] = 

«2I «22 • • • 

^2 n 

0 d2 • • 

• 0 


\ (hi 1 @112 

ttnn J 

v 0 0 •• 

dn J 


/ d\an dia\2 

d 

n^bi \ 


_ 

d\U2\ dia22 

d 

n^2n I 



y^d^&nX * * * dfi& nil / 

Here we have denoted by [r/ 1 ,..., d„] a diagonal matrix with diagonal elements d\,... ,d n . 
In the special case of multiplying two diagonal matrices, we simply multiply the corre¬ 
sponding diagonal matrix elements, which obviously is commutative. 


Trace 

In any square matrix the sum of the diagonal elements is called the trace. 
Clearly the trace is a linear operation: 

trace(A — B) = trace(A) — trace! B). 
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One of its interesting and useful properties is that the trace of a product of two matrices A 
and B is independent of the order of multiplication: 

trace(AB) = ^(AB),, = 'Y^^a i jbji 
i i j 

= EEv.7=E (B % 

j > j 

— trace(BA). 

This holds even though AB / BA. Equation (3.48) means that the trace of any commutator 
[A, B] = AB — BA is zero. From Eq. (3.48) we obtain 

trace(ABC) = trace(BCA) = trace(CAB), 

which shows that the trace is invariant under cyclic permutation of the matrices in a prod¬ 
uct. 

For a real symmetric or a complex Hermitian matrix (see Section 3.4) the trace is the 
sum, and the determinant the product, of its eigenvalues, and both are coefficients of the 
characteristic polynomial. In Exercise 3.4.23 the operation of taking the trace selects one 
term out of a sum of 16 terms. The trace will serve a similar function relative to matrices 
as orthogonality serves for vectors and functions. 

In terms of tensors (Section 2.7) the trace is a contraction and, like the contracted second- 
rank tensor, is a scalar (invariant). 

Matrices are used extensively to represent the elements of groups (compare Exer¬ 
cise 3.2.7 and Chapter 4). The trace of the matrix representing the group element is known 
in group theory as the character. The reason for the special name and special attention 
is that, the trace or character remains invariant under similarity transformations (compare 
Exercise 3.3.9). 


Matrix Inversion 


At the beginning of this section matrix A is introduced as the representation of an operator 
that (linearly) transforms the coordinate axes. A rotation would be one example of such 
a linear transformation. Now we look for the inverse transformation A -1 that will restore 
the original coordinate axes. This means, as either a matrix or an operator equation, 10 

AA^'^A-'A^l. (3.49) 

With (A _1 ) I; - = a\j^, 


-t) _ 

J ~ |A| ’ 


(3.50) 


10 Here and throughout this chapter our matrices have finite rank. If A is an infinite-rank matrix (n xn with n —> oo), then life is 
more difficult. For A -1 to be the inverse we must demand that both 

AA -1 = 1 and A _1 A=1. 


one relation no longer implies the other. 
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with Cjj the cofactor (see discussion preceding Eq. (3.11)) of ajj and the assumption that 
the determinant of A, |A| ^ 0. If it is zero, we label A singular. No inverse exists. 

There is a wide variety of alternative techniques. One of the best and most commonly 
used is the Gauss-Jordan matrix inversion technique. The theory is based on the results of 
Exercises 3.2.34 and 3.2.35, which show that there exist matrices Mr such that the product 
Mi A will be A but with 


a. one row multiplied by a constant, or 

b. one row replaced by the original row minus a multiple of another row, or 

c. rows interchanged. 


Other matrices Mr operating on the right (AM r) can carry out the same operations on 
the columns of A. 

This means that the matrix rows and columns may be altered (by matrix multiplication) 
as though we were dealing with determinants, so we can apply the Gauss-Jordan elimina¬ 
tion techniques of Section 3.1 to the matrix elements. Hence there exists a matrix M/ (or 
Mr) such that 11 

MrA=1. (3.51) 

Then Mr = A -1 . We determine Mr by carrying out the identical elimination operations on 
the unit matrix. Then 

Mr1 = Mr. (3.52) 

To clarify this, we consider a specific example. 


Example 3.2.2 Gauss-Jordan matrix inversion 


We want to invert the matrix 


A = 



(3.53) 


For convenience we write A and 1 side by side and carry out the identical operations on 
each: 



and 

To be systematic, we multiply each row to get arj = 1, 

h n 



(3.54) 


/l I 

1 I 


and 


\1 1 4 / 


0 

VO 


0 \ 

0 

1 / 


(3.55) 


11 Remember that det(A) ^ 0. 
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As with the Gauss-Jordan solution of simultaneous linear algebraic equations, this tech¬ 
nique is well adapted to computers. Indeed, this Gauss-Jordan matrix inversion technique 
will probably be available in the program library as a subroutine (see Sections 2.3 and 2.4 
of Press et al. , loc. cit.). 

For matrices of special form, the inverse matrix can be given in closed form. For 

example, for 

( a b c\ 

b d b , (3.59) 

c b e J 


the inverse matrix has a similar but slightly more general form, 

/ » Pi y \ 

A -1 = I Pi 8 P 2 I , (3.60) 

\ Y h £ / 

with matrix elements given by 

Da—ed — b 2 , Dy — —(cd — b 2 ), DP\=(c — e)b , DP 2 — (c — a)b, 

DS — ae — c 2 , De—ad — b 2 , D = b 2 (2c — a — e) + d(ae — c 2 ), 

where D = det(A) is the determinant of the matrix A. If e = a in A, then the inverse matrix 
A“* also simplifies to 


= ^ 2 . 


€ = a, 


D — (a 2 — c 2 )d + 2(c - a)b 2 . 
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As a check, let us work out the 11-matrix element of the product A A 1 = 1. We find 
aa + bf i + cy = — [a(ed — b 2 ) + b 2 (c — e) — c(cd — /? 2 )] 

= — ( — fl £> 2 + aec/ + 2 b 2 c — i> 2 e — c 2 cf) = — = 1 . 

Similarly we check that the 12-matrix element vanishes, 

fl/Si + bS + eft 2 = — [a£>(c — e) + b(ae — c 2 ) + cb(c — a)] = 0, 

and so on. 

Note though that we cannot always find an inverse of A -1 by solving for the matrix 
elements a, b, ... of A, because not every inverse matrix A -1 of the form in Eq. (3.60) has 
a corresponding A of the special form in Eq. (3.59), as Example 3.2.2 clearly shows. 

Matrices are square or rectangular arrays of numbers that define linear transformations, 
such as rotations of a coordinate system. A? such, they are linear operators. Square matri¬ 
ces may be inverted when their determinant is nonzero. When a matrix defines a system of 
linear equations, the inverse matrix solves it. Matrices with the same number of rows and 
columns may be added and subtracted. They form what mathematicians call a ring with 
a unit and a zero matrix. Matrices are also useful for representing group operations and 
operators in Hilbert spaces. 


Exercises 

3.2.1 Show that matrix multiplication is associative, (AB)C = A(BC). 

3.2.2 Show that 

(A + B)(A-B) = A 2 -B 2 
if and only if A and B commute, 

[A, B] = 0. 

3.2.3 Show that matrix A is a linear operator by showing that 

A(ciri + c 2 r 2 ) = ci Ari + c 2 Ar 2 . 

It can be shown that an n x n matrix is the most general linear operator in an n- 
dimensional vector space. This means that every linear operator in this n -dimensional 
vector space is equivalent to a matrix. 

3.2.4 (a) Complex numbers, a + ib, with a and h real, may be represented by (or are iso¬ 

morphic with) 2 x 2 matrices: 

a + ib • o- 

Show that this matrix representation is valid for (i) addition and (ii) multiplication, 
(b) Find the matrix corresponding to (a + ib )~ 1 . 




188 Chapter 3 Determinants and Matrices 


3.2.5 If A is an n x n matrix, show that 

det(—A) = (—1)" detA. 

3.2.6 (a) The matrix equation A 2 = 0 does not imply A = 0. Show that the most general 

2x2 matrix whose square is zero may be written as 

ab b 2 \ 

— a 2 —abJ' 

where a and b are real or complex numbers. 

(b) If C = A + B, in general 

detC / detA + detB. 

Construct a specific numerical example to illustrate this inequality. 

3.2.7 Given the three matrices 



find all possible products of A, B, and C, two at a time, including squares. Express your 
answers in terms of A, B, and C, and 1, the unit matrix. These three matrices, together 
with the unit matrix, form a representation of a mathematical group, the vierergruppe 
(see Chapter 4). 

3.2.8 Given 



show that 

K" = KKK••■(« factors) = 1 
(with the proper choice of n, n ^ 0). 

3.2.9 Verify the Jacobi identity, 

[A, [B, C]] = [B, [A, C]] — [C, [A, B]]. 

This is useful in matrix descriptions of elementary particles (see Eq. (4.16)). As a 
mnemonic aid, the you might note that the Jacobi identity has the same form as the 
BAC-CAB rule of Section 1.5. 

3.2.10 Show that the matrices 

/0 1 0\ /0 0 0\ 

A =I 0 0 0 , B= 0 0 1, 

\0 0 0/ \0 0 0/ 

satisfy the commutation relations 

[A, B] = C, [A, C] = 0, and [B.C] = 0. 
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3.2.11 Let 


( 0 

1 

0 

°\ 



(0 

0 

0 

-i\ 

-1 

0 

0 

0 



0 

0 

-1 

0 

0 

0 

0 

1 

’ 

j 

0 

1 

0 

0 

V 0 

0 

-1 

V 



V 

0 

0 

0 / 




(0 

0 

1 

°\ 







0 

0 

0 

1 






k = 

1 

0 

0 

0 







^0 

-1 

0 

V 





Show that 

(a) r — j 2 — k 2 = — 1 , where 1 is the unit matrix. 

(b) ij = -ji = k, 
jk = — kj = i, 
ki = -ik = j. 


These three matrices (i, j, and k) plus the unit matrix 1 form a basis for quaternions. 
An alternate basis is provided by the four 2x2 matrices, io\, i cr 2 , — ia 3 , and 1, where 
the a are the Pauli spin matrices of Exercise 3.2.13. 

3.2.12 A matrix with elements a;j — 0 for j < i may be called upper right triangular. The 
elements in the lower left (below and to the left of the main diagonal) vanish. Examples 
are the matrices in Chapters 12 and 13, Exercise 13.1.21, relating power series and 
eigenfunction expansions. 

Show that the product of two upper right triangular matrices is an upper right triangular 
matrix. 


3.2.13 


The three Pauli spin matrices are 



Show that 


and 



(a) (ct ,) 2 = 1 2 , 

(b) a j (Tf, — ia /, (j, k, /) = (1,2, 3), (2, 3, 1), (3,1,2) (cyclic permutation), 

(c) ajOj + OjOi = 28jj 1 2 ; 1 2 is the 2 x 2 unit matrix. 


These matrices were used by Pauli in the nonrelativistic theory of electron spin. 
3.2.14 Using the Pauli 07 of Exercise 3.2.13, show that 

(cr • a)(o • b) = a • b 1 2 + ia ■ (a x b). 


Here 


a = xcr \ + ycr 2 + £ 03 , 

a and b are ordinary vectors, and 1 2 is the 2 x 2 unit matrix. 
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3.2.15 One description of spin 1 particles uses the matrices 


, /O 1 0 \ . /0 -i 0 

Mr = 1 0 1 r My = r 0 

V2 \ 0 1 0 / V2 \ 0 / 0 


1 0 °\ 

M- = 0 0 0 . 

Vo 0 -l) 

Show that 

(a) [M v , M-y] = /M-, and so on 12 (cyclic permutation of indices). Using the Levi- 
Civita symbol of Section 2.9, we may write 


[M p , IVU = is 


pqr ■ 


(b) M 2 = M 2 + M 2 + M 2 = 2 I 3 , where I 3 is the 3 x 3 unit matrix. 

(c) [M 2 , M,] = 0, 

[Mj, L + ] = L + , 

[L+,L“] = 2M., 

where 

L + = M.y + iMy, 

L“ = M, - iM v . 


3.2.16 Repeat Exercise 3.2.15 using an alternate representation, 


/ 0 0 0 
M a = 0 0 —i 

\0 i 0 


0 0 i 

0 0 0 
-i 0 0 


\0 0 0 / 

In Chapter 4 these matrices appear as the generators of the rotation group. 

3.2.17 Show that the matrix-vector equation 

(m.v + 13 12)^° 

reproduces Maxwell’s equations in vacuum. Here ijr is a column vector with compo¬ 
nents Tp-j = Bj — iEj/c,j — x,y,z. M is a vector whose elements are the angular 
momentum matrices of Exercise 3.2.16. Note that eoMo = 1/c 2 , I 3 is the 3x3 unit 


[A. B] = AB - BA. 
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3.2.18 


3.2.19 


3.2.20 


From Exercise 3.2.15(b), 


M 2 i/s = 2i jr. 


A comparison with the Dirac relativistic electron equation suggests that the “particle” 
of electromagnetic radiation, the photon, has zero rest mass and a spin of 1 (in units 
of h ). 


Repeat Exercise 3.2.15, using the matrices for a spin of 3/2, 



( 0 

V3 

0 

0 ^ 


( 0 

-V3 

0 

0 \ 

M v = - 
2 

V3 

0 

0 

2 

2 

0 

0 

V3 

. M, = i 

V3 

0 

0 

2 

-2 

0 

0 

—>/3 


V o 

0 

V3 

0 ) 


V o 

0 

V3 

0 / 



/ 3 

0 

0 

0 \ 

1 

0 

1 

0 

0 

2 

0 

0 

-1 

0 


\° 

0 

0 

— 3 / 


An operator P commutes with J x and J v , the x and y components of an angular momen¬ 
tum operator. Show that P commutes with the third component of angular momentum, 
that is, that 


[P,J z ]=0. 


Hint. The angular momentum components must satisfy the commutation relation of 
Exercise 3.2.15(a). 


The L + and L _ matrices of Exercise 3.2.15 are ladder operators (see Chapter 4): L + 
operating on a system of spin projection m will raise the spin projection to m + 1 if m is 
below its maximum. L + operating on m max yields zero. L“ reduces the spin projection 
in unit steps in a similar fashion. Dividing by ~Jl, we have 

/0 1 0 \ /0 0 0 \ 

L+ = 0 0 1 , L“ = 1 0 0 . 

\0 0 0 / \0 1 0 / 

Show that 

L + | — 1) = |0), L _ | —1) = null column vector, 

L+|0> = |1>, L - |0> = |—1), 

L + |l) = null column vector, L _ |l) = |0), 


where 




and 


| 1 > = 


represent states of spin projection —1,0, and 1, respectively. 

Note. Differential operator analogs of these ladder operators appear in Exercise 12.6.7. 
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3.2.21 Vectors A and B are related by the tensor T, 

B = TA. 

Given A and B, show that there is no unique solution for the components of T. This is 
why vector division B/A is undefined (apart from the special case of A and B parallel 
and T then a scalar). 

3.2.22 We might ask for a vector A -1 , an inverse of a given vector A in the sense that 

A • A -1 = A -1 A = 1. 

Show that this relation does not suffice to define A -1 uniquely; A would then have an 
infinite number of inverses. 

3.2.23 If A is a diagonal matrix, with all diagonal elements different, and A and B commute, 
show that B is diagonal. 

3.2.24 If A and B are diagonal, show that A and B commute. 

3.2.25 Show that trace(ABC) = trace(CBA) if any two of the three matrices commute. 

3.2.26 Angular momentum matrices satisfy a commutation relation 

[M/, Mfc] = /M/, j,kj cyclic. 

Show that the trace of each angular momentum matrix vanishes. 

3.2.27 (a) The operator trace replaces a matrix A by its trace; that is, 

trace (A) = ^ag. 
i 

Show that trace is a linear operator. 

(b) The operator det replaces a matrix A by its determinant; that is, 

det(A) = determinant of A. 

Show that det is not a linear operator. 

3.2.28 A and B anticommute: BA = — AB. Also, A 2 = 1, B 2 = 1. Show that trace(A) = 
trace(B) = 0. 

Note. The Pauli and Dirac (Section 3.4) matrices are specific examples. 

3.2.29 With \x) an ;V-dimensional column vector and (v| an /V-dimensional row vector, show 
that 

trace(|x) (y|) = (y|x). 

Note. |x}(y| means direct product of column vector \x) with row vector (y|. The result 
is a square N x N matrix. 

3.2.30 (a) If two nonsingular matrices anticommute, show that the trace of each one is zero. 

(.Nonsingular means that the determinant of the matrix nonzero.) 

(b) For the conditions of part (a) to hold, A and B must be n x n matrices with n even. 
Show that if n is odd, a contradiction results. 
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3.2.31 

3.2.32 


If a matrix has an inverse, show that the inverse is unique. 
If A -1 has elements 


(A” 1 ), 


,(-i) 


Cp 
|A| ’ 


where C,-/ is the ji th cofactor of |A|, show that 


A _1 A= 1. 


Hence A 1 is the inverse of A (if |A| ^ 0). 


3.2.33 Show that detA -1 = (detA) -1 . 

Hint. Apply the product theorem of Section 3.2. 

Note. If detA is zero, then A has no inverse. A is singular. 

3.2.34 Find the matrices M/ such that the product M/ A will be A but with: 

(a) the /th row multiplied by a constant k (a,j —*■ kciij, j = 1,2, 3 , .. .); 

(b) the /'th row replaced by the original /'th row minus a multiple of the ///th row 
(ci(j ^ Gij Kciyfij , / =: 1 , 2 , 3 ,...), 

(c) the /'th and ///th rows interchanged (aij — > a m j, a m j -* a,j , j — 1,2,3,...). 

3.2.35 Find the matrices M r such that the product AM r will be A but with: 


(a) the /'th column multiplied by a constant k (ajj —>■ kajj, j = 1,2,3 ,...); 

(b) the /'th column replaced by the original /'th column minus a multiple of the ///th 
column (fiji —> ajj — ka /( „, j = 1,2, 3,...); 

(c) the /'th and ///th columns interchanged (cijj —> aj m , aj m —> ctji, j — 1, 2, 3, ...). 


3.2.36 Find the inverse of 




3.2.37 (a) Rewrite Eq. (2.4) of Chapter 2 (and the corresponding equations for dy and dz) as 

a single matrix equation 


I dxk) = J| dqj). 

J is a matrix of derivatives, the Jacobian matrix. Show that 


{dxk\dxk) — {dqi\G\dqj), 

with the metric (matrix) G having elements g/j given by Eq. (2.6). 
(b) Show that 


det(J) dqidqz dqi — dx dy dz. 


with det(J) the usual Jacobian. 
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3.2.38 Matrices are far too useful to remain the exclusive property of physicists. They may ap¬ 
pear wherever there are linear relations. For instance, in a study of population movement 
the initial fraction of a fixed population in each of n areas (or industries or religions, etc.) 
is represented by an n -component column vector P. The movement of people from one 
area to another in a given time is described by an n x n (stochastic) matrix T. Here Th¬ 
is the fraction of the population in the / th area that moves to the ith area. (Those not 
moving are covered by i — /.) With P describing the initial population distribution, the 
final population distribution is given by the matrix equation TP = Q. 

From its definition, ^" =1 Pi — 1. 

(a) Show that conservation of people requires that 

n 

X>y = l, y = l,2, 

i= 1 

(b) Prove that 

n 

X> = 1 

i =1 

continues the conservation of people. 

3.2.39 Given a 6 x 6 matrix A with elements a,j — 0.5^' — -Tl, i = 0, 1, 2,..., 5; i — 0, 1, 
2,..., 5, find A -1 . List its matrix elements to five decimal places. 

4-20 0 0 

-2 5 -2 0 0 

0-25-20 
0 0 -2 5 -2 

0 0 0 -2 5 

0 0 0 0 -2 

3.2.40 Exercise 3.1.7 may be written in matrix form: 

AX = C. 

Find A -1 and calculate X as A -1 C. 

3.2.41 (a) Write a subroutine that will multiply complex matrices. Assume that the complex 

matrices are in a general rectangular form. 

(b) Test your subroutine by multiplying pairs of the Dirac 4x4 matrices. Section 3.4. 

3.2.42 (a) Write a subroutine that will call the complex matrix multiplication subroutine of 

Exercise 3.2.41 and will calculate the commutator bracket of two complex matri¬ 
ces. 

(b) Test your complex commutator bracket subroutine with the matrices of Exer¬ 
cise 3.2.16. 

3.2.43 Interpolating polynomial is the name given to the (n — l)-degree polynomial determined 
by (and passing through) n points, (v,, v/) with all the x\ distinct. This interpolating 
polynomial forms a basis for numerical quadratures. 
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(a) Show that the requirement that an (n — 1)-degree polynomial in x pass through 
each of the n points (x,, y,) with all x, distinct leads to n simultaneous equations 
of the form 

n— 1 

Y, ajxj = yi, i = 1, 2 ,..., n. 

7=0 

(b) Write a computer program that will read in n data points and return the n coeffi¬ 
cients cij. Use a subroutine to solve the simultaneous equations if such a subroutine 
is available. 

(c) Rewrite the set of simultaneous equations as a matrix equation 

XA = Y. 

(d) Repeat the computer calculation of part (b), but this time solve for vector A by 
inverting matrix X (again, using a subroutine). 

3.2.44 A calculation of the values of electrostatic potential inside a cylinder leads to 

7 (0.0) = 52.640 7 (0.6) = 25.844 
7 (0.2) = 48.292 7 (0.8) = 12.648 

V(0.4) = 38.270 7(1.0) = 0.0. 

The problem is to determine the values of the argument for which 7= 10, 20, 30, 40, 
and 50. Express V(x) as a series ^ n=0 a 2n x 2 ". (Symmetry requirements in the original 
problem require that V(x) be an even function of x.) Determine the coefficients a 2n . 
With V (x) now a known function of x, find the root of V(x) — 10 = 0, 0 < x < I. 
Repeat for 7 ( x ) — 20, and so on. 

ANS. a 0 = 52.640, 
a 2 = -117.676, 
7(0.6851) = 20. 


3.3 Orthogonal Matrices 

Ordinary three-dimensional space may be described with the Cartesian coordinates 
(xi, x 2 , X 3 ). We consider a second set of Cartesian coordinates (x^ x' 2 , x' 3 ), whose ori¬ 
gin and handedness coincides with that of the first set but whose orientation is different 
(Fig. 3.1). We can say that the primed coordinate axes have been rotated relative to the 
initial, unprimed coordinate axes. Since this rotation is a linear operation, we expect a 
matrix equation relating the primed basis to the unprimed basis. 

This section repeats portions of Chapters 1 and 2 in a slightly different context and 
with a different emphasis. Previously, attention was focused on the vector or tensor. In 
the case of the tensor, transformation properties were strongly stressed and were critical. 
Here emphasis is placed on the description of the coordinate rotation itself — the matrix. 
Transformation properties, the behavior of the matrix when the basis is changed, appear 
at the end of this section. Sections 3.4 and 3.5 continue with transformation properties in 
complex vector spaces. 
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Figure 3.1 Cartesian coordinate systems. 

Direction Cosines 

A unit vector along the xj-axis (x^) may be resolved into components along the x\~, X 2 ~, 
and t 3 -axes by the usual projection technique: 

xj =Xl COS(Xj, Xl) + X 2 COS(Xj,X 2 ) + X 3 cos(xj, X 3 ). (3.61) 

Equation (3.61) is a specific example of the linear relations discussed at the beginning of 
Section 3.2. 

For convenience these cosines, which are the direction cosines, are labeled 

cos(xj, x\) = x'j • xi = an, 

COS(Xj, X 2 ) = x'j • X 2 = (712, 

COS(Xj, X 3 ) = Xj • X 3 = ( 713 - 

Continuing, we have 

COS(Xt, Xl) = x' 2 ■ Xl = (721, 

COS(X 2 , X 2 ) —x' 2 -X2 — (722, 

and so on, where « 2 i ^ a \2 in general. Now, Eq. (3.62) may be rewritten 

Xj =Xl(7ll +X 2 (712 +X 3 ( 713 , (3.62c) 


(3.62a) 


(3.62b) 


and also 


X 2 = X[(721 + X 2 U 22 + X3«23, 

X 3 = Xifl3i + X2<732 + X3«33. 


(3.62d) 
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We may also go the other way by resolving xi, X2, and £3 into components in the primed 
system. Then 

xj — x| nn + x 2 a2i T x^t/31, 

X2 = Xjf/12 + X2<Z22 + *30325 ( 3 . 63 ) 

X 3 = x'| a 13 + X 2(223 + X3CZ33. 

Associating xj and x'j with the subscript 1 , X2 and x, with the subscript 2 , X3 and X3 
with the subscript 3 , we see that in each case the first subscript of ajj refers to the primed 
unit vector (x^x^Xj), whereas the second subscript refers to the unprimed unit vector 

(Xl,X 2 ,X 3 ). 

Applications to Vectors 

If we consider a vector whose components are functions of the position in space, then 
V(Xl,X2,X 3 ) = Xi V\ +X 2 V 2 +X3V3, 

( 3 . 64 ) 

(x \. x' 2 , X3) = x'| V[ +X2V2 + x' 3 V3, 

since the point may be given both by the coordinates (xi, X2, *3) and by the coordinates 
{x[, x 2 , X3). Note that V and V' are geometrically the same vector (but with different com¬ 
ponents). The coordinate axes are being rotated; the vector stays fixed. Using Eqs. ( 3 . 62 ) 
to eliminate xj, X2, and X3, we may separate Eq. ( 3 . 64 ) into three scalar equations, 

V{ — a\\ Vi + ci 12 V2 + fli3 V3, 

V 2 ' = (221 Vi + 022 V2 + (223 V3, ( 3 . 65 ) 

V3 = (231 Vi + CI32V2 + 033^3. 

In particular, these relations will hold for the coordinates of a point (ai,* 2,*3) and 
(x[,x' 2 ,x' 3 ), giving 

x\ — (211X1 + Cl\2X2 + (213X3, 

x 2 — a,2ix\ + 022x2 + 023x3, ( 3 . 66 ) 

*3 = O31X1 + 032X2 + 033X3, 

and similarly for the primed coordinates. In this notation the set of three equations ( 3 . 66 ) 
may be written as 

3 

x?, = Y,OijXj. ( 3 . 67 ) 

2 = 1 

where i takes on the values 1 , 2 , and 3 and the result is three separate equations. 

Now let us set aside these results and try a different approach to the same problem. We 
consider two coordinate systems (xi, .*2, *3) and (x\, x' 2 , x' 2 ) with a common origin and 
one point (xi, *2, X3) in the unprimed system, (xj, x' 2 ,x'^) in the primed system. Note the 
usual ambiguity. The same symbol x denotes both the coordinate axis and a particular 
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distance along that axis. Since our system is linear, x\ must be a linear combination of 
the Xi. Let 

3 

= (3.68) 

7 = 1 

The cijj may be identified as the direction cosines. This identification is carried out for the 
two-dimensional case later. 

If we have two sets of quantities (V ], VS, V3) in the unprimed system and (V[, V^, V0 in 
the primed system, related in the same way as the coordinates of a point in the two different 
systems (Eq. (3.68)), 

3 

v! = Y, a ‘J v j’ (3 - 69) 

7=1 

then, as in Section 1.2, the quantities (V \, Vi, V3) are defined as the components of a vector 
that stays fixed while the coordinates rotate; that is, a vector is defined in terms of trans¬ 
formation properties of its components under a rotation of the coordinate axes. In a sense 
the coordinates of a point have been taken as a prototype vector. The power and useful¬ 
ness of this definition became apparent in Chapter 2, in which it was extended to define 
pseudovectors and tensors. 

From Eq. (3.67) we can derive interesting information about the cijj that describe the 
orientation of coordinate system (x' { , x ' 2 , vj) relative to the system (x \ , xi, xj). The length 
from the origin to the point is the same in both systems. Squaring, for convenience, 13 

4 = J2 x > 2 = °u x j) ( J2 a ‘ kXk 

i i i ' j ' ' k 

= Yx jX k y^aijUik- (3.70) 

j,k i 

This can be true for all points if and only if 

^ 2 a ijaik = Sjk , j, A-=1,2,3. (3.71) 



Note that Eq. (3.71) is equivalent to the matrix equation (3.83); see also Eqs. (3.87a) 
to (3.87d). 

Verification of Eq. (3.71), if needed, may be obtained by returning to Eq. (3.70) and 
setting r = {xi^xi^xi,) — (1,0,0), (0, 1,0), (0,0, 1), (1, 1,0), and so on to evaluate the 
nine relations given by Eq. (3.71). This process is valid, since Eq. (3.70) must hold for all r 
for a given set of cijj . Equation (3.71), a consequence of requiring that the length remain 
constant (invariant) under rotation of the coordinate system, is called the orthogonality 
condition. The cijj , written as a matrix A subject to Eq. (3.71), form an orthogonal matrix, 
a first definition of an orthogonal matrix. Note that Eq. (3.71) is not matrix multiplication. 
Rather, it is interpreted later as a scalar product of two columns of A. 


11 Note that two independent indices j and k are used. 
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In matrix notation Eq. (3.67) becomes 

\x')=k\x). 


(3.72) 


Orthogonality Conditions — Two-Dimensional Case 


A better understanding of the a ;/ - and the orthogonality condition may be gained by consid¬ 
ering rotation in two dimensions in detail. (This can be thought of as a three-dimensional 
system with the X] -, X 2 -a\es rotated about X 3 .) From Fig. 3.2, 

x\—x\ cos w T xi sin w, 

' (3.73) 

x 2 — —x\ sin<p + X 2 cos (p. 

Therefore by Eq. (3.72) 


( cos (p 
— sin^> 


sin q> 
cos q> 


(3.74) 


Notice that A reduces to the unit matrix for q> — Q. Zero angle rotation means nothing has 
changed. It is clear from Fig. 3.2 that 


on = cos <p — cos(;tj, 3 Ci), 

a 12 = sin^j = cos(^ — (p) — cos(.Tj, X 2 ), 


(3.75) 


and so on, thus identifying the matrix elements cii j as the direction cosines. Equation (3.71), 
the orthogonality condition, becomes 


sin 2 1 p + cos 2 <p — 1 , 
sin <p cos (p — sin <p cos q> = 0 . 


(3.76) 



Figure 3.2 Rotation of coordinates. 
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The extension to three dimensions (rotation of the coordinates through 
terclockwise about xy) is simply 

an angle <p coun- 

/ cos <p sin (p 0 \ 

A = — sin (p cos (p 0 1. 

V 0 0 l) 

(3.77) 

The <733 = 1 expresses the fact that x' 2 = X 3 , since the rotation has been about the X 3 -axis. 
The zeros guarantee that x[ and x' 2 do not depend on *3 and that x'^ does not depend on x\ 
and X 2 ■ 

Inverse Matrix, A 1 


Returning to the general transformation matrix A, the inverse matrix A~ 
that 

1 is defined such 

II 

> 

1 

(3.78) 

That is, A 1 describes the reverse of the rotation given by A and returns the coordinate 
system to its original position. Symbolically, Eqs. (3.72) and (3.78) combine to give 

|x)=A 1 A|jc) , 

(3.79) 

and since \x) is arbitrary. 


A~ l A= 1, 

(3.80) 

the unit matrix. Similarly, 


AA _1 = 1, 

(3.81) 

using Eqs. (3.72) and (3.78) and eliminating |x) instead of \x'). 


Transpose Matrix, A 


We can determine the elements of our postulated inverse matrix A -1 by employing the 
orthogonality condition. Equation (3.71), the orthogonality condition, does not conform to 
our definition of matrix multiplication, but it can be put in the required form by defining a 
new matrix A such that 

® ji — j ‘ 

(3.82) 

Equation (3.71) becomes 


II 

< 

>< 

(3.83) 

This is a restatement of the orthogonality condition and may be taken as the constraint 
defining an orthogonal matrix, a second definition of an orthogonal matrix. Multiplying 
Eq. (3.83) by A” 1 from the right and using Eq. (3.81), we have 

7 

< 

II 

>< 

(3.84) 
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a third definition of an orthogonal matrix. This important result, that the inverse equals 
the transpose, holds only for orthogonal matrices and indeed may be taken as a further 
restatement of the orthogonality condition. 

Multiplying Eq. (3.84) by A from the left, we obtain 

AA=1 (3.85) 


or 



i 


(3.86) 


which is still another form of the orthogonality condition. 

Summarizing, the orthogonality condition may be stated in several equivalent ways: 


^ ' a ij a ik — &jk > 
i 

(3.87a) 

^ a ji ttki — &j k > 
i 

(3.87b) 

A A = A A = 1, 

(3.87c) 

7 

< 

11 

<< 

(3.87d) 


Any one of these relations is a necessary and a sufficient condition for A to be orthogonal. 

It is now possible to see and understand why the term orthogonal is appropriate for 
these matrices. We have the general form 

( a it an «13 

<321 <222 «23 

«3I 032 O 33 

a matrix of direction cosines in which a t] is the cosine of the angle between x' and xj. 
Therefore ah, a 12, 013 are the direction cosines of x\ relative to x\, X2, X3. These three 
elements of A define a unit length along x[, that is, a unit vector Xj, 

*1 = Xi<7] 1 + X2012 + X3«13. 

The orthogonality relation (Eq. (3.86)) is simply a statement that the unit vectors Xj,x,, 
and x) are mutually perpendicular, or orthogonal. Our orthogonal transformation matrix A 
transforms one orthogonal coordinate system into a second orthogonal coordinate system 
by rotation and/or reflection. 

As an example of the use of matrices, the unit vectors in spherical polar coordinates may 
be written as 
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where C is given in Exercise 2.5.1. This is equivalent to Eqs. (3.62) with Xj, x' 2 , and x 2 
replaced by r, 0, and ip. From the preceding analysis C is orthogonal. Therefore the inverse 
relation becomes 

= C“‘ ^0 j =C j , (3.89) 

and Exercise 2.5.5 is solved by inspection. Similar applications of matrix inverses appear in 
connection with the transformation of a power series into a series of orthogonal functions 
(Gram-Schmidt orthogonalization in Section 10.3) and the numerical solution of integral 
equations. 



Euler Angles 

Our transformation matrix A contains nine direction cosines. Clearly, only three of these 
are independent, Eq. (3.71) providing six constraints. Equivalently, we may say that two 
parameters (6 and <p in spherical polar coordinates) are required to fix the axis of rotation. 
Then one additional parameter describes the amount of rotation about the specified axis. 
(In the Lagrangian formulation of mechanics (Section 17.3) it is necessary to describe 
A by using some set of three independent parameters rather than the redundant direction 
cosines.) The usual choice of parameters is the Euler angles. 14 

The goal is to describe the orientation of a final rotated system (x"', x 2 , Xj") relative to 
some initial coordinate system (xi,X2,X3). The final system is developed in three steps, 
with each step involving one rotation described by one Euler angle (Fig. 3.3): 

1 . The coordinates are rotated about the X3-axis through an angle a counterclockwise 
into new axes denoted by x\ -, x 2 -, Xy (The X3- and ax,- axes coincide.) 





Figure 3.3 (a) Rotation about X3 through angle a; (b) rotation about x’ 2 through 

angle f3 ; (c) rotation about x" through angle y. 


14 There are almost as many definitions of the Euler angles as there are authors. Here we follow the choice generally made by 
workers in the area of group theory and the quantum theory of angular momentum (compare Sections 4 . 3 , 4 . 4 ). 
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2. The coordinates are rotated about the jt^-axis 15 through an angle p counterclockwise 
into new axes denoted by x'[-, x' 2 -, x". (The x' 2 - and A'"-axes coincide.) 

3. The third and final rotation is through an angle y counterclockwise about the a”- axis, 
yielding the x’", x 2 , x™ system. (The x'y and x^-axes coincide.) 


The three matrices describing these rotations are 

FU(«)= 



exactly like Eq. (3.77), 


(3.90) 


/ cos/6 

*C/2 

1 

o 


° 

1 0 


| (3.91) 

\ sin p 

0 cos 

a ) 


/ cosy 

siny 

°\ 


— siny 

cos y 

0 

(3.92) 

V o 

0 

i/ 



and 


Rv(/3) = 


R-(y) = 


The total rotation is described by the triple matrix product, 

A(«, p, y) = R z (y)R y (0)R z (a). (3.93) 

Note the order: R z (a) operates first, then R y (/3), and finally R z (y). Direct multiplication 
gives 

A (a,/3, y) 

cos y cos p cos a — sin y sin a cos y cos p sin a + sin y cos a — cos y sin p N 

— sin y cos P cos a — cos y sin a — sin y cos P sin a + cos y cos a sin y sin P 

sin p cos a sin p sin a cos/8 

(3.94) 


Equating A (atj) with A(a, P, y ), element by element, yields the direction cosines in terms 
of the three Euler angles. We could use this Euler angle identification to verify the direction 
cosine identities, Eq. (1.46) of Section 1.4, but the approach of Exercise 3.3.3 is much more 
elegant. 


Symmetry Properties 

Our matrix description leads to the rotation group SO(3) in three-dimensional space R 3 , 
and the Euler angle description of rotations forms a basis for developing the rotation 
group in Chapter 4. Rotations may also be described by the unitary group SU(2) in two- 
dimensional space C 2 over the complex numbers. The concept of groups such as SU(2) 
and its generalizations and group theoretical techniques are often encountered in modern 

15 Some authors choose this second rotation to be about the xj-axis. 
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particle physics, where symmetry properties play an important role. The SU(2) group is 
also considered in Chapter 4. The power and flexibility of matrices pushed quaternions into 
obscurity early in the 20th century. 16 

It will be noted that matrices have been handled in two ways in the foregoing discussion: 
by their components and as single entities. Each technique has its own advantages and both 
are useful. 

The transpose matrix is useful in a discussion of symmetry properties. If 

A — A. ciij — aji , (3.95) 

the matrix is called symmetric, whereas if 

A=—A, cijj = —aji, (3.96) 

it is called antisymmetric or skewsymmetric. The diagonal elements vanish. It is easy to 
show that any (square) matrix may be written as the sum of a symmetric matrix and an 
antisymmetric matrix. Consider the identity 

A = j[A + A] + j[A - A], (3.97) 

[A + A] is clearly symmetric, whereas [A-A] is clearly antisymmetric. This is the 
matrix analog of Eq. (2.75), Chapter 2, for tensors. Similarly, a function may be broken up 
into its even and odd parts. 

So far we have interpreted the orthogonal matrix as rotating the coordinate system. This 
changes the components of a fixed vector (not rotating with the coordinates) (Fig. 1.6, 
Chapter 1). However, an orthogonal matrix A may be interpreted equally well as a rotation 
of the vector in the opposite direction (Fig. 3.4). 

These two possibilities, (1) rotating the vector keeping the coordinates fixed and (2) 
rotating the coordinates (in the opposite sense) keeping the vector fixed, have a direct 
analogy in quantum theory. Rotation (a time transformation) of the state vector gives the 
Schrodinger picture. Rotation of the basis keeping the state vector fixed yields the Heisen¬ 
berg picture. 


V 



Figure 3.4 Fixed coordinates — 
rotated vector. 


i 6 R. J. Stephenson, Development of vector analysis from quaternions. Am. J. Phys. 34: 194 (1966). 
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Suppose we interpret matrix A as rotating a vector r into the position shown by ri ; that 
is, in a particular coordinate system we have a relation 

ri = Ar. (3.98) 

Now let us rotate the coordinates by applying matrix B, which rotates (x, y, z) into 

(x',y',z'), 

r'j = Bn = BAr = (Ar)' = BA(B _1 B)r 

= (BAB _1 )Br = (BAB _1 )r'. (3.99) 

Bn is just ri in the new coordinate system, with a similar interpretation holding for Br. 
Hence in this new system (Br) is rotated into position (Bn) by the matrix BAB* 1 : 

Bn = (BAB* 1 ) Br 

l J | 

rj = A' r' 

In the new system the coordinates have been rotated by matrix B; A has the form A', in 
which 

A' = BAB* 1 . (3.100) 

A' operates in the x', y', z! space as A operates in the x, y, z space. 

The transformation defined by Eq. (3.100) with B any matrix, not necessarily orthogo¬ 
nal, is known as a similarity transformation. In component form Eq. (3.100) becomes 

= (3-101) 

k,l 

Now, if B is orthogonal, 

(B -1 )y = (B)y = bji, (3.102) 

and we have 

a'a — Tbikbiiaui. (3.103) 

k,l 

It may be helpful to think of A again as an operator, possibly as rotating coordinate axes, 
relating angular momentum and angular velocity of a rotating solid (Section 3.5). Matrix A 
is the representation in a given coordinate system — or basis. But there are directions asso¬ 
ciated with A — crystal axes, symmetry axes in the rotating solid, and so on — so that the 
representation A depends on the basis. The similarity transformation shows just how the 
representation changes with a change of basis. 
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Relation to Tensors 


Comparing Eq. (3.103) with the equations of Section 2.6, we see that it is the definition 
of a tensor of second rank. Hence a matrix that transforms by an orthogonal similarity 
transformation is, by definition, a tensor. Clearly, then, any orthogonal matrix A, inter¬ 
preted as rotating a vector (Eq. (3.98)), may be called a tensor. If, however, we consider 
the orthogonal matrix as a collection of fixed direction cosines, giving the new orientation 
of a coordinate system, there is no tensor property involved. 

The symmetry and antisymmetry properties defined earlier are preserved under orthog¬ 
onal similarity transformations. Let A be a symmetric matrix. A — A, and 

A' = BAB -1 . (3.104) 

Now, 

A'= §”^13 = BAB” 1 , (3.105) 

since B is orthogonal. But A = A. Therefore 

A' = BAB” 1 = A', (3.106) 

showing that the property of symmetry is invariant under an orthogonal similarity transfor¬ 
mation. In general, symmetry is not preserved under a nonorthogonal similarity transfor¬ 
mation. 


Exercises 

Note. Assume all matrix elements are real. 

3.3.1 Show that the product of two orthogonal matrices is orthogonal. 

Note. This is a key step in showing that all n x n orthogonal matrices form a group 
(Section 4.1). 

3.3.2 If A is orthogonal, show that its determinant = ± 1. 

3.3.3 If A is orthogonal and det A = +1, show that (det A)a t] — C / ; , where C ( / is the cofactor 
of a\j. This yields the identities of Eq. (1.46), used in Section 1.4 to show that a cross 
product of vectors (in three-space) is itself a vector. 

Hint. Note Exercise 3.2.32. 

3.3.4 Another set of Euler rotations in common use is 

(1) a rotation about the X3-axis through an angle <p, counterclockwise, 

(2) a rotation about the xj-axis through an angle 6 , counterclockwise, 

(3) a rotation about the -axis through an angle i//, counterclockwise. 

If 

a — (p — n/2 (p — a + n/2 

j3 = o e = p 

y = \l/ + n/2 \j/ — y — Tt/2, 

show that the final systems are identical. 



3.3 Orthogonal Matrices 


207 


3.3.5 


3.3.6 


3.3.7 


3.3.8 

3.3.9 

3.3.10 


3.3.11 


3.3.12 


3.3.13 


3.3.14 


Suppose the Earth is moved (rotated) so that the north pole goes to 30° north, 20° west 
(original latitude and longitude system) and the 10° west meridian points due south. 

(a) What are the Euler angles describing this rotation? 

(b) Find the corresponding direction cosines. 


/ 0.9551 
ANS. (b) A= 0.0052 
\ 0.2962 


-0.2552 —0.1504 \ 
0.5221 -0.8529 . 

0.8138 0.5000 / 


Verify that the Euler angle rotation matrix, Eq. (3.94), is invariant under the transforma¬ 
tion 


a-+a + n, ft->—ft, y-+y — jr. 

Show that the Euler angle rotation matrix A(a. ft. y) satisfies the following relations: 

(a) A~ l (a.ft.y) = A(a,ft.y), 

(b) A _1 (o:, ft, y) = A(—y, —ft, —a). 


Show that the trace of the product of a symmetric and an antisymmetric matrix is zero. 

Show that the trace of a matrix remains invariant under similarity transformations. 

Show that the determinant of a matrix remains invariant under similarity transforma¬ 
tions. 

Note. Exercises (3.3.9) and (3.3.10) show that the trace and the determinant are inde¬ 
pendent of the Cartesian coordinates. They are characteristics of the matrix (operator) 
itself. 


Show that the property of antisymmetry is invariant under orthogonal similarity trans¬ 
formations. 


A is 2 x 2 and orthogonal. Find the most general form of 


A = 



Compare with two-dimensional rotation. 


|x) and |y) are column vectors. Under an orthogonal transformation S, x') = S|x), 
|y'} = S|y). Show that the scalar product (x | y) is invariant under this orthogonal trans¬ 
formation. 

Note. This is equivalent to the invariance of the dot product of two vectors. Section 1.3. 


Show that the sum of the squares of the elements of a matrix remains invariant under 
orthogonal similarity transformations. 


As a generalization of Exercise 3.3.14, show that 


SjkTjk — ^2, S'lm Tin > 

jk l,m 


3.3.15 
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where the primed and unprimed elements are related by an orthogonal similarity trans¬ 
formation. This result is useful in deriving invariants in electromagnetic theory (com¬ 
pare Section 4.6). 

Note. This product Mjk = Sjk Tjk is sometimes called a Hadamard product. In the 
framework of tensor analysis. Chapter 2, this exercise becomes a double contraction of 
two second-rank tensors and therefore is clearly a scalar (invariant). 

3.3.16 A rotation <p\ + q >2 about the z-axis is carried out as two successive rotations <p\ and 
(P 2 . each about the "-axis. Use the matrix representation of the rotations to derive the 
trigonometric identities 

cos(^i + (P 2 ) = cos (pi cos cp 2 — sin</q sin<£>2, 
sin(^i + (p 2 ) — sini^i cos <£>2 + cos <p 1 sin <£>2- 

3.3.17 A column vector V has components V\ and V 2 in an initial (unprimed) system. Calculate 
V[ and U' for a 

(a) rotation of the coordinates through an angle of 0 counterclockwise, 

(b) rotation of the vector through an angle of 0 clockwise. 


The results for parts (a) and (b) should be identical. 

3.3.18 Write a subroutine that will test whether a real N x N matrix is symmetric. Symmetry 
may be defined as 


0< \<2jj -dji | <£, 

where e is some small tolerance (which allows for truncation error, and so on in the 
computer). 


3.4 Hermitian Matrices, Unitary Matrices 
D efinitions 

Thus far it has generally been assumed that our linear vector space is a real space and 
that the matrix elements (the representations of the linear operators) are real. For many 
calculations in classical physics, real matrix elements will suffice. However, in quantum 
mechanics complex variables are unavoidable because of the form of the basic commuta¬ 
tion relations (or the form of the time-dependent Schrodinger equation). With this in mind, 
we generalize to the case of complex matrix elements. To handle these elements, let us 
define, or label, some new properties. 

1. Complex conjugate. A*, formed by taking the complex conjugate (i -> —i) of each 
element, where i = -J — 1. 

2. Adjoint, A 1 2 , formed by transposing A*, 

A f = A* = A*. 


(3.107) 
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3. Hermitian matrix: The matrix A is labeled Hermitian (or self-adjoint) if 

A = A f . (3.108) 

If A is real, then A^ = A and real Hermitian matrices are real symmetric matrices. 
In quantum mechanics (or matrix mechanics) matrices are usually constructed to be 
Hermitian, or unitary. 

4. Unitary matrix: Matrix U is labeled unitary if 


U' = u; ’. 


(3.109) 


If U is real, then U 1 = U, so real unitary matrices are orthogonal matrices. This 
represents a generalization of the concept of orthogonal matrix (compare Eq. (3.84)). 
5. (AB)* = A*B*, (AB) t = B t A t . 


If the matrix elements are complex, the physicist is almost always concerned with Her¬ 
mitian and unitary matrices. Unitary matrices are especially important in quantum me¬ 
chanics because they leave the length of a (complex) vector unchanged — analogous to the 
operation of an orthogonal matrix on a real vector. It is for this reason that the S matrix 
of scattering theory is a unitary matrix. One important exception to this interest in unitary 
matrices is the group of Lorentz matrices. Chapter 4. Using Minkowski space, we see that 
these matrices are not unitary. 

In a complex n -dimensional linear space the square of the length of a point x = 
x T (x\. X 2 -..., x „), or the square of its distance from the origin 0, is defined as x'x = 
x* Xj = | Xi | 2 . If a coordinate transformation y — Ux leaves the distance unchanged, 

then x+x — y'y — (Ujc)' Ux = x ' Ux. Since x is arbitrary it follows that U 1 U = 1„; 
that is, U is a unitary n x n matrix. If x' — Ax is a linear map, then its matrix in the new 
coordinates becomes the unitary (analog of a similarity) transformation 

A' = UAU f , (3.110) 

because Ux' = y' = UAx = UAU -1 y = UAU 1 y. 


Pauli and Dirac Matrices 


The set of three 2x2 Pauli matrices a, 



were introduced by W. Pauli to describe a particle of spin 1 /2 in nonrelativistic quantum 
mechanics. It can readily be shown that (compare Exercises 3.2.13 and 3.2.14) the Pauli a 
satisfy 


a,-cry = 2&ij 12, anticommutation 

Oja j — i<Jk, 

(o’, i ) 2 = h, 


(3.112) 

(3.113) 

(3.114) 


i, j. k a cyclic permutation of 1, 2, 3 
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where I2 is the 2x2 unit matrix. Thus, the vector cr/2 satisfies the same commutation 
relations, 

[<T. rr j] = cjjoj - (TjfTi = 2 is ijk a k , (3.115) 

as the orbital angular momentum L (L x L = i L, see Exercise 2.5.15 and the SO(3) and 
SU(2) groups in Chapter 4). 

The three Pauli matrices a and the unit matrix form a complete set, so any Hermitian 
2x2 matrix M may be expanded as 

M = mol2 + m\cr\ + ni 2<72 + — m 0 + m • <r, (3.116) 

where the m, form a constant vector m. Using (a, ) 2 = I2 and trace(cr,) = 0 we obtain from 
Eq. (3.116) the expansion coefficients m; by forming traces, 

2mo = trace(M), 2m,- = trace (Mer,-), 1 = 1,2,3. (3.117) 

Adding and multiplying such 2x2 matrices we generate the Pauli algebra. 17 Note that 
trace(er,) = 0 for i — 1.2, 3. 

In 1927 P. A. M. Dirac extended this formalism to fast-moving particles of spin 
such as electrons (and neutrinos). To include special relativity he started from Einstein’s 
energy, E 2 = p 2 c 2 + /« 2 c 4 , instead of the nonrelativistic kinetic and potential energy, 
E — p 2 /2m + V. The key to the Dirac equation is to factorize 

E 2 — p 2 c 2 — E 2 — (ca ■ p) 2 = (E — ca • p)(£ + ca • p) = /w 2 c 4 (3.118) 

using the 2x2 matrix identity 

(<r-p) 2 = p 2 l 2 . (3.119) 

The 2x2 unit matrix I2 is not written explicitly in Eq. (3.118), and Eq. (3.119) follows 
from Exercise 3.2.14 for a = b = p. Equivalently, we can introduce two matrices y' and y 
to factorize E 2 — p 2 c 2 directly: 

\Ey' <g> 1 2 - c(y <g> a) ■ p] _ 

= E 2 y' 2 <g> 1 2 + c 2 y 2 ® (a ■ p) 2 — Ec(y’y + yy') ® a ■ p 

= £ 2 - p 2 c 2 = m 2 c 4 . (3.1190 

For Eq. (3.1190 to hold, the conditions 

/ 2 = 1 = -y 2 , y'y + yy' = 0 (3.120) 

must be satisfied. Thus, the matrices y' and y anticommute, just like the three Pauli ma¬ 
trices; therefore they cannot be real or complex numbers. Because the conditions (3.120) 
can be met by 2 x 2 matrices, we have written direct product signs (see Example 3.2.1) in 
Eq. (3.1190 because y', y are multiplied by I2, <r matrices, respectively, with 



17 For its geometrical significance, see W. E. Baylis, J. Huschilt, and Jiansu Wei, Am. J. Phys. 60: 788 (1992). 


(3.121) 
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The direct-product 4x4 matrices in Eq. (3.119') are the four conventional Dirac 
y-matrices. 


y° — y' 0 h — 


y — y 0a i 


y — y 0 a 3 : 


h 

0 


0 

—1 2 


( 0 



oj" 

( 0 

CT 3 \ 

°3 

oJ“ 


/I 

0 

0 

0 ^ 

0 

1 

0 

0 

0 

0 

-1 

0 

\o 

0 

0 

-v 

/ 0 

0 

0 

1 \ 

0 

0 

1 

0 

0 

-1 

0 

0 

A 

0 

0 

0/ 

/ 0 

0 

1 

0 \ 

0 

0 

0 

-1 

-1 

0 

0 

0 

l 0 

1 

0 

0 / 


(3.122) 


and similarly for y 2 = y 0 02 ■ In vector notation y = y 0 a is a vector with three 
components, each a 4 x 4 matrix, a generalization of the vector of Pauli matrices to a 
vector of 4 x 4 matrices. The four matrices y' are the components of the four-vector 
y tl — (y°, y 1 , y 2 , y 3 ). If we recognize in Eq. (1.119') 


Ey' 0 b - c(y 0 a) ■ p = y^p^ = y ■ p — (y 0 , y) ■ (E, cp) (3.123) 


as a scalar product of two four-vectors y 1 ' and p 1 ' (see Lorentz group in Chapter 4), then 
Eq. (3.119') with p 2 — p ■ p = E 2 — p 2 c 2 may be regarded as a four-vector generalization 
of Eq. (3.119). 

Summarizing the relativistic treatment of a spin 1 /2 particle, it leads to 4x4 matrices, 
while the spin 1/2 of a nonrelativistic particle is described by the 2x2 Pauli matrices a. 

By analogy with the Pauli algebra, we can form products of the basic y jl matrices 
and linear combinations of them and the unit matrix 1 = I 4 , thereby generating a 16- 
dimensional (so-called Clifford 18 ) algebra. A basis (with convenient Lorentz transforma¬ 
tion properties, see Chapter 4) is given (in 2x2 matrix notation of Eq. (3.122)) by 

l4,y5 = «>VVV = ( 1 ° 2 A y\y 5 y»,a^ = i(y»y v -y v y»)l 2. (3.124) 

The y-matrices anticommute; that is, their symmetric combinations 


y^y v + y v y^ = 2g^U, (3.125) 

where g 00 = 1 = —g 11 = — g 22 = —g 33 , and g^ v = 0 for p v, are zero or proportional 
to the 4x4 unit matrix I 4 , while the six antisymmetric combinations in Eq. (3.124) give 
new basis elements that transform like a tensor under Lorentz transformations (see Chap¬ 
ter 4). Any 4x4 matrix can be expanded in terms of these 16 elements, and the expan¬ 
sion coefficients are given by forming traces similar to the 2x2 case in Eq. (3.117) us- 


18 D. Hestenes and G. Sobczyk, loc.cit. \ D. Hestenes, Am. J. Phys. 39: 1013 (1971); and J. Math. Phys. 16: 556 (1975). 
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ing trace(l 4 ) = 4, traced) = 0, trace(y^) = 0 — trac eiysy 11 ), tracejer^) = 0 for n, v — 
0,1,2, 3 (see Exercise 3.4.23). In Chapter 4 we show that 75 is odd under parity, so 75 
transform like an axial vector that has even parity. 

The spin algebra generated by the Pauli matrices is just a matrix representation of the 
four-dimensional Clifford algebra, while Hestenes and coworkers (loc. cit.) have developed 
in their geometric calculus a representation-free (that is, “coordinate-free”) algebra that 
contains complex numbers, vectors, the quaternion subalgebra, and generalized cross prod¬ 
ucts as directed areas (called bivectors ). This algebraic-geometric framework is tailored to 
nonrelativistic quantum mechanics, where spinors acquire geometric aspects and the Gauss 
and Stokes theorems appear as components of a unified theorem. Their geometric algebra 
corresponding to the 16-dimensional Clifford algebra of Dirac 7 -matrices is the appropri¬ 
ate coordinate-free framework for relativistic quantum mechanics and electrodynamics. 

The discussion of orthogonal matrices in Section 3.3 and unitary matrices in this sec¬ 
tion is only a beginning. Further extensions are of vital concern in “elementary” particle 
physics. With the Pauli and Dirac matrices, we can develop spinor wave functions for elec¬ 
trons, protons, and other (relativistic) spin j particles. The coordinate system rotations lead 
to T) J (a, ft, 7 ), the rotation group usually represented by matrices in which the elements 
are functions of the Euler angles describing the rotation. The special unitary group SU(3) 
(composed of 3 x 3 unitary matrices with determinant +1) has been used with considerable 
success to describe mesons and baryons involved in the strong interactions, a gauge theory 
that is now called quantum chromodynamics. These extensions are considered further in 
Chapter 4. 


Exercises 


3.4.1 

3.4.2 

3.4.3 

3.4.4 

3.4.5 

3.4.6 


Show that 

det(A*) = (det A)* = det(A*). 

Three angular momentum matrices satisfy the basic commutation relation 

[J.r> Jy] = i'lz 

(and cyclic permutation of indices). If two of the matrices have real elements, show that 
the elements of the third must be pure imaginary. 

Show that (AB) 1 ' = B'A 1 . 

A matrix C = S’S. Show that the trace is positive definite unless S is the null matrix, 
in which case trace (C) = 0. 

If A and B are Hermitian matrices, show that (AB + BA) and i (AB — BA) are also 
Hermitian. 

The matrix C is not Hermitian. Show that then C + C 1 and 1 (C — C *) are Hermitian. 
This means that a non-Hermitian matrix may be resolved into two Hermitian parts, 

C=f(C + C*) + ii(C-C*). 

This decomposition of a matrix into two Hermitian matrix parts parallels the decompo¬ 
sition of a complex number z into x + iy, where x = (z + z*)/2 and y = (z — z*)/2i. 
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3.4.7 A and B are two noncommuting Hermitian matrices: 

AB — BA = iC. 

Prove that C is Hermitian. 

3 . 4.8 Show that a Hermitian matrix remains Hermitian under unitary similarity transforma¬ 
tions. 

3 . 4.9 Two matrices A and B are each Hermitian. Find a necessary and sufficient condition for 
their product AB to be Hermitian. 

ANS. [A, B] = 0. 

3 . 4.10 Show that the reciprocal (that is, inverse) of a unitary matrix is unitary. 

3 . 4.11 A particular similarity transformation yields 

A' = UAU -1 , 

A' 1 ' = UA + U _1 . 

If the adjoint relationship is preserved (A 1 = A 1 ) and det U = 1, show that U must be 
unitary. 

3 . 4.12 Two matrices U and H are related by 

U=e iaH . 

with a real. (The exponential function is defined by a Maclaurin expansion. This will 
be done in Section 5.6.) 

(a) If H is Hermitian, show that U is unitary. 

(b) If U is unitary, show that H is Hermitian. (H is independent of a.) 

Note. With H the Hamiltonian, 

t) — U(.r, t)x/f(x, 0) = exp(— itH/h)\js(x, 0) 

is a solution of the time-dependent Schrodinger equation. U(x. t) — exp(— itV\/h) is the 
“evolution operator.” 

3 . 4.13 An operator T{t + e, t) describes the change in the wave function from t to t + s. For s 
real and small enough so that e 2 may be neglected, 

T{t + e, t) — 1-eH(f). 

h 

(a) If T is unitary, show that H is Hermitian. 

(b) If H is Hermitian, show that T is unitary. 

Note. When H(f) is independent of time, this relation may be put in exponential form — 
Exercise 3.4.12. 
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3 . 4.14 


3 . 4.15 

3 . 4.16 

3 . 4.17 


3 . 4.18 


3 . 4.19 

3 . 4.20 


3 . 4.21 


3 . 4.22 

3 . 4.23 


Show that an alternate form. 


T(t + e, t) = 


1 - isV\(t)/2h 
\ + ieH(t)/2h' 


agrees with the T of part (a) of Exercise 3.4.13, neglecting e 2 , and is exactly unitary 
(for H Hermitian). 


Prove that the direct product of two unitary matrices is unitary. 

Show that ys anticommutes with all four y 11 . 

Use the four-dimensional Levi-Civita symbol sx/xvp with £0123 = — 1 (generalizing 
Eqs. (2.93) in Section 2.9 to four dimensions) and show that (i) 2y$a pv = —is /lva ^<7 a ^ 
using the summation convention of Section 2.6 and (ii) yxy lt y v = gx^Yv — gXvYp + 
g/ivYk + isx f ivpY p Y5■ Define y,, = g^ v y v using g^ v = g, lv to raise and lower indices. 

Evaluate the following traces: (see Eq. (3.123) for the notation) 


(i) trace(y • ay ■ b) — 4a ■ b, 

(ii) trace))/ ■ ay ■ by ■ c) — 0 , 

(iii) trace(y • ay ■ by ■ cy ■ d) — 4(a ■ be ■ d — a ■ cb ■ d + a ■ db ■ c), 

(iv) trace()/ 5 )/ ■ ay ■ by ■ cy ■ d) = 4is a ^xL V a a b^c^d v . 

Show that (i) y ll y a y 11 = —2 y a , (ii) y ll y 0l y^y ,J ' = 4g a P, and (iii) y ll y c ‘y^y v y ,i = 

-2 y v yPy a . 

If M = ^(1 + 5 / 5 ), show that 

M 2 = M. 

Note that 5/5 may be replaced by any other Dirac matrix (any F,- of Eq. (3.124)). If M is 
Hermitian, then this result, M 2 = M, is the defining equation for a quantum mechanical 
projection operator. 

Show that 

a x a — 2 iar ® I 2 , 

where a = yoy is a vector 

a — (ai , 0 : 2 , 0 ( 3 ). 

Note that if a is a polar vector (Section 2.4), then a is an axial vector. 

Prove that the 16 Dirac matrices form a linearly independent set. 

If we assume that a given 4x4 matrix A (with constant elements) can be written as a 
linear combination of the 16 Dirac matrices 

16 

A = £ Ci r / , 

i=i 


show that 


c,- ~ trace(Ar, ). 
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3.4.24 If C = iy 2 y° is the charge conjugation matrix, show that Cy ,l C 1 = — y^, where 
~ indicates transposition. 

3.4.25 Let x' fL — AJj.r v be a rotation by an angle 9 about the 3-axis, 

Xq — xq, x\ — x\ cos 9 + x 2 sin#, 
x' 2 — —x\ sin 9 + X 2 cost?, x 3 —xt,- 

Use R — exp(/#a 12 /2) = cos#/2 + ;er 12 sin#/2 (see Eq. (3.170b)) and show that 
the y’s transform just like the coordinates that is, A v y v = R~ [ y^R. (Note that 
yn = g)ivY v and that the y 1 ' are well defined only up to a similarity transformation.) 
Similarly, if x’ = Ax is a boost (pure Lorentz transformation) along the 1-axis, that is, 

Xq — xq cosh £ —xi sinh £, x\ = — xq sinh £ + x\ cosh £, 

x't = X2, X 3 =X3, 

with tanh £ = v/c and B — exp(— i£cr 01 /2) — cosht;/2 — icr 01 sinhf/2 (see 
Eq. (3.170b)), show that A y v — By^B~ l . 

3.4.26 (a) Given r' = Ur, with U a unitary matrix and r a (column) vector with complex 

elements, show that the norm (magnitude) of r is invariant under this operation, 
(b) The matrix U transforms any column vector r with complex elements into r', 
leaving the magnitude invariant: r + r = r'T'. Show that U is unitary. 

3.4.27 Write a subroutine that will test whether a complex n x n matrix is self-adjoint. In 
demanding equality of matrix elements atj — ajj, allow some small tolerance e to com¬ 
pensate for truncation error of the computer. 

3.4.28 Write a subroutine that will form the adjoint of a complex M x N matrix. 

3.4.29 (a) Write a subroutine that will take a complex M x N matrix A and yield the product 

A f A. 

Hint. This subroutine can call the subroutines of Exercises 3.2.41 and 3.4.28. 

(b) Test your subroutine by taking A to be one or more of the Dirac matrices, 
Eq. (3.124). 

3.5 Diagonalization of Matrices 
M oment of Inertia Matrix 

In many physical problems involving real symmetric or complex Hermitian matrices it is 
desirable to carry out a (real) orthogonal similarity transformation or a unitary transfor¬ 
mation (corresponding to a rotation of the coordinate system) to reduce the matrix to a 
diagonal form, nondiagonal elements all equal to zero. One particularly direct example 
of this is the moment of inertia matrix I of a rigid body. From the definition of angular 
momentum L we have 


L = I to. 


( 3 . 126 ) 
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(o being the angular velocity. 19 The inertia matrix I is found to have diagonal components 

I xx = rtii ( rf —xf), and so on, (3.127) 

i 

the subscript i referring to mass m , located at r, = (xt, v,-, z;). For the nondiagonal com¬ 
ponents we have 

I X y — ^ ' mjXjyi — Iy X . (3.128) 

i 

By inspection, matrix I is symmetric. Also, since I appears in a physical equation of the 
form (3.126), which holds for all orientations of the coordinate system, it may be consid¬ 
ered to be a tensor (quotient rule. Section 2.3). 

The key now is to orient the coordinate axes (along a body-fixed frame) so that the 
hy and the other nondiagonal elements will vanish. As a consequence of this orientation 
and an indication of it, if the angular velocity is along one such realigned principal axis, 
the angular velocity and the angular momentum will be parallel. As an illustration, the 
stability of rotation is used by football players when they throw the ball spinning about its 
long principal axis. 

Eigenvectors, Eigenvalues 

It is instructive to consider a geometrical picture of this problem. If the inertia matrix I is 
multiplied from each side by a unit vector of variable direction, n = (a, ft, y), then in the 
Dirac bracket notation of Section 3.2, 

(n|l|n} = 7, (3.129) 

where I is the moment of inertia about the direction n and a positive number (scalar). 
Carrying out the multiplication, we obtain 

/ = I xx a 2 + lyyft 2 + I zz y 2 + 2 lxydft + 2 I xz ay + 2 I yz fty, (3.130) 

a positive definite quadratic form that must be an ellipsoid (see Fig. 3.5). From analytic 
geometry it is known that the coordinate axes can always be rotated to coincide with the 
axes of our ellipsoid. In many elementary cases, especially when symmetry is present, these 
new axes, called the principal axes , can be found by inspection. We can find the axes by 
locating the local extrema of the ellipsoid in terms of the variable components of n, subject 
to the constraint n 2 = 1. To deal with the constraint, we introduce a Lagrange multiplier A, 
(Section 17.6). Differentiating (n|l|n) — A(n|n), 

— ({n\\\n)-X{n\n))=2j2 I jkn k -2Xn j =0, j = 1,2,3 (3.131) 

dn J k 

yields the eigenvalue equations 

l|n> = A|n>. 

|l, The moment of inertia matrix may also be developed from the kinetic energy of a rotating body, T = l/2(w|l| to). 


(3.132) 
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n 3 



Figure 3.5 Moment of inertia ellipsoid. 


The same result can be found by purely geometric methods. We now proceed to develop 
a general method of finding the diagonal elements and the principal axes. 

If R -1 = R is the real orthogonal matrix such that n' = Rn, or n') = R|n> in Dirac 
notation, are the new coordinates, then we obtain, using (n'|R = (n| in Eq. (3.132), 

(n|l|n> = (n'|RIR|n') = l[n\ 2 + lW 2 2 + (3.133) 

where the /' > 0 are the principal moments of inertia. The inertia matrix I' in Eq. (3.133) 
is diagonal in the new coordinates, 

_ (i[ o 0\ 

|'= R|R= 0 /' 0 . (3.134) 

\0 0 I'J 

If we rewrite Eq. (3.134) using R" 1 = R in the form 

RI' = IR (3.135) 

and take R = (vi, V2, V3) to consist of three column vectors, then Eq. (3.135) splits up into 
three eigenvalue equations, 

IV| = 7/v,, t = l,2,3 (3.136) 


with eigenvalues 7/ and eigenvectors v, . The names were introduced from the German 
literature on quantum mechanics. Because these equations are linear and homogeneous 
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(for fixed i ), by Section 3.1 their determinants have to vanish: 


' 11-4 

hi 

hi 



hi 

hi - I'i 

hi 

= 0 . 

( 3 . 137 ) 

hi 

hi 

hi ~ l\ 




Replacing the eigenvalue I- by a variable X times the unit matrix 1, we may rewrite 
Eq. (3.136) as 


(I — A.1 )|v> = 0. 

The determinant set to zero, 

|l - A.11 =0, 


(3.1360 


(3.1370 


is a cubic polynomial in X; its three roots, of course, are the Substituting one root at 
a time back into Eq. (3.136) (or (3.1360), we can find the corresponding eigenvectors. 
Because of its applications in astronomical theories, Eq. (3.137) (or (3.1370) is known as 
the secular equation. 20 The same treatment applies to any real symmetric matrix I, except 
that its eigenvalues need not all be positive. Also, the orthogonality condition in Eq. (3.87) 
for R say that, in geometric terms, the eigenvectors v,- are mutually orthogonal unit vectors. 
Indeed they form the new coordinate system. The fact that any two eigenvectors v,\ xj are 
orthogonal if I- ^ /' follows from Eq. (3.136) in conjunction with the symmetry of I by 
multiplying with v ; - and v/, respectively, 

(v/|l|v/) = I-Vj ■ x, = (v;|l|v/> = I'jXi ■ Xj. (3.138a) 


Since /' ^ /'. and Eq. (3.138a) implies that (/'. — /')v; • Xj = 0, so v,- • v ; - = 0. 

We can write the quadratic forms in Eq. (3.133) as a sum of squares in the original 
coordinates |n), 



because the rows of the rotation matrix in n' = Rn, or 


( n\ ) 

/vi-n\ 


n' 2 

= 1 v 2 n 1 


\ n lJ 

\xi-nj 


(3.138b) 


componentwise, are made up of the eigenvectors v,-. The underlying matrix identity. 


i 


(3.138c) 


20 Equation (3.126) will take on this form when o) is along one of the principal axes. Then L = Xco and \(o = Xoo. In the mathe¬ 
matics literature A. is usually called a characteristic value, co a characteristic vector. 
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may be viewed as the spectral decomposition of the inertia tensor (or any real symmetric 
matrix). Here, the word spectral is just another term for expansion in terms of its eigen¬ 
values. When we multiply this eigenvalue expansion by (n| on the left and |n) on the right 
we reproduce the previous relation between quadratic forms. The operator P; = |v,) (v,-1 is 
a projection operator satisfying Pf = P, that projects the ;th component ?/;,■ of any vector 
|w) = ^ ■ wj\\j) that is expanded in terms of the eigenvector basis | vy >. This is verified 
by 


^•|w) = ^ Wj\\i){\i\\j) = Wi\\i)=\i • w|v,->. 
j 


Finally, the identity 


X! I v * >< v i i = 1 


expresses the completeness of the eigenvector basis according to which any vector |w) = 
JL Wi | v, ) can be expanded in terms of the eigenvectors. Multiplying the completeness 
relation by |w) proves the expansion |w) = JT (v,- |w)|v,-). 

An important extension of the spectral decomposition theorem applies to commuting 
symmetric (or Hermitian) matrices A, B: If [A, B] = 0, then there is an orthogonal (unitary) 
matrix that diagonalizes both A and B; that is, both matrices have common eigenvectors if 
the eigenvalues are nondegenerate. The reverse of this theorem is also valid. 

To prove this theorem we diagonalize A : Av, = a, v, . Multiplying each eigenvalue equa¬ 
tion by B we obtain BAv, = a,Bv, = A(Bv ; ), which says that Bv, is an eigenvector of A 
with eigenvalue a,-. Hence Bv, = /;, v, with real Conversely, if the vectors v, are com¬ 
mon eigenvectors of A and B, then ABv, = A/;, v, = a,/;, v, = BAv;. Since the eigenvec¬ 
tors v,- are complete, this implies AB = BA. 


Hermitian Matrices 


For complex vector spaces, Hermitian and unitary matrices play the same role as symmetric 
and orthogonal matrices over real vector spaces, respectively. First, let us generalize the 
important theorem about the diagonal elements and the principal axes for the eigenvalue 
equation 


A|r> = A|r>, 


(3.139) 


We now show that if A is a Hermitian matrix, 21 its eigenvalues are real and its eigenvectors 
orthogonal. 

Let \j and Xj be two eigenvalues and |r, } and r ; ), the corresponding eigenvectors of A, 
a Hermitian matrix. Then 


A|r,-> = A.;|r;), 
A|ry> = A. y -|ry). 


21 If A is real, the Hermitian requirement reduces to a requirement of symmetry. 


(3.140) 

(3.141) 
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Equation (3.140) is multiplied by (r ; j: 


<r/|A|r,-> = Xi{rj\Ti). 

Equation (3.141) is multiplied by (r,-1 to give 

(3.142) 

{ri\A\rj) = Xj{ri\rj). 

Taking the adjoint 22 of this equation, we have 

(3.143) 

{Tj\Al\T i )=X* j {Tj\r i ), 

or 

(3.144) 

< r ; A r,-> = X*(rj\rj) 

since A is Hermitian. Subtracting Eq. (3.145) from Eq. (3.142), we obtain 

(3.145) 

(Xi-X*j)(Tj |r,)=0. 

(3.146) 

This is a general result for all possible combinations of i and j. First, let 
Eq. (3.146) becomes 

j — i. Then 

(A.j-^)<rj|rj>=0. 

Since (r,- |r, } =0 would be a trivial solution of Eq. (3.147), we conclude that 

(3.147) 

or Xj is real, for all i. 

Second, for i ^ j and Xj / Xj, 

(3.148) 

(Xj -Xj)(rj\rj) =0, 

or 

(3.149) 

( r ;l r /) = 0 , 

(3.150) 


which means that the eigenvectors of distinct eigenvalues are orthogonal, Eq. (3.150) being 
our generalization of orthogonality in this complex space . 23 

If Xj = Xi (degenerate case), |r,-> is not automatically orthogonal to |r,), but it may be 
made orthogonal. Consider the physical problem of the moment of inertia matrix again. 
If x\ is an axis of rotational symmetry, then we will find that A. 2 = A. 3. Eigenvectors |r 2 ) and 
| r3) are each perpendicular to the symmetry axis, |rj), but they lie anywhere in the plane 
perpendicular to |ri); that is, any linear combination of |r2) and |r3} is also an eigenvector. 
Consider ( 02 ^ 2 ) + 03 ^ 3 )) with 02 and 03 constants. Then 

A(fl 2 |r2> +fl3|r3>) = a 2 X 2 \r 2 ) + a^X^rj) 

= A 2 (fl2|r2> + a3|r3>)- (3.151) 

22 Note (r j | = |r j)^ for complex vectors. 

2 ^The corresponding theory for differential operators (Sturm-Liouville theory) appears in Section 10.2. The integral equation 
analog (Hilbert-Schmidt theory) is given in Section 16.4. 

24 We are assuming here that the eigenvectors of the ft-fold degenerate A; span the corresponding ft-dimensional space. This 
may be shown by including a parameter s in the original matrix to remove the degeneracy and then letting s approach zero 
(compare Exercise 3.5.30). This is analogous to breaking a degeneracy in atomic spectroscopy by applying an external magnetic 
field (Zeeman effect). 
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as is to be expected, for xi is an axis of rotational symmetry. Therefore, if |ri> and |r2) 
are fixed, ^ 3 } may simply be chosen to lie in the plane perpendicular to |rj> and also 
perpendicular to |r 2 >. A general method of orthogonalizing solutions, the Gram-Schmidt 
process (Section 3.1), is applied to functions in Section 10.3. 

The set of n orthogonal eigenvectors |r, } of our n x n Hermitian matrix A forms a 
complete set, spanning the «-dimensional (complex) space, JT |r,)(r, | = 1. This fact is 
useful in a variational calculation of the eigenvalues. Section 17.8. 

The spectral decomposition of any Hermitian matrix A is proved by analogy with real 
symmetric matrices 



with real eigenvalues kj and orthonormal eigenvectors |r ; ). 

Eigenvalues and eigenvectors are not limited to Hermitian matrices. All matrices have 
at least one eigenvalue and eigenvector. However, only Hermitian matrices have all eigen¬ 
vectors orthogonal and all eigenvalues real. 

Anti-Hermitian Matrices 

Occasionally in quantum theory we encounter anti-Hermitian matrices: 

A f = -A. 

Following the analysis of the first portion of this section, we can show that 

a. The eigenvalues are pure imaginary (or zero). 

b. The eigenvectors corresponding to distinct eigenvalues are orthogonal. 

The matrix R formed from the normalized eigenvectors is unitary. This anti-Hermitian 
property is preserved under unitary transformations. 

Example 3.5.1 Eigenvalues and Eigenvectors of a Real Symmetric Matrix 
Let 

(° 1 °\ 

A = I 1 0 0 . (3.152) 

\0 0 0 / 

The secular equation is 

—k 1 0 

1 —k 0=0, (3.153) 

0 0 —A 


or 


A(l 2 - 1)=0, 


( 3 . 154 ) 
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expanding by minors. The roots are X = —1,0, 1. To find the eigenvector corresponding to 
X — — 1, we substitute this value back into the eigenvalue equation, Eq. (3.139), 



With X = — 1, this yields 

x + y = 0, z — 0. 


(3.155) 


(3.156) 


Within an arbitrary scale factor and an arbitrary sign (or phase factor), (ri| = (1, — 1,0). 
Note that (for real |r) in ordinary space) the eigenvector singles out a line in space. The 
positive or negative sense is not determined. This indeterminancy could be expected if we 
noted that Eq. (3.139) is homogeneous in |r). For convenience we will require that the 
eigenvectors be normalized to unity, (iq |ri) = 1. With this condition, 

(,|| =Gr7i' 0 ) (3J57) 

is fixed except for an overall sign. For X = 0, Eq. (3.139) yields 

y = 0, x = 0, (3.158) 


(r 2 1 = (0,0, 1) is a suitable eigenvector. Finally, for X = 1, we get 


-x + y — 0, z — 0, 


(3.159) 


or 


<r3l = ';T7r 0 


(3.160) 


The orthogonality of iq, n, and r 3 , corresponding to three distinct eigenvalues, may be 
easily verified. 

The corresponding spectral decomposition gives 


A=( - 1)( ^-^ 0 


/ \ 


-2 0 \ 
0 


_ l l 

2 2 

0 0 0 


i 

~vT 

V 0 / 


(+1), M° 


(\ \ o\ 

2 2 0 

\0 0 0 / 



•s/2 

V o / 


+ 0(0,0,1) I 0 

1 



Example 3.5.2 Degenerate Eigenvalues 
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Consider 


The secular equation is 


or 




1 — A 
0 
0 


0 

—X 

1 


0 

1 

—X 


— 0 


(l-A)(A 2 -l)=0, A. = -1,1,1, 


a degenerate case. If X = — 1, the eigenvalue equation (3.139) yields 


2x = 0, y + z = 0. 

A suitable normalized eigenvector is 

For X = 1, we get 


—y + z = 0. 


(3.161) 

(3.162) 

(3.163) 

(3.164) 

(3.165) 

(3.166) 


Any eigenvector satisfying Eq. (3.166) is perpendicular to iq. We have an infinite number 
of choices. Suppose, as one possible choice, r 2 is taken as 

M = (°'7!'VI> (3167) 

which clearly satisfies Eq. (3.166). Then r 3 must be perpendicular to iq and may be made 
perpendicular to r 2 by 25 


r 3 =iq x r 2 = (1,0,0). 


(3.168) 


The corresponding spectral decomposition gives 


A= - 


1 1 


/ 0 \ 

j_ 

V2 

v-*/ 


o \ 


/ ° ( 

0 l 

\0 -2 \) 


1 1 

°’ 


0 0\ 


(0 

0 

\0 k u 


/°\ 

I 

V2 

1 


( 1 , 0 , 0 ) 



25 


The use of the cross product is limited to three-dimensional space (see Section 1.4). 
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Functions of Matrices 


Polynomials with one or more matrix arguments are well defined and occur often. Power 
series of a matrix may also be defined, provided the series converge (see Chapter 5) for 
each matrix element. For example, if A is any n x n matrix, then the power series 


exp (A) = A', 

7=0 ’ 


sin(A) = 

7=0 

OO 

cos (A) = ^2 
7=0 


—A J , 

(3.169a) 

j'- 


A 2J + 1 

(2 j + D! 

(3.169b) 


(3.169c) 

(2 7 )! 


are well defined n x n matrices. For the Pauli matrices err the Euler identity for real 9 and 
A: = 1,2, or 3 


exp O’crjfcf?) = 12 COS 0 + f sin f?. 


(3.170a) 


follows from collecting all even and odd powers of 9 in separate series using erj: = 1. For 
the 4x4 Dirac matrices a' ,k — 1 with (er - 7 *) 2 — 1 if j ^ k = 1,2 or 3 we obtain similarly 
(without writing the obvious unit matrix 14 anymore) 


exp (i<j' k 9) — cos 9 + icr' k sin$, 


(3.170b) 


while 


exp(/er 0 <: c) = coshf + icr ok sinh t, 


(3.170c) 


holds for real £ because ( ia 0k ) 2 = 1 for k= 1,2, or 3. 

For a Hermitian matrix A there is a unitary matrix U that diagonalizes it; that is, UAU' = 
[ai, a. 2 ,..., a n ]. Then the trace formula 


det(exp(A)) = exp(trace(A)) 


is obtained (see Exercises 3.5.2 and 3.5.9) from 


(3.171) 


det(exp(A)) = det(U exp(A)U 1 ) = det(exp(UAU *)) 

= detexp[flj,fl 2 , •••,««] = det[e fll , e ai , ...,e a ' 1 ] 

= ]~[ e" 1 = ex p(^ 7'/j = exp(trace(A)), 

using UA' U + = (UAU 1 )' in the power series Eq. (3.169a) for exp(UAU 1 ) and the product 
theorem for determinants in Section 3.2. 
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This trace formula is a special case of the spectral decomposition law for any (infinitely 
differentiable) function /(A) for Hermitian A: 


/(A) = £/(^)|r;><r,-k 


where |r ( ) are the common eigenvectors of A and A 7 . This eigenvalue expansion follows 
from A 7 |r;} = Xj\r multiplied by f ( ^(0)/jl and summed over j to form the Taylor 
expansion of /(A.,) and yield /(A)|r,) = /(A,)|r ( ). Finally, summing over i and using 
completeness we obtain /(A)JT ]r,-)(r/| = /(A.;)|r;)(r,-| = /(A), q.e.d. 


Example 3.5.3 Exponential of a Diagonal Matrix 


If the matrix A is diagonal like 


CT 3 = 


1 0 
0 -1 


then its nth power is also diagonal with its diagonal, matrix elements raised to the nth 
power: 

1 0 
v 0 (- 1 )" 

Then summing the exponential series, element for element, yields 


to )" = 


E oo 

n =0 n\ 

o 


o 

y-°o (-1)” 
0 n ! 


e 0 
0 1 


If we write the general diagonal matrix as A = [a \, a. 2 , ■ ■ ■, a n ] with diagonal elements a j , 
then A m = [a'". a"',, a„], and summing the exponentials elementwise again we obtain 
e A = [e a, ,e a2 , 

Using the spectral decomposition law we obtain directly 


0 <T3 _ +1 


e + (1,0) 


+ e -1 (0, 1) 


0 


0 

„-i 


Another important relation is the Baker-Hausdorff formula, 
exp(iG)Hexp(—/G) = H + [;G, H] + -[/G, [fG, H]] 


(3.172) 


which follows from multiplying the power series for exp(/G) and collecting the terms with 
the same powers of /G. Here we define 


[G, H] = GH - HG 


as the commutator of G and H. 

The preceding analysis has the advantage of exhibiting and clarifying conceptual rela¬ 
tionships in the diagonalization of matrices. However, for matrices larger than 3 x 3, or 
perhaps 4x4, the process rapidly becomes so cumbersome that we turn to computers and 
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iterative techniques. 26 One such technique is the Jacobi method for determining eigenval¬ 
ues and eigenvectors of real symmetric matrices. This Jacobi technique for determining 
eigenvalues and eigenvectors and the Gauss-Seidel method of solving systems of simulta¬ 
neous linear equations are examples of relaxation methods. They are iterative techniques 
in which the errors may decrease or relax as the iterations continue. Relaxation methods 
are used extensively for the solution of partial differential equations. 

Exercises 

3 . 5.1 (a) Starting with the orbital angular momentum of the /th element of mass, 

L i — r, x p,- = / 77 /r j x (« xr ; ), 

derive the inertia matrix such that L = I co, |L) = I |a>). 

(b) Repeat the derivation starting with kinetic energy 

Ti = ^mi(a) x r ,) 2 — ^(<w|I|m)^. 

3 . 5.2 Show that the eigenvalues of a matrix are unaltered if the matrix is transformed by a 
similarity transformation. 

This property is not limited to symmetric or Hermitian matrices. It holds for any ma¬ 
trix satisfying the eigenvalue equation, Eq. (3.139). If our matrix can be brought into 
diagonal form by a similarity transformation, then two immediate consequences are 

1. The trace (sum of eigenvalues) is invariant under a similarity transformation. 

2. The determinant (product of eigenvalues) is invariant under a similarity transfor¬ 
mation. 

Note. The invariance of the trace and determinant are often demonstrated by using the 
Cayley-Hamilton theorem: A matrix satisfies its own characteristic (secular) equation. 

3 . 5.3 As a converse of the theorem that Hermitian matrices have real eigenvalues and that 
eigenvectors corresponding to distinct eigenvalues are orthogonal, show that if 

(a) the eigenvalues of a matrix are real and 

(b) the eigenvectors satisfy rjr ; - = <5,-y — (r ,• | r y ), 

then the matrix is Hermitian. 

3 . 5.4 Show that a real matrix that is not symmetric cannot be diagonalized by an orthogonal 
similarity transformation. 

Hint. Assume that the nonsymmetric real matrix can be diagonalized and develop a 
contradiction. 

26 In higher-dimensional systems the secular equation may be strongly ill-conditioned with respect to the determination of its 
roots (the eigenvalues). Direct solution by computer may be very inaccurate. Iterative techniques for diagonalizing the original 
matrix are usually preferred. See Sections 2.7 and 2.9 of Press etal., loc. cit. 
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3 . 5.5 

3 . 5.6 

3 . 5.7 

3 . 5.8 

3 . 5.9 

3 . 5.10 

3 . 5.11 

3 . 5.12 

3 . 5.13 


The matrices representing the angular momentum components J x , J y , and J z are all 
Hermitian. Show that the eigenvalues of J 2 , where J 2 = 7 2 + J~ + J?, are real and 
nonnegative. 

A has eigenvalues A.,- and corresponding eigenvectors x, } . Show that A -1 has the same 
eigenvectors but with eigenvalues X ~ 1 . 

A square matrix with zero determinant is labeled singular. 

(a) If A is singular, show that there is at least one nonzero column vector v such that 

A|v> = 0. 

(b) If there is a nonzero vector |v> such that 

A|v> = 0, 

show that A is a singular matrix. This means that if a matrix (or operator) has zero 
as an eigenvalue, the matrix (or operator) has no inverse and its determinant is 
zero. 

The same similarity transformation diagonalizes each of two matrices. Show that the 
original matrices must commute. (This is particularly important in the matrix (Heisen¬ 
berg) formulation of quantum mechanics.) 

Two Hermitian matrices A and B have the same eigenvalues. Show that A and B are 
related by a unitary similarity transformation. 

Find the eigenvalues and an orthonormal (orthogonal and normalized) set of eigenvec¬ 
tors for the matrices of Exercise 3.2.15. 

Show that the inertia matrix for a single particle of mass m at (x, y. z) has a zero de¬ 
terminant. Explain this result in terms of the invariance of the determinant of a matrix 
under similarity transformations (Exercise 3.3.10) and a possible rotation of the coordi¬ 
nate system. 

A certain rigid body may be represented by three point masses: m\ — 1 at (1,1, —2), 
ni 2 = 2 at (—1, —1,0), and m 3 = 1 at (1, 1,2). 


(a) Find the inertia matrix. 

(b) Diagonalize the inertia matrix, obtaining the eigenvalues and the principal axes (as 
orthonormal eigenvectors). 

Unit masses are placed as shown in Fig. 3.6. 

(a) Find the moment of inertia matrix. 

(b) Find the eigenvalues and a set of orthonormal eigenvectors. 

(c) Explain the degeneracy in terms of the symmetry of the system. 


ANS. I = 



-1 

4 

-1 



ki = 2 

r 1 = (l/V3,l/V3,l/V3) 

^•2 = ^-3 = 5. 
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z 



x 


Figure 3.6 Mass sites for inertia tensor. 

3 . 5.14 A mass m i = 1/2 kg is located at (1, 1,1) (meters), a mass m 2 — 1/2 kg is at 
(—1, —1, —1). The two masses are held together by an ideal (weightless, rigid) rod. 

(a) Find the inertia tensor of this pair of masses. 

(b) Find the eigenvalues and eigenvectors of this inertia matrix. 

(c) Explain the meaning, the physical significance of the X — 0 eigenvalue. What is 
the significance of the corresponding eigenvector? 

(d) Now that you have solved this problem by rather sophisticated matrix techniques, 
explain how you could obtain 

(1) X — 0 and X =? — by inspection (that is, using common sense). 

(2) r; = o =? — by inspection (that is, using freshman physics). 

3 . 5.15 Unit masses are at the eight corners of a cube (±1, ±1, ±1). Find the moment of inertia 
matrix and show that there is a triple degeneracy. This means that so far as moments of 
inertia are concerned, the cubic structure exhibits spherical symmetry. 

Find the eigenvalues and corresponding orthonormal eigenvectors of the following ma¬ 
trices (as a numerical check, note that the sum of the eigenvalues equals the sum of the 
diagonal elements of the original matrix. Exercise 3.3.9). Note also the correspondence 
between det A = 0 and the existence of X = 0, as required by Exercises 3.5.2 and 3.5.7. 

/ 1 0 

3 . 5.16 A = 0 1 0 . 

\i 0 l) 

ANS. A = 0, 1,2. 


3.5.17 A = 


1 V2 0 
V 2 0 0 
0 0 0 


ANS. A = -1,0,2. 
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3 . 5.18 


3 . 5.19 


3 . 5.20 


3 . 5.21 


3 . 5.22 


3 . 5.23 


3 . 5.24 


3 . 5.25 


3 . 5.26 


A = 


A = 


A = 


A = 


A = 


A = 


A = 


A = 


A = 



1 0 
0 1 
1 1 


V8 

1 

V8 


0 0 
1 1 
1 1 


0 

1 

V2 


1 0 
0 1 
1 0 


0 0 
1 1 
1 1 


1 1 
0 1 
1 0 


-1 

1 

-1 


1 1 
1 1 
1 1 





ANS. A. = —1,1,2. 


ANS. A. — —3, 1,5. 


ANS. 1 = 0, 1,2. 


ANS. A = —1,1,2. 


ANS. 1 = -V2, 0, -Jl. 


ANS. A. = 0,2,2. 


ANS. A. = —1, —1,2. 


ANS. A = —1,2,2. 


ANS. A = 0,0, 3. 
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(5 0 2\ 

3 . 5.27 A = 0 1 0 . 

\2 0 2 / 

ANS. A = 1,1,6. 

I 1 1 °\ 

3 . 5.28 A = 1 1 0 . 

\0 0 0 / 

ANS. A = 0,0,2. 

/ 5 0 V3\ 

3 . 5.29 A = 0 3 0 . 

\V3 0 3 ) 

ANS. A = 2, 3,6. 

3 . 5.30 (a) Determine the eigenvalues and eigenvectors of 

1 e 
£ 1 

Note that the eigenvalues are degenerate for £ = 0 but that the eigenvectors are 
orthogonal for all £ ^ 0 and £ —> 0. 

(b) Determine the eigenvalues and eigenvectors of 

1 1 
£" 1 


Note that the eigenvalues are degenerate for £ = 0 and that for this (nonsymmetric) 
matrix the eigenvectors (£ = 0) do not span the space. 

(c) Find the cosine of the angle between the two eigenvectors as a function of e for 
0 < £ < 1 . 

3.5.31 (a) Take the coefficients of the simultaneous linear equations of Exercise 3.1.7 to be 

the matrix elements cijj of matrix A (symmetric). Calculate the eigenvalues and 
eigenvectors. 

(b) Form a matrix R whose columns are the eigenvectors of A, and calculate the triple 
matrix product RAR. 

ANS. A = 3.33163. 

3.5.32 Repeat Exercise 3.5.31 by using the matrix of Exercise 3.2.39. 

3.5.33 Describe the geometric properties of the surface 

x 2 + 2 xy + 2y 2 + 2yz + z 2 = 1 • 


How is it oriented in three-dimensional space? Is it a conic section? If so, which kind? 
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Table 3.1 


Matrix 

Eigenvalues 

Eigenvectors 

(for different eigenvalues) 

Hermitian 

Real 

Orthogonal 

Anti-Hermitian 

Pure imaginary (or zero) 

Orthogonal 

Unitary 

Unit magnitude 

Orthogonal 

Normal 

If A has eigenvalue A, 

Orthogonal 


A' has eigenvalue A.* 

A and A^ have the 
same eigenvectors 


3.5.34 


For a Hermitian n x n matrix A with distinct eigenvalues Xj and a function /, show 
that the spectral decomposition law may be expressed as 


/(A) = £/(*;) 

;=i 


rwA-td 


This formula is due to Sylvester. 


3.6 Normal Matrices 

In Section 3.5 we concentrated primarily on Hermitian or real symmetric matrices and 
on the actual process of finding the eigenvalues and eigenvectors. In this section 27 we 
generalize to normal matrices, with Hermitian and unitary matrices as special cases. The 
physically important problem of normal modes of vibration and the numerically important 
problem of ill-conditioned matrices are also considered. 

A normal matrix is a matrix that commutes with its adjoint, 

[A, A 7 ] = 0. 

Obvious and important examples are Hermitian and unitary matrices. We will show that 
normal matrices have orthogonal eigenvectors (see Table 3.1). We proceed in two steps. 

I. Let A have an eigenvector |x) and corresponding eigenvalue X. Then 

A|x>=k|x> (3.173) 

or 

(A — A1) |x) = 0. (3.174) 

For convenience the combination A — A.1 will be labeled B. Taking the adjoint of 
Eq. (3.174), we obtain 

<x|(A-A.l) t = 0= (x|B f . (3.175) 

Because 

[(A - Xl)\ (A - kl)] = [A, A'] = 0, 

27 Normal matrices are the largest class of matrices that can be diagonalized by unitary transformations. For an extensive discus¬ 
sion of normal matrices, see P. A. Macklin, Normal matrices for physicists. Am. J. Phys. 52: 513 (1984). 
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we have 


[B, B' ] = 0. (3.176) 

The matrix B is also normal. 

From Eqs. (3.174) and (3.175) we form 

(x|B + B|x> = 0. (3.177) 

This equals 

(x|BB t |x}=0 (3.178) 

by Eq. (3.176). Now Eq. (3.178) may be rewritten as 

(B + |x» t (B t |x»=0. (3.179) 

Thus 

B 1 |x) = (A + — A*l)|x) = 0. (3.180) 

We see that for normal matrices. A 1 has the same eigenvectors as A but the complex con¬ 
jugate eigenvalues. 

II. Now, considering more than one eigenvector-eigenvalue, we have 


A|x,-> = A.,jx ( -), (3.181) 

A|x;> = ^|x;>. (3.182) 

Multiplying Eq. (3.182) from the left by (x,-1 yields 

(Xj|A|x ; -> = Xj(xi\xj). (3.183) 

Taking the transpose of Eq. (3.181), we obtain 

(x/|A= (A 1 '|x,-)) t . (3.184) 

From Eq. (3.180), with A' having the same eigenvectors as A but the complex conjugate 
eigenvalues, 

(A t |x,» t = (A*|x 1 » t =Mx / |. (3.185) 

Substituting into Eq. (3.183) we have 

Xj(xi\xj) — Xj{Xi\Xj) 


or 


(A.,- — \j)(Xj\Xj) = 0. (3.186) 

This is the same as Eq. (3.149). 

For Xj ^ Xj , 

{Xj\xj)=0. 

The eigenvectors corresponding to different eigenvalues of a normal matrix are orthogo¬ 
nal. This means that a normal matrix may be diagonalized by a unitary transformation. The 
required unitary matrix may be constructed from the orthonormal eigenvectors as shown 
earlier, in Section 3.5. 

The converse of this result is also true. If A can be diagonalized by a unitary transfor¬ 
mation, then A is normal. 
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Normal Modes of Vibration 

We consider the vibrations of a classical model of the CO 2 molecule. It is an illustration of 
the application of matrix techniques to a problem that does not start as a matrix problem. It 
also provides an example of the eigenvalues and eigenvectors of an asymmetric real matrix. 


Example 3.6.1 normal modes 


Consider three masses on the x-axis joined by springs as shown in Fig. 3.7. The spring 
forces are assumed to be linear (small displacements, Hooke’s law), and the mass is con¬ 
strained to stay on the x-axis. 

Using a different coordinate for each mass, Newton’s second law yields the set of equa¬ 
tions 

k 

x\ = - —Ax 1 -x 2 ) 

M 

k k 

xi = -(x 2 -xi) -(X 2 -X 3 ) (3.187) 

m in 

k 

X3 =-(X3 — Xt). 

M 

The system of masses is vibrating. We seek the common frequencies, co, such that all 
masses vibrate at this same frequency. These are the normal modes. Let 

Xi=Xioe ia,t , i = 1,2,3. 


Substituting this set into Eq. (3.187), we may rewrite it as 


/ — 

M 

k 

M 

0 \ 

(x\^ 

i 0 ( X1 ) 


__L 

m 

2 k 

m 

m 

1 X2 

— +or x 2 , 

(3.188) 

V 0 

k 

M 

— ) 
M / 

\*3/ 

\X 3 / 



with the common factor e l(ot divided out. We have a matrix-eigenvalue equation with the 
matrix asymmetric. The secular equation is 

,2 


M 


_Jc_ 

M 

2 -t-a? 

m 

_k_ 

M 


0 


= 0 . 


(3.189) 



k 


k 


M 


m 


M 


Figure 3.7 Double oscillator. 
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This leads to 


The eigenvalues are 




= 0 . 


or = 0, 


k 

M' 



2 k 

m 


all real. 

The corresponding eigenvectors are determined by substituting the eigenvalues back into 
Eq. (3.188) one eigenvalue at a time. For &r = 0, Eq. (3.188), yields 


XI — X2 — 0, —X\ + 2x2 — X 3 — 0, — X2 + X 3 = 0. 


Then we get 


28 


X] —X2 —X 3 . 

This describes pure translation with no relative motion of the masses and no vibration. 

For ur — k/M. Eq. (3.188) yields 

x\ = — * 3 , X2 — 0 . 

The two outer masses are moving in opposite direction. The central mass is stationary. 

For or — k/M + 2k/in, the eigenvector components are 

2 M 

X\ —X3, XT — - Xl. 

m 

The two outer masses are moving together. The central mass is moving opposite to the two 
outer ones. The net momentum is zero. 

Any displacement of the three masses along the x-axis can be described as a linear 
combination of these three types of motion: translation plus two forms of vibration. ■ 


Ill-Conditioned Systems 


A system of simultaneous linear equations may be written as 

A|x) = |y> or A“‘ |y> = |x), (3.190) 


with A and |y) known and |x) unknown. When a small error in |y) results in a larger error 
in |x), then the matrix A is called ill-conditioned. With |<5x) an error in |x) and |<Sx) an error 
in |y), the relative errors may be written as 


(Sx|5x) 


1/2 


<K(A) 


(ty|3y) 
L <yly> 


1/2 


(3.191) 


Here K (A), a property of matrix A, is labeled the condition number. For A Hermitian one 
form of the condition number is given by 28 


K( A) = 


I A- |n 


I A-1 r 


(3.192) 


G. E. Forsythe, and C. B. Moler, Computer Solution of Linear Algebraic Systems. Englewood Cliffs, NJ, Prentice Hall (1967). 
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An approximate form due to Turing 29 is 

K(A) = n[A ij ] m!lx [AT j 1 ] m!ix , (3.193) 

in which n is the order of the matrix and [A,j] max is the maximum element in A. 


Example 3.6.1 an ill-conditioned matrix 


A common example of an ill-conditioned matrix is the Hilbert matrix, = (i + j — 1)" 1 . 
The Hilbert matrix of order 4, H 4 , is encountered in a least-squares fit of data to a third- 
degree polynomial. We have 


(\ i 4 


H 4 = 


1 

5 
1 

6 


\ I I i i / 

\4 5 6 7/ 

The elements of the inverse matrix (order n ) are given by 


(- 1/+ 2 


_ v - w - (n + i — l)!(n + j — 1)! 

1 " )iJ ~ i + j - r [(i - mj - l)!] 2 (n - Wn - j)\ 


For n — 4, 


(3.194) 


(3.195) 


/ 16 

-120 

240 

-140 \ 

-120 

1200 

-2700 

1680 

240 

-2700 

6480 

-4200 

y —140 

1680 

-4200 

2800 j 


From Eq. (3.193) the Turing estimate of the condition number for H 4 becomes 


(3.196) 


^Turing =4xlx 6480 
= 2.59 X 10 4 . 


This is a warning that an input error may be multiplied by 26,000 in the calculation 
of the output result. It is a statement that H 4 is ill-conditioned. If you encounter a highly 
ill-conditioned system, you have two alternatives (besides abandoning the problem). 


(a) Try a different mathematical attack. 

(b) Arrange to carry more significant figures and push through by brute force. 


As previously seen, matrix eigenvector-eigenvalue techniques are not limited to the so¬ 
lution of strictly matrix problems. A further example of the transfer of techniques from one 
area to another is seen in the application of matrix techniques to the solution of Fredholm 
eigenvalue integral equations. Section 16.3. In turn, these matrix techniques are strength¬ 
ened by a variational calculation of Section 17.8. ■ 


-^Compare J. Todd, The Condition of the Finite Segments of the Hilbert Matrix, Applied Mathematics Series No. 313. Washing¬ 
ton, DC: National Bureau of Standards. 
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Exercises 


3.6.1 Show that every 2x2 matrix has two eigenvectors and corresponding eigenvalues. The 
eigenvectors are not necessarily orthogonal and may be degenerate. The eigenvalues are 
not necessarily real. 

3.6.2 As an illustration of Exercise 3.6.1, find the eigenvalues and corresponding eigenvectors 
for 



Note that the eigenvectors are not orthogonal. 


ANS.A.i=0,ri = (2,-l); 
^ 2 =4, r 2 = (2,l). 


If A is a 2 x 2 matrix, show that its eigenvalues A satisfy the secular equation 


A 2 — A trace (A) + detA = 0. 


3.6.4 Assuming a unitary matrix U to satisfy an eigenvalue equation Ur = Ar, show that the 
eigenvalues of the unitary matrix have unit magnitude. This same result holds for real 
orthogonal matrices. 

3.6.5 Since an orthogonal matrix describing a rotation in real three-dimensional space is a 
special case of a unitary matrix, such an orthogonal matrix can be diagonalized by a 
unitary transformation. 


(a) Show that the sum of the three eigenvalues is 1 + 2 cos (p, where q> is the net angle 
of rotation about a single fixed axis. 

(b) Given that one eigenvalue is 1, show that the other two eigenvalues must be e l<p 
and e~ lv> . 


Our orthogonal rotation matrix (real elements) has complex eigenvalues. 

3.6.6 A is an nth-order Hermitian matrix with orthonormal eigenvectors |x, } and real eigen¬ 
values Ai < A 2 < A 3 < • • • < A„. Show that for a unit magnitude vector |y), 

M < (y|A|y> < A„. 

3.6.7 A particular matrix is both Hermitian and unitary. Show that its eigenvalues are all ±1. 
Note. The Pauli and Dirac matrices are specific examples. 

3.6.8 For his relativistic electron theory Dirac required a set of four anticommuting matrices. 
Assume that these matrices are to be Hermitian and unitary. If these are n x n matrices, 
show that n must be even. With 2x2 matrices inadequate (why?), this demonstrates that 
the smallest possible matrices forming a set of four anticommuting, Hermitian, unitary 
matrices are 4 x 4. 



3.6 Normal Matrices 


237 


3.6.9 A is a normal matrix with eigenvalues X n and orthonormal eigenvectors |x„). Show that 
A may be written as 


A - ^ ^ Xfj |X„> (X fl | . 

n 


Hint. Show that both this eigenvector form of A and the original A give the same result 
acting on an arbitrary vector |y>. 

3.6.10 A has eigenvalues 1 and —1 and corresponding eigenvectors ( l (] ) and ( ( | ) ). Construct A. 


ANS. A = 


0 

-1 


3.6.11 A non-Hermitian matrix A has eigenvalues A, and corresponding eigenvectors |u, ). The 
adjoint matrix A’ has the same set of eigenvalues but different corresponding eigen¬ 
vectors, | v,- ). Show that the eigenvectors form a biorthogonal set, in the sense that 


<v;|u;>=0 for A*^A;. 

3.6.12 You are given a pair of equations: 


A|f„> = A„|g„> 

A|g„> = A„ |f„) with A real. 


(a) Prove that |f„) is an eigenvector of (AA) with eigenvalue Xj r 

(b) Prove that |g„> is an eigenvector of (AA) with eigenvalue X„. 

(c) State how you know that 

(1) The |f„) form an orthogonal set. 

(2) The |g„) form an orthogonal set. 

(3) A” is real. 


3.6.13 Prove that A of the preceding exercise may be written as 

A= ^A„|g„}<f„|, 

n 

with the |g„) and (f„| normalized to unity. 

Hint. Expand your arbitrary vector as a linear combination of |f„). 

3.6.14 Given 



(a) Construct the transpose A and the symmetric forms AA and AA. 

(b) From AA|g„) = A^|g„) find A„ and |g„). Normalize the |g„). 

(c) From AA|f„) = A^|g„) find A„ [same as (b)] and |f„). Normalize the |f„). 

(d) Verify that A|f„) = A„ |g„) and A|g„) = A„|f„). 

(e) Verify that A = x n |g„> <f„ |. 
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3.6.15 


3.6.16 


Given the eigenvalues X\ — 1, A .2 = — 1 and the corresponding eigenvectors 





(a) construct A; 

(b) verify that A|f„) = A„|g n ); 

(c) verify that A | g„ > = X n | f„ >. 



and 




ANSA =^(! 


This is a continuation of Exercise 3.4.12, where the unitary matrix U and the Hermitian 
matrix H are related by 


U = e iaH 


(a) If trace H = 0, show that det U = +1. 

(b) If det U = +1, show that trace H = 0. 

Hint. H may be diagonalized by a similarity transformation. Then interpreting the ex¬ 
ponential by a Maclaurin expansion, U is also diagonal. The corresponding eigenvalues 
are given by uj = exp(/a/i /). 

Note. These properties, and those of Exercise 3.4.12, are vital in the development of the 
concept of generators in group theory — Section 4.2. 

3.6.17 An n x n matrix A has n eigenvalues A-,. If B = e A , show that B has the same eigen¬ 
vectors as A, with the corresponding eigenvalues B, given by B, = exp (A/). 

Note. e A is defined by the Maclaurin expansion of the exponential: 

A , A A 2 A 3 

c -1+A+- + - + -... 

3.6.18 A matrix P is a projection operator (see the discussion following Eq. (3.138c)) satisfying 
the condition 

P 2 = P. 

Show that the corresponding eigenvalues (p 2 )x and p,_ satisfy the relation 

(p 2 ) A = (Px)~ — Px- 

This means that the eigenvalues of P are 0 and 1. 

3.6.19 In the matrix eigenvector-eigenvalue equation 

A|r,-> = A. ( jr,-), 

A is an n x n Hermitian matrix. For simplicity assume that its n real eigenvalues are 
distinct, X 1 being the largest. If |r) is an approximation to |r 1 ), 

n 

l r > = In) + ^S/|r/>, 

1=2 
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/ K k K / 

y—^lSSb- —S&S&S&SIj— m -^SlSSb- / 


Figure 3.8 Triple oscillator. 


show that 


(r|A|r) 

(r|r> 


<A| 


and that the error in Xj is of the order |S, |. Take 15,-1 <£. 1. 

Hint. The n |r ; ) form a complete orthogonal set spanning the n-dimensional (complex) 
space. 


3.6.20 Two equal masses are connected to each other and to walls by springs as shown in 
Fig. 3.8. The masses are constrained to stay on a horizontal line. 


(a) Set up the Newtonian acceleration equation for each mass. 

(b) Solve the secular equation for the eigenvectors. 

(c) Determine the eigenvectors and thus the normal modes of motion. 


3.6.21 Given a normal matrix A with eigenvalues Xj, show that A 1 has eigenvalues /.*, its 
real part (A + A*)/2 has eigenvalues IH(ky), and its imaginary part (A — A^)/2 i has 
eigenvalues %(Xj). 


Additional Readings 


Aitken, A. C., Determinants and Matrices. New York: Interscience (1956). Reprinted, Greenwood (1983). A read¬ 
able introduction to determinants and matrices. 

Barnett, S., Matrices: Methods and Applications. Oxford: Clarendon Press (1990). 

Bickley, W. G., and R. S. H. G. Thompson, Matrices — Their Meaning and Manipulation. Princeton, NJ: Van 
Nostrand (1964). A comprehensive account of matrices in physical problems, their analytic properties, and 
numerical techniques. 

Brown, W. C., Matrices and Vector Spaces. New York: Dekker (1991). 

Gilbert, J. and L., Linear Algebra and Matrix Theory. San Diego: Academic Press (1995). 

Heading, J., Matrix Theory for Physicists. London: Longmans, Green and Co. (1958). A readable introduction to 
determinants and matrices, with applications to mechanics, electromagnetism, special relativity, and quantum 
mechanics. 

Vein, R., and P. Dale, Determinants and Their Applications in Mathematical Physics. Berlin: Springer (1998). 

Watkins, D. S., Fundamentals of Matrix Computations. New York: Wiley (1991). 
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Chapter 4 


Group Theory 


Disciplined judgment, about what is neat 
and symmetrical and elegant has time and 
time again proved an excellent guide to 
how nature works 

Murray Gell-Mann 

4.1 Introduction to Group Theory 

In classical mechanics the symmetry of a physical system leads to conservation laws. 
Conservation of angular momentum is a direct consequence of rotational symmetry, which 
means invariance under spatial rotations. In the first third of the 20th century, Wigner and 
others realized that invariance was a key concept in understanding the new quantum phe¬ 
nomena and in developing appropriate theories. Thus, in quantum mechanics the concept 
of angular momentum and spin has become even more central. Its generalizations, isospin 
in nuclear physics and the flavor symmetry in particle physics, are indispensable tools 
in building and solving theories. Generalizations of the concept of gauge invariance of 
classical electrodynamics to the isospin symmetry lead to the electroweak gauge theory. 

In each case the set of these symmetry operations forms a group. Group theory is the 
mathematical tool to treat invariants and symmetries. It brings unification and formalization 
of principles, such as spatial reflections, or parity, angular momentum, and geometry, that 
are widely used by physicists. 

In geometry the fundamental role of group theory was recognized more than a cen¬ 
tury ago by mathematicians (e.g., Felix Klein’s Erlanger Program). In Euclidean geometry 
the distance between two points, the scalar product of two vectors or metric, does not 
change under rotations or translations. These symmetries are characteristic of this geom¬ 
etry. In special relativity the metric, or scalar product of four-vectors, differs from that of 
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Euclidean geometry in that it is no longer positive definite and is invariant under Lorentz 
transformations. 

For a crystal the symmetry group contains only a finite number of rotations at discrete 
values of angles or reflections. The theory of such discrete or finite groups, developed 
originally as a branch of pine mathematics, now is a useful tool for the development of 
crystallography and condensed matter physics. A brief introduction to this area appears in 
Section 4.7. When the rotations depend on continuously varying angles (the Euler angles 
of Section 3.3) the rotation groups have an infinite number of elements. Such continuous 
(or Lie 1 ) groups are the topic of Sections 4.2^1.6. In Section 4.8 we give an introduction 
to differential forms, with applications to Maxwell’s equations and topics of Chapters 1 
and 2, which allows seeing these topics from a different perspective. 

Definition of a Group 

A group G may be defined as a set of objects or operations, rotations, transformations, 
called the elements of G, that may be combined, or “multiplied,” to form a well-defined 
product in G, denoted by a *, that satisfies the following four conditions. 

1. If a and b are any two elements of G, then the product a * b is also an element of G, 
where b acts before a; or (a, b) —»• a * h associates (or maps) an element a * b of G 
with the pair (a, b) of elements of G. This property is known as “G is closed under 
multiplication of its own elements.” 

2. This multiplication is associative: (a * b) * c = a * (b * c). 

3. There is a unit element 2 1 in G such that 1 * a = a * 1 = a for every element a in G. 
The unit is unique: 1 = 1' * 1 = 1\ 

4. There is an inverse, or reciprocal, of each element a of G, labeled a -1 , such that 
a * a -1 = a~ l * a — 1. The inverse is unique: If a~ l and a!~ 1 are both inverses of a , 
then a ,_1 = a’~ l * {a * a'~ l ) = (a ,_1 * a) * a~ l — a~ l . 

Since the * for multiplication is tedious to write, it is customary to drop it and simply let it 
be understood. From now on, we write ab instead of a *b . 

• If a subset G' of G is closed under multiplication, it is a group and called a subgroup 
of G; that is, G' is closed under the multiplication of G. The unit of G always forms a 
subgroup of G. 

• If gg'g~ l is an element of G 1 for any g of G and g’ of G', then G' is called an in¬ 
variant subgroup of G. The subgroup consisting of the unit is invariant. If the group 
elements are square matrices, then gg f g -1 corresponds to a similarity transformation 
(see Eq. (3.100)). 

• If ab — ba for all a,b of G, the group is called abelian, that is, the order in products 
does not matter; commutative multiplication is often denoted by a + sign. Examples are 
vector spaces whose unit is the zero vector and — a is the inverse of a for all elements 
a in G. 

1 After the Norwegian mathematician Sophus Lie. 

2 Following E. Wigner, the unit element of a group is often labeled E, from the German Einheit, that is, unit, or just 1, or I for 
identity. 
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Example 4.1.1 Orthogonal and Unitary Groups 

Orthogonal n x n matrices form the group 0(«), and SO(n) if their determinants are +1 
(S stands for “special”). If 0/ = 0 ( _1 for i — 1 and 2 (see Section 3.3 for orthogonal 
matrices) are elements of O(n), then the product 

oTcb = o 2 6i = o-'o- 1 = (0i0 2 )-' 

is also an orthogonal matrix in O(n), thus proving closure under (matrix) multiplication. 
The inverse is the transpose (orthogonal) matrix. The unit of the group is the n -dimensional 
unit matrix 1„. A real orthogonal n x n matrix has n(n — l)/2 independent parameters. 
For n — 2, there is only one parameter: one angle. For n — 3, there are three independent 
parameters: the three Euler angles of Section 3.3. 

If O,• = 0 ( _1 (for i — 1 and 2) are elements of SO(«), then closure requires proving in 
addition that their product has determinant +1, which follows from the product theorem in 
Chapter 3. 

Likewise, unitary n x n matrices form the group U(«), and SU(n) if their determinants 
are +1. If Uj = U ( _1 (see Section 3.4 for unitary matrices) are elements of U(«), then 

(U,U 2 ) t = ulu\ = u^'ur 1 = (U i U 2 ) —1 , 

so the product is unitary and an element of U(«), thus proving closure under multiplication. 
Each unitary matrix has an inverse (its Hermitian adjoint), which again is unitary. 

If Uj = U ( r 1 are elements of SU(«), then closure requires us to prove that their product 
also has determinant +1, which follows from the product theorem in Chapter 3. ■ 

• Orthogonal groups are called Lie groups; that is, they depend on continuously varying 
parameters (the Euler angles and their generalization for higher dimensions); they are 
compact because the angles vary over closed, finite intervals (containing the limit of 
any converging sequence of angles). Unitary groups are also compact. Translations 
form a noncompact group because the limit of translations with distance d -> oo is not 
part of the group. The Lorentz group is not compact either. 

Homomorphism, Isomorphism 

There may be a correspondence between the elements of two groups: one-to-one, two-to- 
one, or many-to-one. If this correspondence preserves the group multiplication, we say 
that the two groups are homomorphic. A most important homomorphic correspondence 
between the rotation group SO(3) and the unitary group SU(2) is developed in Section 4.2. 
If the correspondence is one-to-one, still preserving the group multiplication, 3 then the 
groups are isomorphic. 

• If a group G is homomorphic to a group of matrices G\ then G' is called a represen¬ 
tation of G. If G and G' are isomorphic, the representation is called faithful. There 
are many representations of groups; they are not unique. 

3 Suppose the elements of one group are labeled g;. the elements of a second group fi L . Then g,- /j,- is a one-to-one correspon¬ 

dence for all values of i. If gjgj = g£ and hjhj = /?/.. then gr and /tg must be the corresponding group elements. 
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Example 4.1.2 rotations 


Another instructive example for a group is the set of counterclockwise coordinate rotations 
of three-dimensional Euclidean space about its "-axis. From Chapter 3 we know that such a 
rotation is described by a linear transformation of the coordinates involving a 3 x 3 matrix 
made up of three rotations depending on the Euler angles. If the z-axis is fixed, the linear 
transformation is through an angle q> of the xv-coordinate system to a new orientation in 
Eq. (1.8), Fig. 1.6, and Section 3.3: 

( x'\ / x\ / cos (p sin <p 0\ /x\ 

y' 1 = Rz(<P) I >1 = ( - sin <p cos <p 0 1 I y 1 (4.1) 

involves only one angle of the rotation about the /-axis. As shown in Chapter 3, the linear 
transformation of two successive rotations involves the product of the matrices correspond¬ 
ing to the sum of the angles. The product corresponds to two rotations, R : (<pi )R-(</>2), and 
is defined by rotating first by the angle cp2 and then by ip\ . According to Eq. (3.29), this 
corresponds to the product of the orthogonal 2x2 submatrices, 


cosy)i sinyq \ / cos <£>2 sin y >2 


y- sinyq cosyqy y — siny^ cosy> 2 / 

(4.2) 

_/ cos(yq + (P 2 ) sin(^i + (pi) \ 
y - sin(</9, + (pi) cos((pi +(P2)J' 

using the addition formulas for the trigonometric functions. The unity in the lower right- 
hand corner of the matrix in Eq. (4.1) is also reproduced upon multiplication. The product is 
clearly a rotation, represented by the orthogonal matrix with angle (p\+(p 2 - The associative 
group multiplication corresponds to the associative matrix multiplication. It is commuta¬ 
tive, or abelian, because the order in which these rotations are performed does not matter. 
The inverse of the rotation with angle (p is that with angle —(p. The unit corresponds to the 
angle q> — 0. Striking off the coordinate vectors in Eq. (4.1), we can associate the matrix 
of the linear transformation with each rotation, which is a group multiplication preserving 
one-to-one mapping, an isomorphism: The matrices form a faithful representation of the 
rotation group. The unity in the right-hand corner is superfluous as well, like the coordinate 
vectors, and may be deleted. This defines another isomorphism and representation by the 
2x2 submatrices: 


/ cos (p sin (p 0\ 

R,(y)) = — sin<p cos cp 0 -> R(<p) = 

Vo 01/ 


cos (p sirup 
— siny) cosy) 


The group’s name is SO(2), if the angle <p varies continuously from 0 to 2jt; SO(2) has 
infinitely many elements and is compact. 

The group of rotations R- is obviously isomorphic to the group of rotations in Eq. (4.3). 
The unity with angle ip — 0 and the rotation with ip = n form a finite subgroup. The finite 
subgroups with angles 2nm/n , n an integer and m = 0,1,..., n — 1 are cyclic; that is, the 
rotations R(27 T/«/h) = R(27r/n) m . ■ 
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In the following we shall discuss only the rotation groups SO («) and unitary groups 
SU(n) among the classical Lie groups. (More examples of finite groups will be given in 
Section 4.7.) 


Representations — Reducible and Irreducible 


The representation of group elements by matrices is a very powerful technique and has 
been almost universally adopted by physicists. The use of matrices imposes no significant 
restriction. It can be shown that the elements of any finite group and of the continuous 
groups of Sections 4.2^1.4 may be represented by matrices. Examples are the rotations 
described in Eq. (4.3). 

To illustrate how matrix representations arise from a symmetry, consider the station¬ 
ary Schrodinger equation (or some other eigenvalue equation, such as I = /,- i>i for the 
principal moments of inertia of a rigid body in classical mechanics, say), 

Hxj/ = Eif. (4.4) 


Let us assume that the Hamiltonian H stays invariant under a group G of transformations 
R in G (coordinate rotations, for example, for a central potential V ( r ) in the Hamiltonian 
//); that is, 

H r = RHR~ 1 =H, RH = HR. (4.5) 


Now take a solution i// of Eq. (4.4) and “rotate” it: x[r -> R >// . Then R\l/ has the same 
energy E because multiplying Eq. (4.4) by R and using Eq. (4.5) yields 


RHf = E(Rf) = (RHR~ l )RxJ/ = 7/(R^). 


(4.6) 


In other words, all rotated solutions Ri/r are degenerate in energy or form what physicists 
call a multiplet. For example, the spin-up and -down states of a bound electron in the 
ground state of hydrogen form a doublet, and the states with projection quantum numbers 
m — —/, —/ + I..... / of orbital angular momentum / form a multiplet with 21+1 basis 
states. 

Let us assume that this vector space Vf of transformed solutions has a finite dimen¬ 
sion n. Let i/q, \j/ 2 , ..., V'Vi be a basis. Since R x/rj is a member of the multiplet, we can 
expand it in terms of its basis. 


Rjfj ='Y2,r jk f k . (4.7) 

k 

Thus, with each R in G we can associate a matrix (rjk)- Just as in Example 4.1.2, two 
successive rotations correspond to the product of their matrices, so this map R -> (rjk) is a 
representation of G. It is necessary for a representation to be irreducible that we can take 
any element of Vf and, by rotating with all elements R of G, transform it into all other 
elements of Vf . If not all elements of Vf are reached, then Vf splits into a direct sum of 
two or more vector subspaces, Vf = Vi © Vi © • • • , which are mapped into themselves 
by rotating their elements. For example, the 2s state and 2 p states of principal quantum 
number n— 2 of the hydrogen atom have the same energy (that is, are degenerate) and form 
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a reducible representation, because the 2s state cannot be rotated into the 2p states, and 
vice versa (angular momentum is conserved under rotations). In this case the representation 
is called reducible. Then we can find a basis in Vf (that is, there is a unitary matrix U) so 
that 


U(r jir)U + 


r: 


V i ; J 


(4.8) 


for all R of G, and all matrices (rjk) have similar block-diagonal shape. Here ri, r 2 ,... 
are matrices of lower dimension than (rjk) that are lined up along the diagonal and the 0’s 
are matrices made up of zeros. We may say that the representation has been decomposed 
into ri + r 2 H-along with Vf — V\ ® V 2 © • • •. 

The irreducible representations play a role in group theory that is roughly analogous to 
the unit vectors of vector analysis. They are the simplest representations; all others can be 
built from them. (See Section 4.4 on Clebsch-Gordan coefficients and Young tableaux.) 


Exercises 


4.1.1 Show that an 11 x n orthogonal matrix has n ( n — l)/2 independent parameters. 

Hint. The orthogonality condition, Eq. (3.71), provides constraints. 

4.1.2 Show that an n x n unitary matrix has rr — 1 independent parameters. 

Hint. Each element may be complex, doubling the number of possible parameters. Some 
of the constraint equations are likewise complex and count as two constraints. 

4.1.3 The special linear group SL(2) consists of all 2 x 2 matrices (with complex elements) 
having a determinant of +1. Show that such matrices form a group. 

Note. The SL(2) group can be related to the full Lorentz group in Section 4.4, much as 
the SU(2) group is related to SO(3). 

4.1.4 Show that the rotations about the "-axis form a subgroup of SO(3). Is it an invariant 
subgroup? 

4.1.5 Show that if R. S, T are elements of a group G so that RS = T and R —»■ (r,/,), S — »■ 
(sjk) is a representation according to Eq. (4.7), then 

(j'ik ) (■''//,) — f Uk — ^inSnk 

' n 

that is, group multiplication translates into matrix multiplication for any group repre¬ 
sentation. 


4.2 Generators of Continuous Groups 

A characteristic property of continuous groups known as Lie groups is that the parameters 
of a product element are analytic functions 4 of the parameters of the factors. The analytic 

4 Analytic here means having derivatives of all orders. 
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nature of the functions (differentiability) allows us to develop the concept of generator and 
to reduce the study of the whole group to a study of the group elements in the neighborhood 
of the identity element. 

Lie’s essential idea was to study elements R in a group G that are infinitesimally close 
to the unity of G. Let us consider the SO(2) group as a simple example. The 2 x 2 ro¬ 
tation matrices in Eq. (4.2) can be written in exponential form using the Euler identity, 
Eq. (3.170a), as 

( cos q> sin <p \ 

I = I 2 cos <p + io 2 sin<p = expO'a^qo). (4.9) 

— sin ip cos q> I 

From the exponential form it is obvious that multiplication of these matrices is equivalent 
to addition of the arguments 

R(<P2)R(<Pi) = expO'CT 2 <P2)expO'(T2<i0i) = exp(/rx20pi + <p 2 )) = R(<pi + (p 2 )- 

Rotations close to 1 have small angle q> 0. 

This suggests that we look for an exponential representation 

R = exp(zeS) = 1 + isS + 0(e 2 ), s —»■ 0, (4.10) 

for group elements R in G close to the unity 1. The infinitesimal transformations are eS, 
and the S are called generators of G. They form a linear space because multiplication 
of the group elements R translates into addition of generators S. The dimension of this 
vector space (over the complex numbers) is the order of G, that is, the number of linearly 
independent generators of the group. 

If R is a rotation, it does not change the volume element of the coordinate space that it 
rotates, that is, det(R) = 1, and we may use Eq. (3.171) to see that 

det(R) = exp (trace (In R)) = exp(/e trace(S)) = 1 

implies etrace(S) = 0 and, upon dividing by the small but nonzero parameter e, that gen¬ 
erators are traceless, 

trace(S) = 0. (4.11) 

This is the case not only for the rotation groups SO (n) but also for unitary groups SU(«). 

If R of G in Eq. (4.10) is unitary, then ,S' f = S is Hermitian, which is also the case for 
SO(n) and SU(n). This explains why the extra i has been inserted in Eq. (4.10). 

Next we go around the unity in four steps, similar to parallel transport in differential 
geometry. We expand the group elements 

R( = exp(ie,-S,-) = 1 + ie-, S, - ^sfSj H-, 

(4.12) 

R~‘ = exp(—ie,-S,-) = 1 - (£/S, - \sjSr -|-, 

to second order in the small group parameter s, because the linear terms and several 
quadratic terms all cancel in the product (Fig. 4.1) 

R,- 1 R j 1 R/ R j — 1 + Si Sj [ S j , S/ ] + • • • , 

= l + SiSj^CpSk-i -, 

k 


(4.13) 
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when Eq. (4.12) is substituted into Eq. (4.13). The last line holds because the product in 
Eq. (4.13) is again a group element, R,y, close to the unity in the group G. Hence its 
exponent must be a linear combination of the generators S^, and its infinitesimal group 
parameter has to be proportional to the product £;£/. Comparing both lines in Eq. (4.13) 
we find the closure relation of the generators of the Lie group G, 

[S / ,S J -] = X! c yS*- (4-14) 

k 

The coefficients cf- are the structure constants of the group G. Since the commutator in 
Eq. (4.14) is antisymmetric in i and j, so are the structure constants in the lower indices. 



If the commutator in Eq. (4.14) is taken as a multiplication law of generators, we see 
that the vector space of generators becomes an algebra, the Lie algebra Q of the group G. 
An algebra has two group structures, a commutative product denoted by a + symbol (this 
is the addition of infinitesimal generators of a Lie group) and a multiplication (the commu¬ 
tator of generators). Often an algebra is a vector space with a multiplication, such as a ring 
of square matrices. For SU(/ + 1) the Lie algebra is called At, for SO(2l + 1) it is £>/, and 
for SO(2 /) it is V /, where l — 1,2,... is a positive integer, later called the rank of the Lie 
group G or of its algebra Q. 

Finally, the Jacobi identity holds for all double commutators 

[[S;, S ; ], S,] + [IS,. S,], Si] + [[S*. S,], S 7 ] = 0, (4.16) 

which is easily verified using the definition of any commutator [A, B] = AB — BA. When 
Eq. (4.14) is substituted into Eq. (4.16) we find another constraint on structure constants, 

^{cJ"[S m , St] + cJ k [S m , S,] + cjj!)[S m , S/]} = 0. (4.17) 

m 

Upon inserting Eq. (4.14) again, Eq. (4.17) implies that 
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where the common factor S„ (and the sum over n) may be dropped because the generators 
are linearly independent. Hence 


£{< 


.m w i r m n , m n 1 _ n 
ij c mk ' c jk c mi ' c ki c mj J 


(4.19) 


The relations (4.14), (4.15), and (4.19) form the basis of Lie algebras from which finite 
elements of the Lie group near its unity can be reconstructed. 

Returning to Eq. (4.5), the inverse of R is R 1 = exp(— isS). We expand Hr according 
to the Baker-Hausdorff formula, Eq. (3.172), 

H = Hr = exp(/eS)//exp(— ieS) = H + is[ S, H] — je 2 [S[S, //]] H- (4.20) 


We drop H from Eq. (4.20), divide by the small (but nonzero), e, and let e —> 0. Then 
Eq. (4.20) implies that the commutator 


[S, H] — 0. 


(4.21) 


If S and H are Hermitian matrices, Eq. (4.21) implies that S and H can be simultaneously 
diagonalized and have common eigenvectors (for matrices, see Section 3.5; for operators, 
see Schur’s lemma in Section 4.3). If S and H are differential operators like the Hamil¬ 
tonian and orbital angular momentum in quantum mechanics, then Eq. (4.21) implies that 
S and H have common eigenfunctions and that the degenerate eigenvalues of H can be 
distinguished by the eigenvalues of the generators S. These eigenfunctions and eigenval¬ 
ues, s, are solutions of separate differential equations. Si jr s = s i// v , so group theory (that 
is, symmetries) leads to a separation of variables for a partial differential equation that is 
invariant under the transformations of the group. 

For example, let us take the single-particle Hamiltonian 


h 2 l d 2 d 
2m r 2 dr dr 


h 2 

2 mr 2 


L 2 + V(r) 


that is invariant under SO(3) and, therefore, a function of the radial distance r, the radial 
gradient, and the rotationally invariant operator L 2 of SO(3). Upon replacing the orbital 
angular momentum operator L 2 by its eigenvalue /(/ + 1) we obtain the radial Schrodinger 
equation (ODE), 


HR,{r) = 


h 2 1 d 2 d 
2m r 2 dr dr 


h 2 l(l +1) 
2m r 2 


+ V(r) 


Rl(r) = EiR,(r), 


where R/(r) is the radial wave function. 

For cylindrical symmetry, the invariance of H under rotations about the z-axis would 
require H to be independent of the rotation angle (p, leading to the ODE 


HR m (z , p) — E m R m (z, p), 


with m the eigenvalue of L z = —id/d(p, the "-component of the orbital angular momentum 
operator. For more examples, see the separation of variables method for partial differen¬ 
tial equations in Section 9.3 and special functions in Chapter 12. This is by far the most 
important application of group theory in quantum mechanics. 

In the next subsections we shall study orthogonal and unitary groups as examples to 
understand better the general concepts of this section. 
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Rotation Groups SO(2) and SO(3) 

For SO(2) as defined by Eq. (4.3) there is only one linearly independent generator, < 72 , and 
the order of SO(2) is 1. We get rro from Eq. (4.9) by differentiation at the unity of SO(2), 
that is, ep — 0, 


= J)->- (422) 

For the rotations R,(<p) about the ’-axis described by Eq. (4.1), the generator is given 
by 


—idR{(p)/d(p\ v= Q = —i 


- sin (p cosy? 
-cos® —sin® 


-idR z {(p)/d(p\ v =o = S ; = 


/0 -i 0 \ 

i 0 0 

yO 0 0 ) 


(4.23) 


where the factor i is inserted to make S- Hermitian. The rotation H : {Sep) through an infin¬ 
itesimal angle S(p may then be expanded to first order in the small Sep as 

H z (Sep)=l 3 + iS(pS z . (4.24) 

A finite rotation R (<p) may be compounded of successive infinitesimal rotations 


RzOtyt + S(pi ) = (1 + /<$<piSz)(l + iS<p2 Sj). (4.25) 

Let Sep = ep/N for N rotations, with N -> oo. Then 

R.-(^) = lim [1 + (i<p/N) S C ]' V = exp(i>S z ). (4.26) 

N-*o o 


This form identifies S- as the generator of the group R-, an abelian subgroup of SO(3), 
the group of rotations in three dimensions with determinant +1. Each 3x3 matrix R- (<p) 
is orthogonal, hence unitary, and trace(S-) = 0, in accord with Eq. (4.11). 

By differentiation of the coordinate rotations 



/i 

0 

0 ^ 


/ COS0 

0 

— sin 6> \ 

R x(f) = 

0 

cos l// 

sin r/r 

R,(0) = 

0 

1 

0 


\0 

— sin \jr 

COS 1 jf ) 


y sin 0 

0 

cos 6 / 


we get the generators 


i 

o 

o 

0 ^ 


( ° 

0 

i N 

II 

c n 

0 0 

—i 

, Sy = 

0 

0 

0 

i 

V° i 

0 ) 



0 

0/ 


(4.27) 


(4.28) 


of R V (R V ), the subgroup of rotations about the x- (y-)axis. 
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Rotation of Functions and Orbital Angular Momentum 


In the foregoing discussion the group elements are matrices that rotate the coordinates. 
Any physical system being described is held fixed. Now let us hold the coordinates fixed 
and rotate a function i//(x, y, z) relative to our fixed coordinates. With R to rotate the 
coordinates, 

x' = Rx, (4.29) 

we define R on i Jr by 

R if{x, y, z ) = i/r'ix , y, z ) = ep'ix'). (4.30) 

In words, R operates on the function i jr, creating a new function i//' that is numerically 
equal to i/r(x'), where x' are the coordinates rotated by R. If R rotates the coordinates 
counterclockwise, the effect of R is to rotate the pattern of the function i// clockwise. 

Returning to Eqs. (4.30) and (4.1), consider an infinitesimal rotation again, ep -> Sep. 
Then, using R- Eq. (4.1), we obtain 

R z (8(p)ir(x, y, z) — if(x + y8(p, y — xSep , z). (4.31) 

The right side may be expanded to first order in the small Sep to give 

R z (Sep)\Jr(x, y, z) — ir(x, y, z) — Sep{xdejf/dy — ydi/f/dx] + O(Sep) 2 


— (1 — iS(pL z )\j/{x, y, z), (4.32) 

the differential expression in curly brackets being the orbital angular momentum i L- (Ex¬ 
ercise 1.8.7). Since a rotation of first ep and then Sep about the z-axis is given by 

R z {ep + Sep)x[r = R z (8ep)R z (ep)els = (1 - i8epL z )R z (ep)\/f ■ (4.33) 


we have (as an operator equation) 

dR z R z (ep + Sep) - R z (ep) 

-= lim - 

dep Sip^O Sep 

In this form Eq. (4.34) integrates immediately to 


* L-Rziv) ■ 


(4.34) 


R z (ep)=exp(-iepL z ). 


(4.35) 


Note that R-(^) rotates functions (clockwise) relative to fixed coordinates and that L z is 
the z component of the orbital angular momentum L. The constant of integration is fixed 
by the boundary condition R- (0) = 1. 

As suggested by Eq. (4.32), L z is connected to S- by 


L z = (x, y, z)S- 


/ d/dx\ 

3/3 v 
\3/3 z) 



so L x , L y , and L- satisfy the same commutation relations. 


[Li, Lj\ — iSjjkLq, 



(4.36) 


(4.37) 


as S.v, S v , and S- and yield the same structure constants isijk of SO(3). 
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SU (2) — SO (3) Homomorphism 


Since unitary 2x2 matrices transform complex two-dimensional vectors preserving their 
norm, they represent the most general transformations of (a basis in the Hilbert space of) 
spin j wave functions in nonrelativistic quantum mechanics. The basis states of this system 
are conventionally chosen to be 



corresponding to spin ^ up and down states, respectively. We can show that the special 
unitary group SU(2) of unitary 2x2 matrices with determinant +1 has all three Pauli 
matrices cr, as generators (while the rotations of Eq. (4.3) form a one-dimensional abelian 
subgroup). So SU(2) is of order 3 and depends on three real continuous parameters f , r/, f , 
which are often called the Cayley-Klein parameters. To construct its general element, we 
start with the observation that orthogonal 2x2 matrices are real unitary matrices, so they 
form a subgroup of SU(2). We also see that 

/ e la 0 \ 

\ 0 e~ ia ) 


is unitary for real angle a with determinant +1. So these simple and manifestly unitary ma¬ 
trices form another subgroup of SU(2) from which we can obtain all elements of SU(2), 
that is, the general 2x2 unitary matrix of determinant +1. For a two-component spin j 
wave function of quantum mechanics this diagonal unitary matrix corresponds to multipli¬ 
cation of the spin-up wave function with a phase factor e' a and the spin-down component 
with the inverse phase factor. Using the real angle i] instead of (p for the rotation matrix 
and then multiplying by the diagonal unitary matrices, we construct a 2 x 2 unitary matrix 
that depends on three parameters and clearly is a more general element of SU(2): 


Defining a 


0 


cos rj sin rj \ e 


W 0 


y 0 e 101 f y — sin rj cos rj J y 0 e J 
/ e'“cos r\ e'“ sin i] \ /e‘P 0 \ 

\-e-'“sin)/ e - '“cos?;yyO e~'P J 

/ e'(“ + ^cos?7 sin rj \ 

sin;; g-i(a+£) cos J 

; = £, a — ^ = >p, we have in fact constructed the general element of SU(2): 


uor, ii, o = 


' e'^ cos i] e'f sin rj ' 
— e~'t sin rj e ~cos rj 


a b 
-b* a* 


(4.38) 


To see this, we write the general SU(2) element as U = (" with complex numbers 
a,b,c,d so that det(U) = 1. Writing unitarity, U 1 = U -1 , and using Eq. (3.50) for the 
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inverse we obtain 




implying c = —£?*, d — a*, as shown in Eq. (4.38). It is easy to check that the determinant 
det(U) = 1 and that U 1 U = 1 = UU 1 hold. 

To get the generators, we differentiate (and drop irrelevant overall factors): 


-/3U/3% = o, );= o 



(4.39a) 


—f 3U/3?7|, 7= o,f=o 



(4.39b) 


To avoid a factor 1/sin?; for ?/ —»• 0 upon differentiating with respect to /, we use in¬ 
stead the right-hand side of Eq. (4.38) for U for pure imaginary b = i( J > with /> —> 0, so 
a = -y/l — P 2 from \a\ 2 + \b\ 2 — a 2 + p 2 — Differentiating such a U, we get the third 
generator. 


,-A/Vw 2 W \ = _.( Jzp 

w \ W y/l~P 2 ) (!=0 \ - *' 




(4.39c) 


The Pauli matrices are all traceless and Hermitian. 

With the Pauli matrices as generators, the elements Ui, U 2 , U 3 of SU(2) may be gener¬ 
ated by 


Ui = exp(/fli< 7 i/ 2 ), U? = exp (;'«2 ( 72 / 2 ), U 3 = exp (?' <73 03 / 2 ). (4.40) 


The three parameters a ; are real. The extra factor 1 /2 is present in the exponents to make 
Si = Gj /2 satisfy the same commutation relations. 


[S,.Sj] = isijkSk, 


(4.41) 


as the angular momentum in Eq. (4.37). 

To connect and compare our results, Eq. (4.3) gives a rotation operator for rotat¬ 
ing the Cartesian coordinates in the three-space R 3 . Using the angular momentum ma¬ 
trix S 3 , we have as the corresponding rotation operator in two-dimensional (complex) 
space Fk(</?) = exp(i<pai,/2). For rotating the two-component vector wave function (spinor) 
or a spin 1 /2 particle relative to fixed coordinates, the corresponding rotation operator is 
R-(^) = exp(— icpG^/2) according to Eq. (4.35). 

More generally, using in Eq. (4.40) the Euler identity, Eq. (3.170a), we obtain 


U j = cos 



+ ioj sin 



(4.42) 


Here the parameter a j appears as an angle, the coefficient of an angular momentum matrix¬ 
like (p in Eq. (4.26). The selection of Pauli matrices corresponds to the Euler angle rotations 
described in Section 3.3. 
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Figure 4.2 Illustration of 
M' = UMU t inEq. (4.43). 


As just seen, the elements of SU(2) describe rotations in a two-dimensional complex 
space that leave |zi | 2 + |Z 2 1 2 invariant. The determinant is +1. There are three independent 
real parameters. Our real orthogonal group SO(3) clearly describes rotations in ordinary 
three-dimensional space with the important characteristic of leaving x 2 + v 2 + z 2 invari¬ 
ant. Also, there are three independent real parameters. The rotation interpretations and the 
equality of numbers of parameters suggest the existence of some correspondence between 
the groups SU(2) and SO(3). Here we develop this correspondence. 

The operation of SU(2) on a matrix is given by a unitary transformation, Eq. (4.5), with 
R = U and Fig. 4.2: 

M' = UMU t . (4.43) 

Taking M to be a 2 x 2 matrix, we note that any 2x2 matrix may be written as a linear 
combination of the unit matrix and the three Pauli matrices of Section 3.4. Let M be the 
zero-trace matrix, 

( z x iy\ 

), (4.44) 

x + iy -z J 

the unit matrix not entering. Since the trace is invariant under a unitary similarity transfor¬ 
mation (Exercise 3.3.9), M' must have the same form, 

/ zl x' — iy'\ 

M' = x'o\ + y' 02 + z'o 3 — ( ) . (4.45) 

\x' + iy —z J 

The determinant is also invariant under a unitary transformation (Exercise 3.3.10). There¬ 
fore 


-(x 2 + y 2 + z 2 ) = ~(x' 2 + y' 2 + z' 2 ), (4.46) 

or x 2 + v 2 + z 2 is invariant under this operation of SU(2), just as with SO(3). Operations 
of SU(2) on M must produce rotations of the coordinates x, y, z appearing therein. This 
suggests that SU( 2 ) and SO(3) may be isomorphic or at least homomorphic. 
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We approach the problem of what this operation of SU(2) corresponds to by considering 
special cases. Returning to Eq. (4.38), let a = e l£ and b = 0, or 


U 3 = 




(4.47) 


In anticipation of Eq. (4.51), this U is given a subscript 3. 

Carrying out a unitary similarity transformation, Eq. (4.43), on each of the three Pauli 
it's of SU( 2 ), we have 


U3CT1U3 



/ 0 e 2 <n 

0 J ' 


We reexpress this result in terms of the Pauli 07 , as in Eq. (4.44), to obtain 


(4.48) 


l^xeriU^, = xo ] cos 2 ^ — xoi sin 2 |. 


(4.49) 


Similarly, 

U 3 VCT 2 U 3 = yo\ sin 2 f + y< 72 Cos 2 £, 

U 3 zct 3 U 3 = zer 3 . (4.50) 


From these double angle expressions we see that we should start with a 

halfangle: f = a/2. Then, adding Eqs. (4.49) and (4.50) and comparing with Eqs. (4.44) 

and (4.45), we obtain 


x' — x cos a + y sin a 

y' — — x sin a + y cos a (4.51) 


The 2x2 unitary transformation using U 3 (o-) is equivalent to the rotation operator R(«) 
ofEq. (4.3). 

The correspondence of 


and Ry(yS) and of 


U 2 O 8 ) = 


Ui(^) = 


cos p /2 

sin P/2 

— sin p /2 

cos p /2 

cos ^/2 

i sin <p /2 

i sin (p/2 

cos (p/2 


and Rj (cp) follow similarly. Note that U*(t/r) has the general form 

U*W) = I 2 cos i/f /2 + iak sin i/r/ 2 , 


(4.52) 


(4.53) 


(4.54) 


where k — 1,2, 3. 
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The correspondence 


U3(a) 


/ e '“/ 2 

° 1 

1 

/ cos a 

sin a 

°\ 

U 

e~ ia l 2 ) 

1 - 

— sin a 

l 0 

cos a 

0 

0 

1 / 


R z (a) 


(4.55) 


is not a simple one-to-one correspondence. Specifically, as a in R- ranges from 0 to 2n, 
the parameter in U 3 , a/2, goes from 0 to n. We find 


R z (a + 2n) — R z (a) 

U 3 (a + 27r) = ( Q _ g _ W2 =- y 3 («). (4-56) 


Therefore both U 3 (a) and 1 ) 3 ( 0 ! + 2it) — —U 3 (a) correspond to R-(a). The correspon¬ 
dence is 2 to 1, or SU(2) and SO(3) are homomorphic. This establishment of the corre¬ 
spondence between the representations of SU( 2 ) and those of SO(3) means that the known 
representations of SU( 2 ) automatically provide us with the representations of SO(3). 

Combining the various rotations, we find that a unitary transformation using 


U(a,/8, y) = U 3 (y)U 2 G8)U 3 (a) (4.57) 


corresponds to the general Euler rotation R-(y )R y (/l)R z (a). By direct multiplication. 


U(a, 0, y) — 


e 'T/2 

0 


0 \ / cos/ 1/2 

g-iy /2 J l-sin/J /2 


sin P/2\ /e ia ' 2 0 \ 

cos , 6/20 e ~'“/ 2 ) 


/ e i( Y +a)l 2 cos/3 / 2 e i( y- a ^ 2 smP/2\ 

~ \ - e -hx -«)/2 sin p/2 e -i(r+ci)/ 2 cos p / 2 J ' 

This is our alternate general form, Eq. (4.38), with 

£ = (y+a)/ 2 , V = P/ 2, £ = (y -a)/2. 

Thus, from Eq. (4.58) we may identify the parameters of Eq. (4.38) as 

a — e' (K+ “^ 2 cos/ 6/2 
b = e i{y - a)/2 smP/2. 


(4.58) 


(4.59) 


(4.60) 


SU (2)-Isospin and SU (3)-Flavor Symmetry 

The application of group theory to “elementary” particles has been labeled by Wigner 
the third stage of group theory and physics. The first stage was the search for the 32 
crystallographic point groups and the 230 space groups giving crystal symmetries — 
Section 4.7. The second stage was a search for representations such as of SO(3) and 
SU(2) — Section 4.2. Now in this stage, physicists are back to a search for groups. 

In the 1930s to 1960s the study of strongly interacting particles of nuclear and high- 
energy physics led to the SU(2) isospin group and the SU(3) flavor symmetry. In the 1930s, 
after the neutron was discovered, Heisenberg proposed that the nuclear forces were charge 
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Table 4.1 

Baryons with Spin 

^ Even Parity 



Mass (MeV) 

Y I 

h 

s - 

1321.32 


1 

2 

3° 

1314.9 

- 1 2 

+1 

xr 

1197.43 


-1 

x x° 

1192.55 

0 1 

0 

x+ 

1189.37 


+1 

A A 

1115.63 

0 0 

0 

n 

939.566 


1 

2 

N 

P 

938.272 

1 2 

+3 


independent. The neutron mass differs from that of the proton by only 1.6%. If this tiny 
mass difference is ignored, the neutron and proton may be considered as two charge (or 
isospin) states of a doublet, called the nucleon. The isospin I has z-projection It, = 1/2 
for the proton and It, — —1/2 for the neutron. Isospin has nothing to do with spin (the 
particle’s intrinsic angular momentum), but the two-component isospin state obeys the 
same mathematical relations as the spin 1 /2 state. For the nucleon, I — r /2 are the usual 
Pauli matrices and the ±1/2 isospin states are eigenvectors of the Pauli matrix T 3 — ( () _ t ). 
Similarly, the three charge states of the pion (tt + , jt°, :r~) form a triplet. The pion is the 
lightest of all strongly interacting particles and is the carrier of the nuclear force at long 
distances, much like the photon is that of the electromagnetic force. The strong interaction 
treats alike members of these particle families, or multiplets, and conserves isospin. The 
symmetry is the SU(2) isospin group. 

By the 1960s particles produced as resonances by accelerators had proliferated. The 
eight shown in Table 4.1 attracted particular attention . 5 The relevant conserved quantum 
numbers that are analogs and generalizations of L z and L 2 from SO(3) are It, and 1 2 for 
isospin and Y for hypercharge. Particles may be grouped into charge or isospin multiplets. 
Then the hypercharge may be taken as twice the average charge of the multiplet. For the 
nucleon, that is, the neutron-proton doublet, F = 2- ^(0+l)=l. The hypercharge and 
isospin values are listed in Table 4.1 for baryons like the nucleon and its (approximately 
degenerate) partners. They form an octet, as shown in Fig. 4.3, after which the corre¬ 
sponding symmetry is called the eightfold way. In 1961 Gell-Mann, and independently 
Ne’eman, suggested that the strong interaction should be (approximately) invariant under 
a three-dimensional special unitary group, SU(3), that is, has SU(3) flavor symmetry. 

The choice of SU(3) was based first on the two conserved and independent quantum 
numbers. Hi — It, and Ht = Y (that is, generators with [±3, F] = 0, not Casimir invariants; 
see the summary in Section 4.3) that call for a group of rank 2. Second, the group had 
to have an eight-dimensional representation to account for the nearly degenerate baryons 
and four similar octets for the mesons. In a sense, SU(3) is the simplest generalization of 
SU(2) isospin. Three of its generators are zero-trace Hermitian 3x3 matrices that contain 


5 A11 masses are given in energy units, 1 MeV = I (/ eV. 
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Y 



Figure 4.3 Baryon octet weight 
diagram for SU(3). 
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Figure 4.4 Baryon mass splitting. 

Altogether there are 3 2 — 1 = 8 generators for SU(3), which has order 8. From the com¬ 
mutators of these generators the structure constants of SU(3) can easily be obtained. 

Returning to the SU(3) flavor symmetry, we imagine the Hamiltonian for our eight 
baryons to be composed of three parts: 

H — //strong + //medium T" //electromagnetic' (4.62) 

The first part, //strong, has the SU(3) symmetry and leads to the eightfold degeneracy. 
Introduction of the symmetry-breaking term, // me dium- removes part of the degeneracy, 
giving the four isospin multiplets (E _ , E°), (£“, E , E + ), A, and N — ( p , n) different 
masses. These are still multiplets because //medium has SU(2)-isospin symmetry. Finally, 
the presence of charge-dependent forces splits the isospin multiplets and removes the last 
degeneracy. This imagined sequence is shown in Fig. 4.4. 

The octet representation is not the simplest SU(3) representation. The simplest repre¬ 
sentations are the triangular ones shown in Fig. 4.5, from which all others can be generated 
by generalized angular momentum coupling (see Section 4.4 on Young tableaux). The 
fundamental representation in Fig. 4.5a contains the u (up), d (down), and s (strange) 
quarks, and Fig. 4.5b contains the corresponding antiquarks. Since the meson octets can 
be obtained from the quark representations as qq , with 3 2 = 8 + 1 states, this suggests 
that mesons contain quarks (and antiquarks) as their constituents (see Exercise 4.4.3). The 
resulting quark model gives a successful description of hadronic spectroscopy. The reso¬ 
lution of its problem with the Pauli exclusion principle eventually led to the SU(3)-color 
gauge theory of the strong interaction called quantum chromodynamics (QCD). 

To keep group theory and its very real accomplishment in proper perspective, we should 
emphasize that group theory identifies and formalizes symmetries. It classifies (and some¬ 
times predicts) particles. But aside from saying that one part of the Hamiltonian has SU(2) 
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Figure 4.5 (a) Fundamental representation of SU(3), the weight diagram for 

the u, d, s quarks; (b) weight diagram for the antiquarks u,d,s. 


symmetry and another part has SU(3) symmetry, group theory says nothing about the par¬ 
ticle interaction. Remember that the statement that the atomic potential is spherically sym¬ 
metric tells us nothing about the radial dependence of the potential or of the wave function. 
In contrast, in a gauge theory the interaction is mediated by vector bosons (like the photon 
in quantum electrodynamics) and uniquely determined by the gauge covariant derivative 
(see Section 1.13). 

Exercises 

4.2.1 (i) Show that the Pauli matrices are the generators of SU(2) without using the para¬ 
meterization of the general unitary 2x2 matrix in Eq. (4.38). (ii) Derive the eight 
independent generators A.,- of SU(3) similarly. Normalize them so that tr (kj'/.j) = 28jj. 
Then determine the structure constants of SU(3). 

Hint. The k; are traceless and Hermitian 3x3 matrices. 

(iii) Construct the quadratic Casimir invariant of SU(3). 

Hint. Work by analogy with o^ 2 + cry + er| of SU(2) or L 2 of SO(3). 

4.2.2 Prove that the general form of a 2 x 2 unitary, unimodular matrix is 



with a*a + b*b = 1. 

4.2.3 Determine three SU(2) subgroups of SU(3). 

4.2.4 A translation operator T(a) converts i// (x) to i //(x + a), 

T (a)ir(x) = \[r (x + a). 
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In terms of the (quantum mechanical) linear momentum operator p x — —id/dx, show 
that T (a) = exp (iap x ), that is, p x is the generator of translations. 

Hint. Expand i jr(x + a) as a Taylor series. 

4.2.5 Consider the general SU(2) element Eq. (4.38) to be built up of three Euler rotations: 
(i) a rotation of a/2 about the z-axis, (ii) a rotation of b/2 about the new x-axis, and 
(iii) a rotation of c/2 about the new "-axis. (All rotations are counterclockwise.) Using 
the Pauli a generators, show that these rotation angles are determined by 

a — £ — £ + ^-=q'+Y 
b = 2 ij = /3 

c = % + £ — j = Y ~ 2 • 

Note. The angles a and b here are not the a and b of Eq. (4.38). 

4.2.6 Rotate a nonrelativistic wave function \jr — (\j/ f, i/fj) of spin 1/2 about the z-axis by 
a small angle dO. Find the corresponding generator. 

4.3 Orbital Angular Momentum 

The classical concept of angular momentum, L c i ass = r x p, is presented in Section 1.4 
to introduce the cross product. Following the usual Schrodinger representation of quantum 
mechanics, the classical linear momentum p is replaced by the operator —/V. The quantum 
mechanical orbital angular momentum operator becomes 6 

L qm = — ir x V. (4.63) 

This is used repeatedly in Sections 1.8, 1.9, and 2.4 to illustrate vector differential oper¬ 
ators. From Exercise 1.8.8 the angular momentum components satisfy the commutation 
relations 

[Li,Lj\=i£i jk L k . (4.64) 

The stjk is the Levi-Civita symbol of Section 2.9. A summation over the index k is under¬ 
stood. 

The differential operator corresponding to the square of the angular momentum 

L 2 = L • L = L 2 x + L 2 + L\ (4.65) 

may be determined from 

L • L = (r x p) • (r x p), (4.66) 

which is the subject of Exercises 1.9.9 and 2.5.17(b). Since L 2 as a scalar product is in¬ 
variant under rotations, that is, a rotational scalar, we expect [L 2 , L,] = 0, which can also 
be verified directly. 

Equation (4.64) presents the basic commutation relations of the components of the quan¬ 
tum mechanical angular momentum. Indeed, within the framework of quantum mechanics 
and group theory, these commutation relations define an angular momentum operator. We 
shall use them now to construct the angular momentum eigenstates and find the eigenval¬ 
ues. For the orbital angular momentum these are the spherical harmonics of Section 12.6. 

6 For simplicity, ti is set equal to 1. This means that the angular momentum is measured in units of h. 
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Ladder Operator Approach 

Let us start with a general approach, where the angular momentum J we consider may rep¬ 
resent an orbital angular momentum L, a spin ar /2, or a total angular momentum L + a/2, 
etc. We assume that 

1. J is an Hermitian operator whose components satisfy the commutation relations 

[Ji,Jj] = ieijkJk, [j 2 ,/;]=0. (4.67) 

Otherwise J is arbitrary. (See Exercise 4.3.1.) 

2 . XM) is simultaneously a normalized eigenfunction (or eigenvector) of .1- with eigen¬ 
value M and an eigenfunction 7 of J 2 , 

J Z \XM) — M\XM), J 2 \XM) = X\XM), (XM\XM) = 1. (4.68) 

We shall show that X — J (J + 1) and then find other properties of the \XM). The treat¬ 
ment will illustrate the generality and power of operator techniques, particularly the use of 
ladder operators. 8 

The ladder operators are defined as 

J+ = J x + iJy, J- — J x ~ 1 Jy ■ (4.69) 

In terms of these operators J 2 may be rewritten as 

J 2 = \(J+J- + J-J+) + J?. (4.70) 

From the commutation relations, Eq. (4.67), we find 

[J z ,J+] = +J+, [/*,/_] = -/_, [/+,/_] =2J Z . (4.71) 

Since J + commutes with J 2 (Exercise 4.3.1), 

J 2 (7+|AM» = i+(J 2 |AM)) = X(J+\XM)). (4.72) 

Therefore, J + \XM) is still an eigenfunction of J 2 with eigenvalue X, and similarly for 
J-\XM). But from Eq. (4.71), 

J Z J+ = J+(J Z + 1), (4.73) 

or 

J z (j+\kM )) = J+(J Z + 1)| XM) = (M + l)J+\kM). (4.74) 

7 That | XM) can be an eigenfunction of both J z and J 2 follows from [J z , J 2 ] = 0 in Eq. (4.67). For SU(2), (XM\XM) is the 
scalar product (of the bra and ket vector or spinors) in the bra-ket notation introduced in Section 3.1. For SO(3), |A.Af) is a 
function Y(0,(p) and | XM') isafunction Y'(0,(p) and the matrix element ( XM\XM') = fy=ofQ—oY*(0,(p)Y'(0,(p) sin 0 d6 d(p 
is their overlap. However, in our algebraic approach only the norm in Eq. (4.68) is used and matrix elements of the angular 
momentum operators are reduced to the norm by means of the eigenvalue equation for J z , Eq. (4.68), and Eqs. (4.83) and (4.84). 
8 Ladder operators can be developed for other mathematical functions. Compare the next subsection, on other Lie groups, and 
Section 13.1, for Hermite polynomials. 
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Therefore, J + \XM) is still an eigenfunction of J- but with eigenvalue M + 1 . J + has raised 
the eigenvalue by 1 and so is called a raising operator. Similarly,./_ lowers the eigenvalue 
by 1 and is called a lowering operator. 

Taking expectation values and using J% — J x , jl = J y , we get 

(XM\J 2 - J 2 \XM) - {XM\J 2 + J 2 \XM) = \j x \XM)f + \jy\XM)\ 2 

and see that X — M 2 > 0, so M is bounded. Let J be the largest M. Then J + \XJ) — 0, 
which implies J-J + \XJ) — 0. Hence, combining Eqs. (4.70) and (4.71) to get 

J 2 = J-J+ + Jz(Jz + 1). (4.75) 

we find from Eq. (4.75) that 

0=J-J+\XJ) = (J 2 -Jr - J Z )\XJ) = (X- J 2 - J)\XJ). 

Therefore 


k= /(/ + 1) >0, (4.76) 

with nonnegative J. We now relabel the states \XM) = \JM). Similarly, let J' be the 
smallest M. Then J-\J J') — 0. From 

J 2 = J+J- + J z (Jz - 1)- (4.77) 


we see that 

0=/ + /_|// , > = (J 2 + 7 ; .-/ 2 )|i/ , } = (A + / , -y ,2 )|// , ). (4.78) 

Hence 


X=J{J + 1) = J'(J'~ 1) = (-/)(-/- 1). 

So J' = —J, and M runs in integer steps from — J to +/, 

— J < M < J. (4.79) 

Starting from | J J) and applying /_ repeatedly, we reach all other states | J M). Hence the 
| JM) form an irreducible representation of SO(3) or SU(2); M varies and J is fixed. 
Then using Eqs. (4.67), (4.75), and (4.77) we obtain 

J-J+\JM) = [J(J + 1) - M(M+ l)]\JM) = (J - M)(J + M+1)\JM), 
J+J-\JM) = [/(/ + 1 ) - M(M - 1 )]| JM) = (J + M)(J -M+l)\JM). (4 ' 8 °' ) 

Because J + and ./_ are Hermitian conjugates, 

jl = J-, J1 = J+, (4.81) 

the eigenvalues in Eq. (4.80) must be positive or zero. 10 Examples of Eq. (4.81) are pro¬ 
vided by the matrices of Exercise 3.2.13 (spin 1/2), 3.2.15 (spin 1), and 3.2.18 (spin 3/2). 


®The Hermitian conjugation or adjoint operation is defined for matrices in Section 3.5, and for operators in general in Sec¬ 
tion 10.1. 

10 For an excellent discussion of adjoint operators and Hilbert space see A. Messiah, Quantum Mechanics. New York: Wiley 
1961, Chapter 7. 
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For the orbital angular momentum ladder operators, L + , and L_, explicit forms are given 
in Exercises 2.5.14 and 12.6.7. You can now show (see also Exercise 12.7.2) that 

{J M\J-(J + \J M)) = (/+1 JM) ) 1 J + 1 J M) . (4.82) 

Since J + raises the eigenvalue M to M + 1, we relabel the resultant eigenfunction 
| JM + 1). The normalization is given by Eq. (4.80) as 

J+\JM) = J(J - M)(J + M + 1)\JM + 1) = y/j(J+ 1)-M(M+1)\JM+ 1>, 

(4.83) 

taking the positive square root and not introducing any phase factor. By the same argu¬ 
ments, 

J-\JM) = J(J + M)(J - M + \)\JM - 1> = 7 ( 7(7 + 1) - M(M - 1)| JM - 1). 

(4.84) 

Applying J + to Eq. (4.84), we obtain the second line of Eq. (4.80) and verify that Eq. (4.84) 
is consistent with Eq. (4.83). 

Finally, since M ranges from — /to +/ in unit steps, 2/ must be an integer; / is either 
an integer or half of an odd integer. As seen later, if J is an orbital angular momentum L, 
the set | LM) for all M is a basis defining a representation of SO(3) and L will then be 
integral. In spherical polar coordinates 9, <p, the functions | LM) become the spherical har¬ 
monics (9, (p) of Section 12.6. The sets of | JM) states with half-integral / define rep¬ 
resentations of SU(2) that are not representations of SO(3); we get / = 1/2, 3/2, 5/2,_ 

Our angular momentum is quantized, essentially as a result of the commutation relations. 
All these representations are irreducible, as an application of the raising and lowering op¬ 
erators suggests. 


Summary of Lie Groups and Lie Algebras 

The general commutation relations, Eq. (4.14) in Section 4.2, for a classical Lie group 
[SO(n) and SU(n) in particular] can be simplified to look more like Eq. (4.71) for SO(3) 
and SU(2) in this section. Here we merely review and, as a rule, do not provide proofs for 
various theorems that we explain. 

First we choose linearly independent and mutually commuting generators //, which are 
generalizations of J z for SO(3) and SU(2). Let / be the maximum number of such //, with 

[Hi,H k ]= 0. (4.85) 

Then l is called the rank of the Lie group G or its Lie algebra Q. The rank and dimension, 
or order, of some Lie groups are given in Table 4.2. All other generators E a can be shown 
to be raising and lowering operators with respect to all the //,, so 

[Hj,E a ] = ai E a , ( = 1,2,...,/. (4.86) 

The set of so-called root vectors (ai, 012 ,. form the root diagram of Q. 

When the H, commute, they can be simultaneously diagonalized (for symmetric (or 
Hermitian) matrices see Chapter 3; for operators see Chapter 10). The //, provide us with 
a set of eigenvalues mi, m 2 , [projection or additive quantum numbers generalizing 
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Table 4.2 Rank and Order of Unitary and Rotational 
Groups 

Lie algebra Aj B / Dj 

Lie group SU(/ + 1) SO(2/ + 1) SO(2l ) 

Rank l l 1 

Order Z(/ + 2) /(2/ + 1) 1(21 - 1) 


M of ./- in SOf3) and SU(2)]. The set of so-called weight vectors (mi, m 2 ,..., m/) for 
an irreducible representation (multiplet) form a weight diagram. 

There are / invariant operators C/, called Casimir operators, that commute with all 
generators and are generalizations of J 2 , 

[C;, Hj] = 0, [C/,£„]=0, / = 1,2,...,/. (4.87) 

The first one, Ci, is a quadratic function of the generators; the others are more complicated. 
Since the C/ commute with all Hj, they can be simultaneously diagonalized with the Hi. 
Their eigenvalues c\,C 2 , ■ ■. ,ci characterize irreducible representations and stay constant 
while the weight vector varies over any particular irreducible representation. Thus the gen¬ 
eral eigenfunction may be written as 

|(ci, c 2 ,..., ci)m\, m 2 ,.... mi), (4.88) 

generalizing the multiplet \JM) of SO(3) and SU(2). Their eigenvalue equations are 

H, |(ci, c 2 ,,.., c/)m 1 , m 2 ,..., m/) = m, |(ci, c 2 ,..., c/)m 1 , m 2 ,..., mi) (4.89a) 

Cj|(ci, c 2 ,..., c/)mi,m 2 ,..., m;) = c,-|(ci, c 2 ,..., q)mi,m 2 ,... ,m;). (4.89b) 

We can now show that E a \(c\, c 2 ,..., c/)mi, m 2 ,..., m/) has the weight vector 
(m 1 + ai, m 2 + a 2 ,..., m; + a/) using the commutation relations, Eq. (4.86), in con¬ 
junction with Eqs. (4.89a) and (4.89b): 

Hi E a | (ci, c 2 ,..., c/)m 1 , m 2 ,..., mi) 

= (E a Hi + [Hi,E a ])\(ci , c 2 ,..., c/)mi, m 2 ,..., m/) 

— (mi + o‘i)E ct | (ci, c 2 ,..., ci)m\, m 2 ,..., m,). (4.90) 

Therefore 

£«|(ci,c 2 ,..., c/)mi,m 2 ,..., mi) ~ |(ci-- c/)mi + ai,..., m/ + a/), 

the generalization of Eqs. (4.83) and (4.84) from SO(3). These changes of eigenvalues by 
the operator E u are called its selection rules in quantum mechanics. They are displayed in 
the root diagram of a Lie algebra. 

Examples of root diagrams are given in Fig. 4.6 for SU(2) and SU(3). If we attach the 
roots denoted by arrows in Fig. 4.6b to a weight in Figs. 4.3 or 4.5a, b, we can reach any 
other state (represented by a dot in the weight diagram). 

Here Schur’s lemma applies: An operator H that commutes with all group operators, 
and therefore with all generators //, of a (classical) Lie group G in particular, has as eigen¬ 
vectors all states of a multiplet and is degenerate with the multiplet. As a consequence, 
such an operator commutes with all Casimir invariants, [H, C,] = 0. 



266 Chapter 4 Group Theory 




a 



b 


Figure 4.6 Root diagram for (a) SU(2) and 
(b) SU(3). 


The last result is clear because the Casimir invariants are constructed from the generators 
and raising and lowering operators of the group. To prove the rest, let i p be an eigenvector, 
//ip = Eip . Then, for any rotation R of G, we have H Rip — ER\p , which says that Rip 
is an eigenstate with the same eigenvalue E along with ip. Since [H, C,] = 0, all Casimir 
invariants can be diagonalized simultaneously with H and an eigenstate of H is an eigen¬ 
state of all the Cj. Since [//,-, C, ] = 0, the rotated eigenstates Rip are eigenstates of C;, 
along with i p belonging to the same multiplet characterized by the eigenvalues c, of C,-. 

Finally, such an operator H cannot induce transitions between different multiplets of the 
group because 

((cj, c 2 , ■ .., c[)m \, m 2 , ... ,m'i\H\(c\,C 2 , ■ ■ ■, c/)mj, mj, ■ . ., mi) = 0. 

Using [ H , Cy] = 0 (for any j) we have 

0 = ((c'j, c' 2 ,..., c'i)m \, m' 2 ,m', \ [H, C j] \ (ci , C 2 ,..., ci)m i, m 2 ,..., mi) 

= (Cj - c'j)((c[, c' 2 ,m' 2 —,mJ|//|(ci,C 2 ,..., C|)mi,m 2 ,..., mi). 

If c'j ^ Cj for some j, then the previous equation follows. 


Exercises 

4.3.1 Show that (a) [i+, J 2 ] = 0, (b) [/_, J 2 ] = 0. 

4.3.2 Derive the root diagram of SU(3) in Fig. 4.6b from the generators a, in Eq. (4.61). 
Hint. Work out first the SU(2) case in Fig. 4.6a from the Pauli matrices. 

4.4 Angular Momentum Coupling 

In many-body systems of classical mechanics, the total angular momentum is the sum 
L = L j of the individual orbital angular momenta. Any isolated particle has conserved 
angular momentum. In quantum mechanics, conserved angular momentum arises when 
particles move in a central potential, such as the Coulomb potential in atomic physics, 
a shell model potential in nuclear physics, or a confinement potential of a quark model in 
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particle physics. In the relativistic Dirac equation, orbital angular momentum is no longer 
conserved, but J = L + S is conserved, the total angular momentum of a particle consisting 
of its orbital and intrinsic angular momentum, called spin S = a /2, in units of h. 

It is readily shown that the sum of angular momentum operators obeys the same com¬ 
mutation relations in Eq. (4.37) or (4.41) as the individual angular momentum operators, 
provided those from different particles commute. 

Clebsch-Gordan Coefficients: SU(2)-SO(3) 

Clearly, combining two commuting angular momenta J, to form their sum 

J = Ji+J 2 , [hi,hi] = 0, (4.91) 

occurs often in applications, and J satisfies the angular momentum commutation relations 

[Jj, Jk\ — Ulj + hj, hk + hk] = Ulj, J\k\ + [hj, hk] = isjkiUu + hi) — iSjklJh 

For a single particle with spin 1 /2, for example, an electron or a quark, the total angular 
momentum is a sum of orbital angular momentum and spin. For two spinless particles 
their total orbital angular momentum L = Li + L 2 . For J 2 and J z of Eq. (4.91) to be both 
diagonal, [J 2 , 7-] = 0 has to hold. To show this we use the obvious commutation relations 
[Jiz,i 2 j] = 0, and 

J^ = J^ + J2 + 2J i ■ J 2 = J 2 + J 2 T h + h- + h —^ 2 + + 2J\ z J2 z (4.9 T) 

in conjunction with Eq. (4.71), for both J,-, to obtain 

[j 2 , J z ] — [J1-J2+ + J1+J2-, hz + h z \ 

= U\~, J\z\h+ + h-lh+, hz] + [7i+, Jizih— + h+lh-, h z ] 

— Ji-h+ — J1-J2+ — Ji+h- + h+h- — 0. 

Similarly [J 2 , J 2 ] = 0 is proved. Hence the eigenvalues of J 2 , J 2 , J- can be used to label 
the total angular momentum states | J\ JtJ M). 

The product states \ J\mi)\hm2) obviously satisfy the eigenvalue equations 

J z \J\ m i)\hm 2 ) — (hz + h z )\J\m\)\hm 2 ) — (m\ + W2)|7imi)|7 2 «t 2 ) 

— M\Jimi)\h»i2), (4.92) 

J?|/imi)|72«t 2 ) = Ji(Jj + \)\Jim\)\hm 2 ), 

but will not have diagonal J 2 except for the maximally stretched states with M — 
±(7i + h) and J = J\ + h (see Fig. 4.7a). To see this we use Eq. (4.91') again in con¬ 
junction with Eqs. (4.83) and (4.84) in 

J 2 |7im 1 )7 2 w 2 ) = {/i(/i + 1) + h(h + 1) + 2mim2}|7imi)|/ 2 m 2 ) 

+ {hUi + 1) - mi(mi + l)} 1/2 {/ 2 (7 2 + 1) -m 2 (m 2 - 1)} 1/2 

x \J\m\ + l)|/ 2 m 2 - 1) + {/i(7i + 1) - m\(m\ - 1)} l/_ 

x {h(h + 1) - m 2 (m 2 + l)} 1/2 |/imi - l)|/ 2 m 2 + 1). 


(4.93) 
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a b c 


Figure 4.7 Coupling of two angular momenta: 

(a) parallel stretched, (b) antiparallel, (c) general 
case. 

The last two terms in Eq. (4.93) vanish only when m\ — J\ and m 2 — J 2 or m\ — —J\ and 
m 2 = — J 2 - In both cases J — J\ + J 2 follows from the first line of Eq. (4.93). In general, 
therefore, we have to form appropriate linear combinations of product states 

\JiJ 2 JM)= E C(JiJ 2 J\mim 2 M)\Jimi)\J 2 m 2 ), (4.94) 

my,m2 

so that J 2 has eigenvalue 7(7 + 1). The quantities C(7| J 2 J\m 1 m 2 M ) in Eq. (4.94) are 
called Clebsch-Gordan coefficients. From Eq. (4.92) we see that they vanish unless M — 
m 1 + m 2 , reducing the double sum to a single sum. Applying J± to 7 M) shows that the 
eigenvalues M of 7- satisfy the usual inequalities — 7 < M < J. 

Clearly, the maximal 7 max = J\ + J 2 (see Fig. 4.7a). In this case Eq. (4.93) reduces to a 
pure product state 

\J\J 2 J — J\ T J 2 M — J[ + J 2 ) = \JiJ 1 )\J 2 J 2 ), (4.95a) 

so the Clebsch-Gordan coefficient 

C(J\J 2 J = Ji + J 2 \JiJ 2 Ji + J 2 ) = 1. (4.95b) 

The minimal J = J\ — J 2 (if J\ > J 2 , see Fig. 4.7b) and J = J 2 — J\ for J 2 > J\ follow if 
we keep in mind that there are just as many product states as | JM) states; that is, 

J max 

E (27 + 1) = (7 ma x ‘Anin H" l)(Amax A m i n + 1) 

-t—7mn 

= (27i + 1)(27 2 + 1). (4.96) 

This condition holds because the \J\J 2 J M) states merely rearrange all product states into 
irreducible representations of total angular momentum. It is equivalent to the triangle rule: 

A(7!7 2 7) = l, if |7 i — 7 2 | < 7 < 7i + 7 2 : 

(4.97) 

A(7i 7 2 7) = 0, else. 
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This indicates that one complete multiplet of each / value from / m ; n to / max accounts 
for all the states and that all the | JM) states are necessarily orthogonal. In other words, 
Eq. (4.94) defines a unitary transformation from the orthogonal basis set of products of 
single-particle states \J\m \; / 2 /M 2 } = |/imi)|/ 2 m 2 ) to the two-particle states \J\J 2 JM). 
The Clebsch-Gordan coefficients are just the overlap matrix elements 

C(/i/ 2 /|mim 2 M) = {J\J2J /2/«2}- (4.98) 

The explicit construction in what follows shows that they are all real. The states in 
Eq. (4.94) are orthonormalized, provided that the constraints 

Y C{J\J2J\m\m2M)C(J\J2J'\m\m2M') 

mi,m 2 , mi+m 2 =M (4.99a) 

= (J\hJ M') =8jj'8 M M' 

Y C{J\ / 2 /|mim 2 M)C(/i J2J\m' ] m' 2 M) 

j.m “ (4.99b) 

= (/imi|/im' 1 )(y 2 m2|/2m2> = & nnm '^ mvn ' 2 

hold. 

Now we are ready to construct more directly the total angular momentum states starting 
from |/ max = /i + Ji M = J\ + J 2 ) in Eq. (4.95a) and using the lowering operator /_ = 
J\- + J 2 - repeatedly. In the first step we use Eq. (4.84) for 

Ji-\JiJi) = {/,(/, + 1) - JiUi - 1 )}‘ /2 |JiJi ~ 1> = (2 Ji) 1/2 \JiJi - 1>, 

which we substitute into (/j_ + / 2 _}|/i/i) 1 / 2 / 2 )- Normalizing the resulting state with 
M — J[ + J 2 — 1 properly to 1, we obtain 

|/l/2/l + / 2/1 + J2 ~ 1) = {/l/(/l + — 1)1 ^2^ 2 ) 

+ {/ 2 /(/l + /2)} 1/2 |/l/l>|/2/2-l>. 

Equation (4.100) yields the Clebsch-Gordan coefficients 

C(/,/ 2 /i + / 2 |/t - 1 h h + h ~ 1) = {h/Ux + / 2 )} l/2 , 

C(JxJ 2 J\ + / 2 I /1 Ji - 1 /1 + h - 1) = {/ 2 /(/i + / 2 )}' /2 . 

Then we apply /_ again and normalize the states obtained until we reach \ J\ J 2 J\ + / 2 M) 
with M — —(/1 + Ji). The Clebsch-Gordan coefficients C(/i/ 2 /i + / 2 1 m \m 2 M ) may 
thus be calculated step by step, and they are all real. 

The next step is to realize that the only other state with M — J\ + /> — 1 is the top of the 
next lower tower of | /1 + J 2 — 1 M) states. Since | /1 + / 2 — 1 /1 + /2 — 1} is orthogonal to 
I /l + / 2 /i + / 2 — 1} in Eq. (4.100), it must be the other linear combination with a relative 
minus sign, 

|/t + h - l h + /2 - 1} = -{/ 2 /(/i + / 2 )} 1/2 |/i/i - l>|/ 2 / 2 ) 

+ {/i/(/i + / 2 )} 1/2 |/i/i>|/ 2 /2 - 1>, (4.102) 


(4.100) 


(4.101) 


up to an overall sign. 
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Hence we have determined the Clebsch-Gordan coefficients (for J 2 > J\) 


c{j\ji + j 2 J\ + h- i) = -{h/ih + h )} 1/2 , 

(4.103) 

C(JiJ 2 J1 + J2- i|/i h - l h + h - i) = {/i/(/i + ^2)} 1/2 . 

Again we continue using /_ until we reach M = — (J[ + J 2 — 1), and we keep normalizing 
the resulting states \Ji + J 2 — 1 M) of the J = J\ + J 2 — 1 tower. 

In order to get to the top of the next tower, | J\ + J 2 — 2 M) with M = J[ + J 2 — 2, we 
remember that we have already constructed two states with that M. Both \J\ + J 2 J] + 
J 2 — 2) and \J\ + J 2 — \ Ji + J 2 — 2) are known linear combinations of the three product 
states \J\J\)\J 2 J 2 — 2) — 1} x \J 2 J 2 — 1), and \J\J\ — 2)\J 2 J 2 ). The third linear 
combination is easy to find from orthogonality to these two states, up to an overall phase, 
which is chosen by the Condon-Shortley phase conventions 11 so that the coefficient 
C(J[J 2 J\ + J 2 — 2 1 J[ J 2 — 2 Ji + J 2 — 2) of the last product state is positive for | J\ J 2 J i + 
J 2 — 2 J] + J 2 — 2) . It is straightforward, though a bit tedious, to determine the rest of the 
Clebsch-Gordan coefficients. 

Numerous recursion relations can be derived from matrix elements of various angular 
momentum operators, for which we refer to the literature. 12 

The symmetry properties of Clebsch-Gordan coefficients are best displayed in the more 
symmetric Wigner’s 3 j-symbols, which are tabulated: 12 


J1J2J3 \ (- 1 )*-*- 


m 3 


m 1 / 7 ? 2^3 


J (2J 3 + 1)V 2 


-C(JiJ 2 J 3 \m 1 m 2 , -m 3 ), 


(4.104a) 


obeying the symmetry relations 


J\J 2 J 2 \ 
m\m 2 m 3 J 


= (-D 


/1 + /2 + /3 


JkJl Jn 

m 


(4.104b) 


for ( k,l,n ) an odd permutation of (1,2,3). One of the most important places where 
Clebsch-Gordan coefficients occur is in matrix elements of tensor operators, which are 
governed by the Wigner-Eckart theorem discussed in the next section, on spherical ten¬ 
sors. Another is coupling of operators or state vectors to total angular momentum, such 
as spin-orbit coupling. Recoupling of operators and states in matrix elements leads to 6 j- 
and 9j -symbols. 12 Clebsch-Gordan coefficients can and have been calculated for other 
Lie groups, such as SU(3). 


1 *E. U. Condon and G. H. Shortley, Theory of Atomic Spectra. Cambridge, UK: Cambridge University Press (1935). 

12 There is a rich literature on this subject, e.g., A. R. Edmonds, Angular Momentum in Quantum Mechanics. Princeton, NJ: 
Princeton University Press (1957); M. E. Rose, Elementary Theory of Angular Momentum. New York: Wiley (1957); A. de-Shalit 
and I. Talmi, Nuclear Shell Model. New York: Academic Press (1963); Dover (2005). Clebsch-Gordan coefficients are tabulated 
in M. Rotenberg, R. Bivins, N. Metropolis, and J. K. Wooten, Jr., The 3j- and 6j-Symbols. Cambridge, MA: Massachusetts 
Institute of Technology Press (1959). 
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In Chapter 2 the properties of Cartesian tensors are defined using the group of nonsin¬ 
gular general linear transformations, which contains the three-dimensional rotations as a 
subgroup. A tensor of a given rank that is irreducible with respect to the full group may 
well become reducible for the rotation group SOf3). To explain this point, consider the 
second-rank tensor with components Tjk — Xj Vk for j,k — 1,2, 3. It contains the symmet¬ 
ric tensor Sjk = ix,jyk + Xkyj )/2 and the antisymmetric tensor Ajk — (xjyk — Xkyj)/ 2, so 
Tjk — Sjk + Ajk . This reduces Tjk in SO(3). However, under rotations the scalar product 
x • y is invariant and is therefore irreducible in SO(3). Thus, Sjk can be reduced by sub¬ 
traction of the multiple of x • y that makes it traceless. This leads to the SO(3)-irreducible 
tensor 


Sjk — 2 ( x jyk + x ky j ) 3 x ■ ySjk- 

Tensors of higher rank may be treated similarly. When we form tensors from products of 
the components of the coordinate vector r then, in polar coordinates that are tailored to 
SO(3) symmetry, we end up with the spherical harmonics of Chapter 12. 

The form of the ladder operators for SO(3) in Section 4.3 leads us to introduce the 
spherical components (note the different normalization and signs, though, prescribed by 
the Yim) of a vector A: 


A+\ — —^j(A x + iA y ), 


A -‘ = 73 (A < 


i Ay ), Ao At. 

Then we have for the coordinate vector r in polar coordinates. 


r +1 = -^rsm9e ,,f> = r^^-Yn, 


r-i = -j^rsinde ,( <’ = r y J^fY i._i. 


(4.105) 


(4.106) 


ro = rJ^-Y lQ , 


where Yi m (0, (p) are the spherical harmonics of Chapter 12. Again, the spherical jm com¬ 
ponents of tensors Tjm of higher rank j may be introduced similarly. 

An irreducible spherical tensor operator Tj m of rank j has 2 / + 1 components, just 
as for spherical harmonics, and m runs from — j to + j. Under a rotation R(a), where a 
stands for the Euler angles, the T/„, transform as 


Yim(r') = Yi m '{r)D' m , m (R), (4.107a) 

m' 

where F = (9' , cp') are obtained from f = (0, (p) by the rotation R and are the angles of the 
same point in the rotated frame, and 

P’ Y) = {Jm\exp(iaJ z )exp(i/3Jy)exp(iyJ z )\Jm') 

are the rotation matrices. So, for the operator T jm , we define 

R Tjm R = T j m ' D m'm 

m' 


(4.107b) 
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For an infinitesimal rotation (see Eq. (4.20) in Section 4.2 on generators) the left side of 
Eq. (4.107b) simplifies to a commutator and the right side to the matrix elements of J, the 
infinitesimal generator of the rotation R: 


[J n , Tj m ] = y^T jm '{jm'\J n \jm}. (4.108) 

m' 

If we substitute Eqs. (4.83) and (4.84) for the matrix elements of J m we obtain the alterna¬ 
tive transformation laws of a tensor operator, 

[Jo, T jm ] = mTj m , [/±, T jm ] = Tj m ±] [(j - m){j ± m + 1 )} 1/2 . (4.109) 

We can use the Clebsch-Gordan coefficients of the previous subsection to couple two 
tensors of given rank to another rank. An example is the cross or vector product of two 
vectors a and b from Chapter 1. Let us write both vectors in spherical components, a m and 
b m . Then we verify that the tensor C m of rank 1 defined as 


C 


m 


T, C(lll\mim. 2 >n)a mi b m2 = 

m\m2 


V2 


(a x b),„. 


(4.110) 


Since C m is a spherical tensor of rank 1 that is linear in the components of a and b, it must 
be proportional to the cross product, C m = N( ax h),„. The constant N can be determined 
from a special case, a = x, b = y, essentially writing x x y = z in spherical components as 
follows. Using 

(2)0 = 1; (x)t = -1/V2, (x)_! = 1/V2; 

(y)i = -«/V2, (y)_i = -i/V2, 


Eq. (4.110) for m = 0 becomes 

C(lll|l, —1,0)[(x) x (y)_i — (x)_!(y)i] = N((z)o) = N 


1 

V! 


V2\ V2j V2\ V2 


l 


where we have used C(lll|101) = from Eq. (4.103) for J\ = 1 = J 2 , which implies 
C(lll|l, -1,0) = using Eqs. (4.104a,b): 

/ 1 1 1 \ 1 1 

=- 7 =C'(111|101) = —- = — 

\1 0 -1/ V3 6 


1 1 r 

1 - 10 , 


= --^( 11111 ,- 1 , 0 ). 
V3 


A bit simpler is the usual scalar product of two vectors in Chapter 1, in which a and b 
are coupled to zero angular momentum: 


a b = — (ab)oV3 = — V3 ^ C(110|/7i, —m,0)a m b- n 


(4.111) 


Again, the rank zero of our tensor product implies a • b = n(ab)o- The constant n can 
be determined from a special case, essentially writing zr — 1 in spherical components: 
z 2 = 1 = nC(110|000) = —-j=. 




4.4 Angular Momentum Coupling 


273 


Another often-used application of tensors is the recoupling that involves 6j-symbols for 
three operators and 9 j for four operators. 12 An example is the following scalar product, 
for which it can be shown 12 that 

1 2 

o i • rff 2 • r = -r <ri ' + ( 0102)2 • (rr) 2 , (4.112) 

but which can also be rearranged by elementary means. Here the tensor operators are de¬ 
fined as 

(<r 102)2 m= Y C(H2|mim2m)eri mi <72m 2 , (4.113) 

m\m.2 


87r 


E / OJL 9 /s 

C (112| m 1 m2in)r m{ r„ n = yj — r T 2 m(r) 


and the scalar product of tensors of rank 2 as 

(0102)2 ■ (rr) 2 = y^(-l) m (ffig 2 ) 2 m(rr) 2 ,-m = V5((ai<r 2 ) 2 (rr) 2 ) 0 . 

m 


(4.114) 


(4.115) 


One of the most important applications of spherical tensor operators is the Wigner- 
Eckart theorem. It says that a matrix element of a spherical tensor operator T km of rank k 
between states of angular momentum j and j' factorizes into a Clebsch-Gordan coefficient 
and a so-called reduced matrix element, denoted by double bars, that no longer has any 
dependence on the projection quantum numbers m,m ', n: 

(j'm'\T kn \jm) = C(kjj'\nmm')(-l) k -j + >’(j'\\T k \\j)/^(2j' + 1). (4.116) 


In other words, such a matrix element factors into a dynamic part, the reduced matrix 
element, and a geometric part, the Clebsch-Gordan coefficient that contains the rotational 
properties (expressed by the projection quantum numbers) from the S0(3) invariance. To 
see this we couple T kn with the initial state to total angular momentum j': 

\j'm') Q = y ^ C (kjf \nmm')T kn \jm). (4.117) 

nm 

Under rotations the state \j'm')o transforms just like | j'm'). Thus, the overlap matrix ele¬ 
ment (j'm!\j'm!) 0 is a rotational scalar that has no m! dependence, so we can average over 
the projections, 

(JM\j'm')o= 8 ^' n ' ^(//r|;V)o- (4-118) 

2/ + 1 ' 

Next we substitute our definition, Eq. (4.117), into Eq. (4.118) and invert the relation 
Eq. (4.117) using orthogonality, Eq. (4.99b), to find that 

(J M\T kn | jm) = Y, C(kjj'\nmm') j 1 ' ^(7/r| (4.119) 

j'm' A 6 

which proves the Wigner-Eckart theorem, Eq. (4.116). 13 


13 The extra factor (— 1)* jyj (2 j’ + 1) in Eq. (4.116) is just a convention that varies in the literature. 



274 Chapter 4 Group Theory 


As an application, we can write the Pauli matrix elements in terms of Clebsch-Gordan 
coefficients. We apply the Wigner-Eckart theorem to 

[\y\ a a\\P) = (<Ta)y/3 = ~ C(l \ \\<xPy){\ || a || \)- (4.120) 

Since = 1 with op = 03 and C( | 0^4) — — 1 /a/ 3, we find 

(2 Ik II s) = >/6, (4.121) 

which, substituted into Eq. (4.120), yields 

K)^ = -V3C(l±±|a/ix). (4.122) 

Note that the a = ±1,0 denote the spherical components of the Pauli matrices. 

Young Tableaux for SU(«) 

Young tableaux (YT) provide a powerful and elegant method for decomposing products 
of SU(«) group representations into sums of irreducible representations. The YT provide 
the dimensions and symmetry types of the irreducible representations in this so-called 
Clebsch-Gordan series, though not the Clebsch-Gordan coefficients by which the prod¬ 
uct states are coupled to the quantum numbers of each irreducible representation of the 
series (see Eq. (4.94)). 

Products of representations correspond to multiparticle states. In this context, permuta¬ 
tions of particles are important when we deal with several identical particles. Permutations 
of n identical objects form the symmetric group S n . A close connection between irre¬ 
ducible representations of S„, which are the YT, and those of SU(n) is provided by this 
theorem: Every /V-particle state of S„ that is made up of single-particle states of the fun¬ 
damental n-dimensional SU(/z) multiplet belongs to an irreducible SU(n) representation. 
A proof is in Chapter 22 of Wybourne. 14 

For SU(2) the fundamental representation is a box that stands for the spin (up) and 
— j (down) states and has dimension 2. For SU(3) the box comprises the three quark states 
in the triangle of Fig. 4.5a; it has dimension 3. 

An array of boxes shown in Fig. 4.8 with kj boxes in the first row, ki boxes in the 
second row, .... and k„_i boxes in the last row is called a Young tableau (YT), denoted 
by [k 1,1 ], and represents an irreducible representation of Slip?) if and only if 

M >*2> ■■■>*„_!. (4.123) 

Boxes in the same row are symmetric representations; those in the same column are anti¬ 
symmetric. A YT consisting of one row is totally symmetric. A YT consisting of a single 
column is totally antisymmetric. 

There are at most n — 1 rows for SU(n) YT because a column of n boxes is the totally 
antisymmetric (Slater determinant of single-particle states) singlet representation that 
may be struck from the YT. 

An array of N boxes is an /V-particle state whose boxes may be labeled by positive 
integers so that the (particle labels or) numbers in one row of the YT do not decrease from 


i4 B. G. Wybourne, Classical Groups for Physicists. New York: Wiley (1974). 
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Figure 4.8 Young tableau (YT) for SU(«). 

left to right and those in any one column increase from top to bottom. In contrast to the 
possible repetitions of row numbers, the numbers in any column must be different because 
of the antisymmetry of these states. 

The product of a YT with a single box, [1], is the sum of YT formed when the box is 
put at the end of each row of the YT, provided the resulting YT is legitimate, that is, obeys 
Eq. (4.123). For SU(2) the product of two boxes, spin 1/2 representations of dimension 2, 
generates 

[1] <S> [1] = [2] © [1, 1], (4.124) 

the symmetric spin 1 representation of dimension 3 and the antisymmetric singlet of di¬ 
mension 1 mentioned earlier. 

The column of n — 1 boxes is the conjugate representation of the fundamental represen¬ 
tation; its product with a single box contains the column of n boxes, which is the singlet. 
For SU(3) the conjugate representation of the single box, [1] or fundamental quark repre¬ 
sentation, is the inverted triangle in Fig. 4.5b, [1, 1], which represents the three antiquarks 
h, d, s, obviously of dimension 3 as well. 

The dimension of a YT is given by the ratio 

dim YT = —. (4.125) 

The numerator N is obtained by writing an n in all boxes of the YT along the diagonal, 
(n + 1) in all boxes immediately above the diagonal, (n — 1) immediately below the diago¬ 
nal, etc. N is the product of all the numbers in the YT. An example is shown in Fig. 4.9a for 
the octet representation of SU(3), where N — 2 ■ 3 ■ 4 = 24. There is a closed formula that 
is equivalent to Eq. (4.125). 15 The denominator D is the product of all hooks. 16 A hook is 
drawn through each box of the YT by starting a horizontal line from the right to the box in 
question and then continuing it vertically out of the YT. The number of boxes encountered 
by the hook-line is the hook-number of the box. D is the product of all hook-numbers of 


15 See, for example, M. Hamermesh, Group Theory and Its Application to Physical Problems. Reading. MA: Addison-Wesley 
(1962). 

*®F. Close, Introduction to Quarks and Partons. New York: Academic Press (1979). 
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Figure 4.9 Illustration 
of (a) /V and (b) D in 
Eq. (4.125) for the octet 
Young tableau of SU(3). 


the YT. An example is shown in Fig. 4.9b for the octet of SU(3), whose hook-number is 
D = 1 • 3 • 1 = 3. Hence the dimension of the SU(3) octet is 24/3 = 8, whence its name. 

Now we can calculate the dimensions of the YT in Eq. (4.124). For SU(2) they are 
2x2 = 3+ l=4. For SU(3) they are 3 • 3 = 3 • 4/(1 • 2) + 3 • 2/(2 ■ 1) = 6 + 3 = 9. For 
the product of the quark times antiquark YT of SU(3) we get 

[1,1] <» [1] = [2,1] ©[1,1,1], (4.126) 

that is, octet and singlet, which are precisely the meson multiplets considered in the sub¬ 
section on the eightfold way, the SU(3) flavor symmetry, which suggest mesons are bound 
states of a quark and an antiquark, qq configurations. For the product of three quarks we 
get 


([1] ® [1]) ® [1] = ([2] © [1, 1]) <g> [1] = [3] © 2[2, 1] © [1, 1, 1], (4.127) 

that is, decuplet, octet, and singlet, which are the observed multiplets for the baryons, 
which suggests they are bound states of three quarks, q 3 configurations. 

As we have seen, YT describe the decomposition of a product o/SU(«) irreducible repre¬ 
sentations into irreducible representations o/SU(n), which is called the Clebsch-Gordan 
series, while the Clebsch-Gordan coefficients considered earlier allow construction of the 
individual states in this series. 
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Exercises 

4.4.1 Derive recursion relations for Clebsch-Gordan coefficients. Use them to calculate 
C(WJ\m\m 2 M) for J — 0,1,2. 

Hint. Use the known matrix elements of J + = J\ + + J 2 +, ■/;+, and J 2 = CJ 1 + J 2 ) 2 , etc. 

4.4.2 Show that (Y/x) J M — ^2C(ljJ\rnim s M)Yi mi Xm s , where x±i /2 are the spin up and 
down eigenfunctions of 03 = a z , transforms like a spherical tensor of rank J. 

4.4.3 When the spin of quarks is taken into account, the SU(3) flavor symmetry is replaced by 
the SU(6) symmetry. Why? Obtain the Young tableau for the antiquark configuration 
q. Then decompose the product qq. Which SU(3) representations are contained in the 
nontrivial SU(6) representation for mesons? 

Hint. Determine the dimensions of all YT. 

4.4.4 For / = 1, Eq. (4.107a) becomes 

1 

lf(0V)= E D l m , m (a,p,y)Yf(e,<p). 

m'=—1 

Rewrite these spherical harmonics in Cartesian form. Show that the resulting Cartesian 
coordinate equations are equivalent to the Euler rotation matrix A(a, fi, y), Eq. (3.94), 
rotating the coordinates. 

4.4.5 Assuming that D ] (a, fi, y) is unitary, show that 

l 

E rr(Oi.n)rr02.9i) 

m=—l 

is a scalar quantity (invariant under rotations). This is a spherical tensor analog of a 
scalar product of vectors. 

4.4.6 (a) Show that the a and y dependence of D 7 (a, fi, y) may be factored out such that 

D J (a,p, y) — A J (a)d j (j3)C j (y). 

(b) Show that A J (a) and C J (y ) are diagonal. Find the explicit forms. 

(c) Show that d 7 (yS) = D 7 (0, yd, 0). 

4.4.7 The angular momentum-exponential form of the Euler angle rotation operators is 

R = R z "(y)R/(/ 6 )R z (oO 
= exp(— iyJ z ") exp(—i/iJ v ')exp(—iaJ z ). 

Show that in terms of the original axes 

R = exp(/o'y-)exp(—//l/ v )exp(— iyJ z ). 

Hint. The R operators transform as matrices. The rotation about the v'-axis (second 
Euler rotation) may be referred to the original y-axis by 

exp(— ifiJy') — exp(— iotJ z ) exp(— ifiJ y ) exp(iaJ z ). 



278 Chapter 4 Group Theory 


4.4.8 Using the Wigner-Eckart theorem, prove the decomposition theorem for a spherical 
vector operator {j'm'\T hn \jm) = Um \i-Ti\jm) Sjj , 

4.4.9 Using the Wigner-Eckart theorem, prove the factorization 
{j'm'\J M J • Ti| jm) = {jm'\J M \jm)8jfj{jm\i • Ti| jm). 

4.5 Homogeneous Lorentz Group 

Generalizing the approach to vectors of Section 1.2, in special relativity we demand that 
our physical laws be covariant 17 under 

a. space and time translations, 

b. rotations in real, three-dimensional space, and 

c. Lorentz transformations. 

The demand for covariance under translations is based on the homogeneity of space and 
time. Covariance under rotations is an assertion of the isotropy of space. The requirement 
of Lorentz covariance follows from special relativity. All three of these transformations 
together form the inhomogeneous Lorentz group or the Poincare group. When we exclude 
translations, the space rotations and the Lorentz transformations together form a group — 
the homogeneous Lorentz group. 

We first generate a subgroup, the Lorentz transformations in which the relative velocity 
v is along the x = x 1 -axis. The generator may be determined by considering space-time 
reference frames moving with a relative velocity Sv , an infinitesimal . 18 The relations are 
similar to those for rotations in real space. Sections 1.2, 2.6, and 3.3, except that here the 
angle of rotation is pure imaginary (compare Section 4.6). 

Lorentz transformations are linear not only in the space coordinates Xj but in the time t 
as well. They originate from Maxwell’s equations of electrodynamics, which are invariant 
under Lorentz transformations, as we shall see later. Lorentz transformations leave the 
quadratic form c 2 t 2 — x\ — x 2 — x 2 = Xq — x 2 — x 2 — x| invariant, where xq = ct. We 
see this if we switch on a light source at the origin of the coordinate system. At time t 

light has traveled the distance ct = J ^ xf, so c 2 t 2 — x 2 — x 2 — x 2 — 0. Special relativity 
requires that in all (inertial) frames that move with velocity v < c in any direction relative 
to the Xj -system and have the same origin at time / = 0, c 2 t' 2 — x' 2 — x!f — x' 2 — 0 holds 
also. Four-dimensional space-time with the metric x ■ x — x 2 = x ( 7 — x 2 — x 2 — x 2 is called 
Minkowski space, with the scalar product of two four-vectors defined as a ■ b — aobo — a • b. 
Using the metric tensor 



/i 

0 

0 

0 ^ 



0 

-1 

0 

0 


0 fcv) = (*'*’') = 

0 

0 

-l 

0 

(4.128) 


lo 

0 

0 

-v 


17 To be covariant means to have the same form in different coordinate 

systems so that there is no preferred reference system 

(compare Sections 1.2 and 2.6). 






ls This derivation, with a slightly different metric, appears in an article by J. L. Strecker, Am. J. Phys. 35: 12 (1967). 
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we can raise and lower the indices of a four-vector, such as the coordinates x 1 ' = (xo, x), 
so that X/j, = g/j,vX v = ( xo, — x) and x ,L g fiv x v = Xq — x 2 , Einstein’s summation convention 
being understood. For the gradient, 3^ = (d/dxo, —V) = d/dx^ and 3^ = (d/dxo, V), so 
3 2 = d M d^ = (d/dxo) 2 — V 2 is a Lorentz scalar, just like the metric x 2 — Xq — x 2 . 

For v « c, in the nonrelativistic limit, a Lorentz transformation must be Galilean. Hence, 
to derive the form of a Lorentz transformation along the a'i -axis, we start with a Galilean 
transformation for infinitesimal relative velocity <5i>: 

x' 1 — x l — Svt = x l — x°Sj6. (4.129) 

Here, p — v/c. By symmetry we also write 

x'° = x° + aSfix 1 , (4.1290 

with the parameter a chosen so that x ( 2 — x 2 is invariant, 

Xq 2 — x’ 2 = Vq — x 2 . (4.130) 

Remember, x /l — (x°,x) is the prototype four-dimensional vector in Minkowski space. 
Thus Eq. (4.130) is simply a statement of the invariance of the square of the magnitude of 
the “distance” vector under Lorentz transformation in Minkowski space. Here is where the 
special relativity is brought into our transformation. Squaring and subtracting Eqs. (4.129) 
and (4.1290 an d discarding terms of order (S/ 6 ) 2 , we find a = — 1. Equations (4.129) and 
(4.1290 may be combined as a matrix equation. 



= ( 1 2-SM) 



(4.131) 


a i happens to be the Pauli matrix, rt \, and the parameter 8/3 represents an infinitesimal 
change. Using the same techniques as in Section 4.2, we repeat the transformation N times 
to develop a finite transformation with the velocity parameter p — N8/3. Then 



(4.132) 




( cosh p — sinh p 
— sinh p cosh p 



(4.133) 

(4.134) 

(4.135) 

(4.136) 
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< 7 i has generated the representations of this pure Lorentz transformation. The quantities 
cosh p and sinh p may be identified by considering the origin of the primed coordinate 
system, x' 1 =0, or x 1 — vt. Substituting into Eq. (4.136), we have 

0 = x l coshp — x° sinh p. (4.137) 

With x 1 — vt and x° = ct, 

v 

tanh p = = -. 

c 

Note that the rapidity p ^ v/c, except in the limit as v —> 0. The rapidity is the additive 
parameter for pure Lorentz transformations (“boosts”) along the same axis that corresponds 
to angles for rotations about the same axis. Using 1 — tanh 2 p = (cosh 2 p) -1 , 

coshp = (1 — /l 2 ) X ^ = y, sinh p = /3y. (4.138) 

The group of Lorentz transformations is not compact, because the limit of a sequence of 
rapidities going to infinity is no longer an element of the group. 

The preceding special case of the velocity parallel to one space axis is easy, but it illus¬ 
trates the infinitesimal velocity-exponentiation-generator technique. Now, this exact tech¬ 
nique may be applied to derive the Lorentz transformation for the relative velocity v not 
parallel to any space axis. The matrices given by Eq. (4.136) for the case of v = xi>. Y form 
a subgroup. The matrices in the general case do not. The product of two Lorentz transfor¬ 
mation matrices L(vj) and L(V 2 ) yields a third Lorentz matrix, L(V 3 ), if the two velocities 
Vi and V 2 are parallel. The resultant velocity, V 3 , is related to V| and V 2 by the Einstein 
velocity addition law. Exercise 4.5.3. If vj and V 2 are not parallel, no such simple relation 
exists. Specifically, consider three reference frames S, S', and .S'", with S and S' related by 
L(vi) and S' and S" related by L(v 2 ). If the velocity of S" relative to the original system S 
is V 3 , S" is not obtained from S by L(V 3 ) = L(v 2 )L(vj). Rather, we find that 

L(v 3 ) = RL(v 2 )L(vi), (4.139) 

where R is a 3 x 3 space rotation matrix embedded in our four-dimensional space-time. 
With vi and V 2 not parallel, the final system, S", is rotated relative to S. This rotation 
is the origin of the Thomas precession involved in spin-orbit coupling terms in atomic 
and nuclear physics. Because of its presence, the pure Lorentz transformations L(v) by 
themselves do not form a group. 

Kinematics and Dynamics in Minkowski Space-Time 

We have seen that the propagation of light determines the metric 

r 2 - c 2 t 2 = 0 = r /2 - cV 2 , 

where x 11 = (ct, r) is the coordinate four-vector. Lor a particle moving with velocity v, the 
Lorentz invariant infinitesimal version 

cdr = y/dxt* dx^ — y/c 2 dt 2 — dr 2 = city/c 2 — v 2 

defines the invariant proper time r on its track. Because of time dilation in moving frames, 
a proper-time clock rides with the particle (in its rest frame) and runs at the slowest possible 
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rate compared to any other inertial frame (of an observer, for example). The four-velocity 
of the particle can now be defined properly as 

= _ v ) 

dr \ Vc 2 — \2 Vc- — v 2 / 


so u 2 — 1, and the four-momentum p /l — emu ^ = ( —, p) yields Einstein’s famous energy 
relation 


E = 


me 


y 7 ! — v 2 /c 2 


= mc~ H - v 2 ± ■ 


A consequence of u 2 — 1 and its physical significance is that the particle is on its mass 
shell p 2 — m 2 c 2 . 

Now we formulate Newton’s equation for a single particle of mass m in special relativity 
as ‘^r — K 1 ' , with K fl denoting the force four-vector, so its vector part of the equation 
coincides with the usual form. For p.,= 1,2, 3 we use dr — dt v /l — v 2 /c 2 and find 


1 dp _ F 

\/l — \ 2 /c 2 dt y 7 ! — \ 2 /c 2 


determining K in terms of the usual force F. We need to find K°. We proceed by analogy 
with the derivation of energy conservation, multiplying the force equation into the four- 
velocity 


mu v 


du" 

dr 


m dir 
2 dr 


because u 2 — 1 = const. The other side of Newton’s equation yields 


1 

0=-u - K = 

c 


K° 

-v/1 - \ 2 /c 2 


F ■ v/c 

Vl-v 2 /c 22 ’ 


so K° — . F ' v ^ c is related to the rate of work done by the force on the particle. 

Now we turn to two-body collisions, in which energy-momentum conservation takes 
the form pi + p 2 = P 3 + pa, where p 1 ' are the particle four-momenta. Because the scalar 
product of any four-vector with itself is an invariant under Lorentz transformations, it is 
convenient to define the Lorentz invariant energy squared ,v = (p\ + P 2) 2 — P 2 , where 
P 1 ' is the total four-momentum, and to use units where the velocity of light c = 1. The 
laboratory system (lab) is defined as the rest frame of the particle with four-momentum 
p% — (m 2 , 0 ) and the center of momentum frame (ems) by the total four-momentum P 1 ' — 
(Ei + E 2 , 0). When the incident lab energy is given, then 

s = p\ + p\ + 2p\ • P 2 — rn\ + m\ + 2mlE[ 


is determined. Now, the ems energies of the four particles are obtained from scalar products 

Pi ■ P = Ei(E\ + E 2 ) = Ei*/s, 
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so 


E 1 = 

E 2 = 
e 3 = 

e 4 = 


Pi ■ (Pi + Pi) 

s/s 

P 2 -(p 1 + P 2 ) 

*Js 

P3 • (P3 + Pa) 
■>/s 

P4 ' (P3 + PA) 

y/~S 


m j + pi ■ 

■ P 2 

s/s 


m\ + pi ■ 

■ P 2 

■y/s 


m\ + P3 ■ 

■ P4 

■y/s 


mj + P3 

' P4 


\/~S 


m\ 

— m\ 

+ s 


2 yfs 


m 2 

— m j 

+ s 


2 yjli 


2 

m 3 

2 

-m% 

+ s 


2yfs 


2 

— m 2 

+ s 


2 yfs 


by substituting 

2 2 2 2 
2pi ■ P 2 = s — m\ — m 2 , 2p 2 ■ p 4 — s — m 3 — m 4 . 

Thus, all cms energies T, depend only on the incident energy but not on the scattering 
angle. For elastic scattering, m 3 = mi, 1114 = m 2 , so £3 = E\, E 4 — E 2 . The Lorentz 
invariant momentum transfer squared 

t = (pi - pi) 2 = m i + m \ - 2 pi ■ P3 


depends linearly on the cosine of the scattering angle. 


Example 4 . 5.1 Kaon Decay and Pion Photoproduction Threshold 

Find the kinetic energies of the muon of mass 106 MeV and massless neutrino into which 
a K meson of mass 494 MeV decays in its rest frame. 

Conservation of energy and momentum gives m k — E p + E v — x fs. Applying the rela¬ 
tivistic kinematics described previously yields 

C- _ Pfi- (Pn + Pv) _ m l + Pn ■ Pv 
-C'/x — — > 

m k nix 

V _ Pv • (Pn + Pv) _ Pf! ■ Pv 
lL v — — 

mK tTiK 

Combining both results we obtain m 2 K — m 2 + 2p^ ■ p v , so 

E,i = 7), + m /x = mK + m ' 1 = 258.4 MeV, 

2 m % 

2 1 
mi — mf. 

E v = T v = —-- 'E = 235.6 MeV. 

2 m k 

As another example, in the production of a neutral pion by an incident photon according to 
y + p —> 7T° + p' at threshold, the neutral pion and proton are created at rest in the cms. 
Therefore, 


s = (p Y + p) 2 = m 2 + 2m p Ey = (p K + p') 2 = (m„ + m p ) 2 , 



4.6 Lorentz Covariance of Maxwell’s Equations 


283 


so Et; — m n 


+ 


2m i 


= 144.7 MeV. 


Exercises 


4.5.1 Two Lorentz transformations are carried out in succession: iq along the x-axis, then 
i >2 along the y-axis. Show that the resultant transformation (given by the product of 
these two successive transformations) cannot be put in the form of a single Lorentz 
transformation. 

Note. The discrepancy corresponds to a rotation. 

4.5.2 Rederive the Lorentz transformation, working entirely in the real space (x°, x 1 , x , x 3 ) 
with x° = A'o = ct. Show that the Lorentz transformation may be written L(v) = 
exp(per), with 


4.5.3 


/ o 

—X 
—M 
V-v 


—X 

0 

0 

0 


-/x —v ^ 

0 0 

0 0 

0 0 ) 


and X, /x, v the direction cosines of the velocity v. 


Using the matrix relation, Eq. (4.136), let the rapidity p\ relate the Lorentz reference 
frames (. x'°,x n ) and Or 0 ,* 1 ). Let p 2 relate (x" 0 ,^" 1 ) and (x'°,x n ). Finally, let p 
relate (x"°, x" 1 ) and (x°, x 1 ). From p — pi + p 2 derive the Einstein velocity addition 
law 


Ul + V2 

V — - 

1 + V\V 2 /c l 

4.6 Lorentz Covariance of Maxwell’s Equations 

If a physical law is to hold for all orientations of our (real) coordinates (that is, to be in¬ 
variant under rotations), the terms of the equation must be covariant under rotations (Sec¬ 
tions 1.2 and 2.6). This means that we write the physical laws in the mathematical form 
scalar = scalar, vector = vector, second-rank tensor = second-rank tensor, and so on. Sim¬ 
ilarly, if a physical law is to hold for all inertial systems, the terms of the equation must be 
covariant under Lorentz transformations. 

Using Minkowski space (ct — x°; x = x 1 , y = x, z — x 3 ), we have a four-dimensional 
space with the metric g jlv (Eq. (4.128), Section 4.5). The Lorentz transformations are linear 
in space and time in this four-dimensional real space. 19 


i9 A group theoretic derivation of the Lorentz transformation in Minkowski space appears in Section 4.5. See also H. Goldstein, 
Classical Mechanics. Cambridge, MA: Addison-Wesley (1951). Chapter 6. The metric equation x? — x 2 = 0. independent of 
reference frame, leads to the Lorentz transformations. 
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Here we consider Maxwell’s equations. 


and the relations 


9B 

V xE=-, 

dt 

a d 

V x H = — + pv, 

dt 

V D = p, 

V • B = 0, 


D = £qE, 


B = /roH. 


(4.140a) 

(4.140b) 
(4.140c) 
(4.140d) 

(4.141) 


The symbols have their usual meanings as given in Section 1.9. For simplicity we assume 
vacuum (e = so, M = Mo)- 

We assume that Maxwell’s equations hold in all inertial systems; that is. Maxwell’s 
equations are consistent with special relativity. (The covariance of Maxwell’s equations 
under Lorentz transformations was actually shown by Lorentz and Poincare before Ein¬ 
stein proposed his theory of special relativity.) Our immediate goal is to rewrite Maxwell’s 
equations as tensor equations in Minkowski space. This will make the Lorentz covariance 
explicit, or manifest. 

In terms of scalar, <p, and magnetic vector potentials. A, we may solve 20 Eq. (4.140d) 
and then (4.140a) by 


B = V x A 
9A 

E =- Vtp. (4.142) 

dt 

Equation (4.142) specifies the curl of A; the divergence of A is still undefined (compare 
Section 1.16). We may, and for future convenience we do, impose a further gauge restric¬ 
tion on the vector potential A: 

V • A + eo/xoTr“ = 0. (4.143) 

dt 

This is the Lorentz gauge relation. It will serve the purpose of uncoupling the differential 
equations for A and tp that follow. The potentials A and q> are not yet completely fixed. 
The freedom remaining is the topic of Exercise 4.6.4. 

Now we rewrite the Maxwell equations in terms of the potentials A and ip. From 
Eqs. (4.140c) for V • D, (4.141) and (4.142), 

9 9A p 

V 2 <p + V-= - —, (4.144) 

dt So 


whereas Eqs. (4.140b) for V x H and (4.142) and Eq. (1.86c) of Chapter 1 yield 


9 2 A dip 

-h V — 

dt 2 dt 


—-—(VV • A — V 2 A} 

sqMo 


pv 
£o ' 


20 Compare Section 1.13, especially Exercise 1.13.10. 


(4.145) 
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Using the Lorentz relation, Eq. (4.143), and the relation eoMO = 1 /c 2 , we obtain 


2 n 


V 2_ll_ 

c 2 3 1 2 

V 2 - 1 — 
c 2 3/ 2 


A = -/ropv, 


P 

cp =-. 

£0 


(4.146) 


Now, the differential operator (see also Exercise 2.7.3) 


is a four-dimensional Laplacian, usually called the d’Alembertian and also sometimes de¬ 
noted by □. It is a scalar by construction (see Exercise 2.7.3). 

For convenience we define 


1 _ A x 


T A 7 

A 5 =-= csqA z 

/x 0 c 

A n — Pr\(f) — 4^ 

IM)C 
2 _ Ay 

— C£qA x , 

— A 

PQC 

- C C(J2T. y , 



If we further define a four-vector current density 

P v x -1 pv V .2 P v z -3 • -0 

- =J , — =J , — = J , P = J0 = J , 

c c c 

then Eq. (4.146) may be written in the form 

3 2 A' x = /*. 


(4.147) 


(4.148) 


(4.149) 


The wave equation (4.149) looks like a four-vector equation, but looks do not constitute 
proof. To prove that it is a four-vector equation, we start by investigating the transformation 
properties of the generalized current j 11 . 

Since an electric charge element de is an invariant quantity, we have 

de — pdx 1 dx 2 dx 3 , invariant. (4.150) 


We saw in Section 2.9 that the four-dimensional volume element dx° dx l dx 2 dx 3 was also 
invariant, a pseudoscalar. Comparing this result, Eq. (2.106), with Eq. (4.150), we see that 
the charge density p must transform the same way as dx ( \ the zeroth component of a four¬ 
dimensional vector dx'-. We put p — /°, with j° now established as the zeroth component 
of a four-vector. The other parts of Eq. (4.148) may be expanded as 


. L pv x p dx 1 .q dx 1 
1 c c dt ^ dx° 


(4.151) 


Since we have just shown that j° transforms as dx °, this means that j 1 transforms as dx 1 . 
With similar results for j 2 and j 3 . We have j' transforming as dx x . proving that j x is a 
four-vector in Minkowski space. 

Equation (4.149), which follows directly from Maxwell’s equations, Eqs. (4.140), is 
assumed to hold in all Cartesian systems (all Lorentz frames). Then, by the quotient rule. 
Section 2.8, A 1 ' is also a vector and Eq. (4.149) is a legitimate tensor equation. 
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Now, working backward, Eq. (4.142) may be written 


dAJ 9A° 

° ; 9x° 9x7 ’ 

1 8 A k dAJ 

Hoc dxJ dx k 

We define a new tensor, 


j = 1,2,3, 


(i, j, k) — cyclic (1,2, 3). 


(4.152) 


9 ; 'A a - 9 a A^ = 


9A a 


dxx 


(/u,X = 0 , 1,2,3), 


an antisymmetric second-rank tensor, since A A is a vector. Written out explicitly. 



( ° 

E x 

Ey 

E z 

\ 


( 0 

~E X 

-Ey 

-E z 

\ 

7 7 fix 

~E X 

0 

-cB z 

CBy 


p/zX 

E x 

0 

~cB z 

CBy 


£0 

~Ey 

cB- 

0 

~cB x 


£0 

Ey 

cB z 

0 

—cB x 



\~ E z 

-CBy 

cB x 

0 

) 


u 

C By 

cB x 

0 

/ 


(4.153) 


Notice that in our four-dimensional Minkowski space E and B are no longer vectors but to¬ 
gether form a second-rank tensor. With this tensor we may write the two nonhomogeneous 
Maxwell equations ((4.140b) and (4.140c)) combined as a tensor equation. 


3 F Xll . 

-r -= A- 

OXfji 


(4.154) 


The left-hand side of Eq. (4.154) is a four-dimensional divergence of a tensor and therefore 
a vector. This, of course, is equivalent to contracting a third-rank tensor 9 /’’ a,/ /9a' v . (com¬ 
pare Exercises 2.7.1 and 2.7.2). The two homogeneous Maxwell equations — (4.140a) for 
V x E and (4.140d) for V • B — may be expressed in the tensor form 


3 f*23 3^31 3El2 

3xi 3x2 9*3 

for Eq. (4.140d) and three equations of the form 

37^30 3 7=02 97^23 

9x2 9x3 3xo 


(4.155) 


(4.156) 


for Eq. (4.140a). (A second equation permutes 120, a third permutes 130.) Since 

3 F /tv 

gA pflV _ y_ _ fl/J-V 

dxx 

is a tensor (of third rank), Eqs. (4.140a) and (4.140d) are given by the tensor equation 


J.X/IV . jVX.fi jfivk _ q 


(4.157) 


From Eqs. (4.155) and (4.156) you will understand that the indices X. //, and v are supposed 
to be different. Actually Eq. (4.157) automatically reduces to 0 = 0 if any two indices 
coincide. An alternate form of Eq. (4.157) appears in Exercise 4.6.14. 
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Lorentz Transformation of E and B 


The construction of the tensor equations ((4.154) and (4.157)) completes our initial goal of 
rewriting Maxwell’s equations in tensor form. 21 Now we exploit the tensor properties of 
our four vectors and the tensor /-), l; . 

For the Lorentz transformation corresponding to motion along the ~(x 3 )-axis with ve¬ 
locity v, the “direction cosines” are given by 22 


where 


and 


x'°=y(x°-/3 x 3 ) 
x ,3 = y{x 3 -P jr°), 



c 


K = (l — ft 2 ) V2 ■ 


(4.158) 


(4.159) 


Using the tensor transformation properties, we may calculate the electric and magnetic 
fields in the moving system in terms of the values in the original reference frame. From 
Eqs. (2.66), (4.153), and (4.158) we obtain 


and 


E' 


E’ 


E’ 


1 

7^ 

i 

E z 





K 

B 'y 

K 


i 

i 

Tw 1 

B z . 





(4.160) 


(4.161) 


This coupling of E and B is to be expected. Consider, for instance, the case of zero electric 
field in the unprimed system 


E x — E y = E z — 0. 


- 1 Modern theories of quantum electrodynamics and elementary particles are often written in this "manifestly covariant” form 
to guarantee consistency with special relativity. Conversely, the insistence on such tensor form has been a useful guide in the 
construction of these theories. 

22 A group theoretic derivation of the Lorentz transformation appears in Section 4.5. See also Goldstein, loc. cit., Chapter 6. 
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Clearly, there will be no force on a stationary charged particle. When the particle is in 
motion with a small velocity v along the 4 -axis , 23 an observer on the particle sees fields 
(exerting a force on his charged particle) given by 

K = ~VBy, 

E' y = vB x , 

where B is a magnetic induction field in the unprimed system. These equations may be put 
in vector form. 


E' = v x B 


or (4.162) 

F^jvxB, 

which is usually taken as the operational definition of the magnetic induction B. 


Electromagnetic Invariants 

Finally, the tensor (or vector) properties allow us to construct a multitude of invariant 
quantities. A more important one is the scalar product of the two four-dimensional vectors 
or four-vectors A, and j;. We have 


.1 , P V X . PVy , pv z 

A jx = ~cs 0 A x - cs 0 A v —- - c£ 0 A ,—- + e 0 <pp 

c c c 

— eo(p(p — A • J), invariant, (4.163) 

with A the usual magnetic vector potential and J the ordinary current density. The first 
term, pep, is the ordinary static electric coupling, with dimensions of energy per unit vol¬ 
ume. Hence our newly constructed scalar invariant is an energy density. The dynamic in¬ 
teraction of field and current is given by the product A • J. This invariant A' j-, appears in 
the electromagnetic Lagrangians of Exercises 17.3.6 and 17.5.1. 

Other possible electromagnetic invariants appear in Exercises 4.6.9 and 4.6.11. 

The Lorentz group is the symmetry group of electrodynamics, of the electroweak gauge 
theory, and of the strong interactions described by quantum chromodynamics: It governs 
special relativity. The metric of Minkowski space-time is Lorentz invariant and expresses 
the propagation of light; that is, the velocity of light is the same in all inertial frames. 
Newton’s equations of motion are straightforward to extend to special relativity. The kine¬ 
matics of two-body collisions are important applications of vector algebra in Minkowski 
space-time. 


23 If the velocity is not small, a relativistic transformation of force is needed. 



4.6 Lorentz Covariance of Maxwell’s Equations 


289 


Exercises 


4 . 6.1 


4 . 6.2 


4 . 6.3 

4 . 6.4 


(a) Show that every four-vector in Minkowski space may be decomposed into an or¬ 
dinary three-space vector and a three-space scalar. Examples: (ct , r), (p, pv/c), 
(e 0 <P, ceoA), (E/c, p), (co/c, k). 

Hint. Consider a rotation of the three-space coordinates with time fixed. 

(b) Show that the converse of (a) is not true — every three-vector plus scalar does not 
form a Minkowski four-vector. 


(a) Show that 

= 3-7 = ^= 0 . 

oxn 

(b) Show how the previous tensor equation may be interpreted as a statement of con¬ 
tinuity of charge and current in ordinary three-dimensional space and time. 

(c) If this equation is known to hold in all Lorentz reference frames, why can we not 
conclude that j :l is a vector? 

Write the Lorentz gauge condition (Eq. (4.143)) as a tensor equation in Minkowski 
space. 

A gauge transformation consists of varying the scalar potential tp\ and the vector poten¬ 
tial Ai according to the relation 

, 3x 

<P2 = <P\ + -r-. 

dt 

A 2 = Ai — V*. 


The new function / is required to satisfy the homogeneous wave equation 

dt 2 

Show the following: 


v2 x-^tS = 0. 


(a) The Lorentz gauge relation is unchanged. 

(b) The new potentials satisfy the same inhomogeneous wave equations as did the 
original potentials. 

(c) The fields E and B are unaltered. 


The invariance of our electromagnetic theory under this transformation is called gauge 
invariance. 

4 . 6.5 A charged particle, charge q, mass m , obeys the Lorentz covariant equation 

i — r Pv, 

ax some 

where p v is the four-momentum vector (E/c; p , p 2 , p 3 ), r is the proper time, dx = 
dty /1 — v 2 /c 2 , a Lorentz scalar. Show that the explicit space-time forms are 

dE d\) 

— =q\-E; — =<?(E + vxB). 

dt dt 
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4 . 6.6 From the Lorentz transformation matrix elements (Eq. (4.158)) derive the Einstein ve¬ 
locity addition law 

, u — v u! + v 

u = - 3 - or u = -r-, 

1 — ( uv/c 2 ) 1 + ( u'v/c 2 ) 

where u — cdx 3 /dx° and u' = cdx' 3 /dx'°. 

Hint. If L 12 (f) is the matrix transforming system 1 into system 2, L 23 (r/ / ) the matrix 
transforming system 2 into system 3, I_i 3 (m) the matrix transforming system 1 directly 
into system 3, then I_i 3 (n) = \- 23 (u')\-i 2 (v). From this matrix relation extract the Ein¬ 
stein velocity addition law. 

4 . 6.7 The dual of a four-dimensional second-rank tensor B may be defined by B, where the 
elements of the dual tensor are given by 

B ij = -s ijkl B kl . 

2 ! 

Show that B transforms as 


(a) a second-rank tensor under rotations, 

(b) a pseudotensor under inversions. 


4 . 6.8 


4 . 6.9 


Note. The tilde here does not mean transpose. 

Construct F, the dual of F, where F is the electromagnetic tensor given by Eq. (4.153). 


ANS. W v = £ 0 


/ 0 

—cB x 

C B y 

~cB z \ 

cB x 

0 

E z 

-Ey 

C By 

~E Z 

0 

E x 

\ c Bz 

Ey 

~E X 

0 ) 


This corresponds to 


cB 


-E, 


E 


cB. 


This transformation, sometimes called a dual transformation, leaves Maxwell’s equa¬ 
tions in vacuum (p — 0) invariant. 

Because the quadruple contraction of a fourth-rank pseudotensor and two second-rank 
tensors s^,x va F^ 1 F va is clearly a pseudoscalar, evaluate it. 

ANS. — 8£qcB • E. 


4 . 6.10 (a) If an electromagnetic field is purely electric (or purely magnetic) in one particular 

Lorentz frame, show that E and B will be orthogonal in other Lorentz reference 
systems. 

(b) Conversely, if E and B are orthogonal in one particular Lorentz frame, there exists 
a Lorentz reference system in which E (or B) vanishes. Find that reference system. 
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4.6.11 Show that c 2 B 2 - E 2 is a Lorentz scalar. 

4.6.12 Since (dx°, dx l , dx 2 , dx 2 ) is a four-vector, dx/, dx 1 ' is a scalar. Evaluate this scalar 
for a moving particle in two different coordinate systems: (a) a coordinate system fixed 
relative to you (lab system), and (b) a coordinate system moving with a moving particle 
(velocity v relative to you). With the time increment labeled dr in the particle system 
and dt in the lab system, show that 


4.6.13 


dr — dtJ 1 — v 2 /c 2 . 

r is the proper time of the particle, a Lorentz invariant quantity. 


Expand the scalar expression 


-- -F fJLV F> iv +-j tl A» 
4 £o So 


in terms of the fields and potentials. The resulting expression is the Lagrangian density 
used in Exercise 17.5.1. 


4.6.14 Show that Eq. (4.157) may be written 


SafjyS ' 


dF 01 ? 

3x v 


= 0 . 


4.7 Discrete Groups 

Here we consider groups with a finite number of elements. In physics, groups usually ap¬ 
pear as a set of operations that leave a system unchanged, invariant. This is an expression 
of symmetry. Indeed, a symmetry may be defined as the invariance of the Hamiltonian of a 
system under a group of transformations. Symmetry in this sense is important in classical 
mechanics, but it becomes even more important and more profound in quantum mechan¬ 
ics. In this section we investigate the symmetry properties of sets of objects (atoms in a 
molecule or crystal). This provides additional illustrations of the group concepts of Sec¬ 
tion 4.1 and leads directly to dihedral groups. The dihedral groups in turn open up the study 
of the 32 crystallographic point groups and 230 space groups that are of such importance 
in crystallography and solid-state physics. It might be noted that it was through the study 
of crystal symmetries that the concepts of symmetry and group theory entered physics. In 
physics, the abstract group conditions often take on direct physical meaning in terms of 
transformations of vectors, spinors, and tensors. 

As a simple, but not trivial, example of a finite group, consider the set 1 ,a,b,c that 
combine according to the group multiplication table 24 (see Fig. 4.10). Clearly, the four 
conditions of the definition of “group” are satisfied. The elements a,b,c, and 1 are ab¬ 
stract mathematical entities, completely unrestricted except for the multiplication table of 
Fig. 4.10. 

Now, for a specific representation of these group elements, let 

1—>1, a—> i, b—*—X, c—>—i, 

~ 4 The order of the factors is row-column: ab = c in the indicated previous example. 


(4.164) 
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1 

a 

1 b \ 

1 1 

c 

1 

1 

a 

1 1 

! b \ 

c 

a 

a 

b 

' c i 

\ 

b 

b 

c 

1 

a 

c 

c 

1 

a 

b 


Figure 4.10 Group 
multiplication table. 


combining by ordinary multiplication. Again, the four group conditions are satisfied, and 
these four elements form a group. We label this group C 4 . Since the multiplication of 
the group elements is commutative, the group is labeled commutative, or abelian. Our 
group is also a cyclic group, in that the elements may be written as successive powers of 
one element, in this case i n , n = 0, 1,2, 3. Note that in writing out Eq. (4.164) we have 
selected a specific faithful representation for this group of four objects, C 4 . 

We recognize that the group elements 1, i, — 1, —i may be interpreted as successive 90° 
rotations in the complex plane. Then, from Eq. (3.74), we create the set of four 2x2 matri¬ 
ces (replacing <p by —cp in Eq. (3.74) to rotate a vector rather than rotate the coordinates): 


( cos w — sin w 
sin q) cos qi 

and for cp — 0, tt/2, 7 r, and 3jt/2 we have 



(4.165) 


This set of four matrices forms a group, with the law of combination being matrix multipli¬ 
cation. Here is a second faithful representation. By matrix multiplication one verifies that 
this representation is also abelian and cyclic. Clearly, there is a one-to-one correspondence 
of the two representations 


1-** 1 1 <7 A o-— 1 ** B c«-io C. (4.166) 


In the group C 4 the two representations (1, i, — 1, —i) and (1, A, B, C) are isomorphic. 

In contrast to this, there is no such correspondence between either of these representa¬ 
tions of group C 4 and another group of four objects, the vierergruppe (Exercise 3.2.7). The 


Table 4.3 



1 

Vi 

y 2 

y 3 

1 

1 

Vi 

y 2 

y 3 

Ti 

Vi 

1 

y 3 

y 2 

y 2 

El 

Fa 

1 

Vi 

y 3 


v 2 

Ti 

1 
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vierergruppe has the multiplication table shown in Table 4.3. Confirming the lack of cor¬ 
respondence between the group represented by (1, i, — 1 , —i) or the matrices (1, A, B, C) 
of Eq. (4.165), note that although the vierergruppe is abelian, it is not cyclic. The cyclic 
group C 4 and the vierergruppe are not isomorphic. 


Classes and Character 

Consider a group element x transformed into a group element y by a similarity transform 
with respect to gj , an element of the group 

giXgy X =y. (4.167) 

The group element y is conjugate to x. A class is a set of mutually conjugate group ele¬ 
ments. In general, this set of elements forming a class does not satisfy the group postulates 
and is not a group. Indeed, the unit element 1, which is always in a class by itself, is the 
only class that is also a subgroup. All members of a given class are equivalent, in the sense 
that any one element is a similarity transform of any other element. Clearly, if a group is 
abelian, every element is a class by itself. We find that 

1. Every element of the original group belongs to one and only one class. 

2. The number of elements in a class is a factor of the order of the group. 

We get a possible physical interpretation of the concept of class by noting that y is a 
similarity transform of x. If gj represents a rotation of the coordinate system, then y is the 
same operation as x but relative to the new, related coordinates. 

In Section 3.3 we saw that a real matrix transforms under rotation of the coordinates 
by an orthogonal similarity transformation. Depending on the choice of reference frame, 
essentially the same matrix may take on an infinity of different forms. Likewise, our group 
representations may be put in an infinity of different forms by using unitary transforma¬ 
tions. But each such transformed representation is isomorphic with the original. From Ex¬ 
ercise 3.3.9 the trace of each element (each matrix of our representation) is invariant under 
unitary transformations. Just because it is invariant, the trace (relabeled the character) as¬ 
sumes a role of some importance in group theory, particularly in applications to solid-state 
physics. Clearly, all members of a given class (in a given representation) have the same 
character. Elements of different classes may have the same character, but elements with 
different characters cannot be in the same class. 

The concept of class is important (1) because of the trace or character and (2) because 
the number of nonequivalent irreducible representations of a group is equal to the 
number of classes. 

Subgroups and Cosets 

Frequently a subset of the group elements (including the unit element I) will by itself 
satisfy the four group requirements and therefore is a group. Such a subset is called a sub¬ 
group. Every group has two trivial subgroups: the unit element alone and the group itself. 
The elements 1 and b of the four-element group C 4 discussed earlier form a nontrivial 
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subgroup. In Section 4.1 we consider S0(3), the (continuous) group of all rotations in or¬ 
dinary space. The rotations about any single axis form a subgroup of SO(3). Numerous 
other examples of subgroups appear in the following sections. 

Consider a subgroup H with elements /;, and a group element x not in H. Then xhj and 
hix are not in subgroup H. The sets generated by 

xhj, i — 1,2 ,... and hjx, i — 1,2,... 

are called cosets, respectively the left and right cosets of subgroup H with respect to a. It 
can be shown (assume the contrary and prove a contradiction) that the coset of a subgroup 
has the same number of distinct elements as the subgroup. Extending this result we may 
express the original group G as the sum of H and cosets: 

G = H + xiH+ x 2 H+ ■■■ . 

Then the order of any subgroup is a divisor of the order of the group. It is this result 
that makes the concept of coset significant. In the next section the six-element group Z >3 
(order 6) has subgroups of order 1, 2, and 3. />, cannot (and does not) have subgroups of 
order 4 or 5. 

The similarity transform of a subgroup H by a fixed group element x not in //. x Hx~ ] , 
yields a subgroup — Exercise 4.7.8. If this new subgroup is identical with H for all x, that 
is, 

xHx~ l = H, 

then H is called an invariant, normal, or self-conjugate subgroup. Such subgroups are 
involved in the analysis of multiplets of atomic and nuclear spectra and the particles dis¬ 
cussed in Section 4.2. All subgroups of a commutative (abelian) group are automatically 
invariant. 


Two Objects — Twofold Symmetry Axis 

Consider first the two-dimensional system of two identical atoms in the xy-plane at (1, 
0) and (—1, 0), Fig. 4.11. What rotations 25 can be carried out (keeping both atoms in the 
Ay-plane) that will leave this system invariant? The first candidate is, of course, the unit 
operator 1. A rotation of n radians about the "-axis completes the list. So we have a rather 
uninteresting group of two members (1, —1). The "-axis is labeled a twofold symmetry 
axis — corresponding to the two rotation angles, 0 and jt, that leave the system invariant. 

Our system becomes more interesting in three dimensions. Now imagine a molecule 
(or part of a crystal) with atoms of element X at ±a on the A'-axis, atoms of element Y 
at ±b on the y-axis, and atoms of element Z at ±c on the "-axis, as show in Fig. 4.12. 
Clearly, each axis is now a twofold symmetry axis. Using R x (jt) to designate a rotation of 
Tt radians about the A-axis, we may 


- 5 Here we deliberately exclude reflections and inversions. They must be brought in to develop the full set of 32 crystallographic 
point groups. 
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Figure 4.1 1 Diatomic molecules H?, N 2 , O 2 , 
Cl 2 . 



Figure 4.12 D 2 symmetry. 


set up a matrix representation of the rotations as in Section 3.3: 



n 

0 

°\ 


/-! 


0 

0 \ 

R.y(7T) = 

0 

-1 

» 

, Ry(^) = 

0 


1 

0 


\0 

0 -\) 


l 0 


0 

-1/ 


/-I 

0 

0) 


/I 

0 

°\ 


R z (tt) = 

0 

-1 

0 

1 = 

0 

1 

0 



l 0 

0 

ly 


\0 

0 

V 



(4.168) 


These four elements [ 1, R v (n ), R v (n ), R-(tt) | form an abelian group, with the group mul¬ 
tiplication table shown in Table 4.4. 

The products shown in Table 4.4 can be obtained in either of two distinct ways: 
(1) We may analyze the operations themselves — a rotation of n about the .r-axis fol¬ 
lowed by a rotation of jt about the y-axis is equivalent to a rotation of jt about the ’-axis: 
R v (7T) R v (7T) = R-(tt). (2) Alternatively, once a faithful representation is established, we 
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Table 4.4 



1 

R.v 60 

RyOr) 

R-(w) 

1 

1 

R, 

Ry 

R.v 

R.vbr) 

R.v 

1 

R ; 

Ry 

Rybr) 

Ry 

R, 

1 

R.v 

R,(;r) 

R* 

Ry 

R* 

1 


can obtain the products by matrix multiplication. This is where the power of mathematics 
is shown — when the system is too complex for a direct physical interpretation. 

Comparison with Exercises 3.2.7, 4.7.2, and 4.7.3 shows that this group is the vier- 
ergruppe. The matrices of Eq. (4.168) are isomorphic with those of Exercise 3.2.7. Also, 
they are reducible, being diagonal. The subgroups are (1, R t ), (1, R y ), and (1, R-). They 
are invariant. It should be noted that a rotation of ir about the y-axis and a rotation of n 
about the "-axis is equivalent to a rotation of jt about the y-axis: R-(7r)Ry(7r) = R x - (it). 
In symmetry terms, if y and z are twofold symmetry axes, x is automatically a twofold 
symmetry axis. 

This symmetry group, 26 the vierergruppe, is often labeled /.T, the D signifying a dihe¬ 
dral group and the subscript 2 signifying a twofold symmetry axis (and no higher symmetry 
axis). 


Three Objects — Threefold Symmetry Axis 


Consider now three identical atoms at the vertices of an equilateral triangle. Fig. 4.13. 
Rotations of the triangle of 0, 2jt/3, and 47 t/3 leave the triangle invariant. In matrix form, 
we have 27 


1 = R, (0) 


0 

1 


A=R,(2;r/3) 


/cos27r/3 — sin 2 jt/ 3 
l sin 2 jt/ 3 cos27r/3 


B = R,(4tt/3) = 



73/2 \ 
— 1/2/ 


/_1/2 -V3/2\ 
\V3/2 -1/2 / 


(4.169) 


The z-axis is a threefold symmetry axis. (1, A, B) form a cyclic group, a subgroup of the 
complete six-element group that follows. 

In the xy-plane there are three additional axes of symmetry — each atom (vertex) and 
the geometric center defining an axis. Each of these is a twofold symmetry axis. These rota¬ 
tions may most easily be described within our two-dimensional framework by introducing 


-®A symmetry group is a group of symmetry-preserving operations, that is, rotations, reflections, and inversions. A symmetric 
group is the group of permutations of n distinct objects — of order n\. 

27 Note that here we are rotating the triangle counterclockwise relative to fixed coordinates. 
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Figure 4.13 Symmetry operations on an 
equilateral triangle. 


reflections. The rotation of jr about the C- (or y-) axis, which means the interchanging of 
(structureless) atoms a and c, is just a reflection of the .r-axis: 


C = R c(7r) = 




(4.170) 


We may replace the rotation about the Z)-axis by a rotation of 4n/3 (about our z-axis) 
followed by a reflection of the jc-axis (x —> —x) (Fig. 4.14): 



Figure 4.14 The triangle on the right is the triangle on 
the left rotated 180° about the /Taxis. D = CB. 
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In a similar manner, the rotation of jt about the /Taxis, interchanging a and b, is replaced 
by a rotation of 27t/3(A) and then a reflection 28 of the x-axis: 


E = R^ (jx ) = CA 

/-I oW- 1/2 -V3/2\ 

\° l)\V3/2 -I/ 2 ) 

= I 1/2 73/2 \ 

\V3/2 -I/ 2 )' 


The complete group multiplication table is 



1 

A 

B 

C 

D 

E 

1 

1 

A 

B 

c 

D 

E 

A 

A 

B 

1 

D 

E 

C 

B 

B 

1 

A 

E 

C 

D 

C 

C 

E 

D 

1 

B 

A 

D 

D 

C 

E 

A 

1 

B 

E 

E 

D 

C 

B 

A 

1 


(4.172) 


Notice that each element of the group appears only once in each row and in each column, as 
required by the rearrangement theorem. Exercise 4.7.4. Also, from the multiplication table 
the group is not abelian. We have constructed a six-element group and a 2 x 2 irreducible 
matrix representation of it. The only other distinct six-element group is the cyclic group 
[1, R, R 2 , R 3 , R 4 , R 5 ], with 


R = e 27Ti/6 


R = = 




(4.173) 


Our group [1 , A, B, C, D, E] is labeled D 3 in crystallography, the dihedral group with a 
threefold axis of symmetry. The three axes (C, D , and E) in the xy-plane automatically 
become twofold symmetry axes. As a consequence, (1 , C), (1 , D), and (1 , E) all form 
two-element subgroups. None of these two-element subgroups of Dj, is invariant. 

A general and most important result for finite groups of h elements is that 


^n 2 = /i, (4.174) 

i 

where n, is the dimension of the matrices of the ;th irreducible representation. This equal¬ 
ity, sometimes called the dimensionality theorem, is very useful in establishing the irre¬ 
ducible representations of a group. Here for />, we have l 2 + l 2 + 2 2 = 6 for our three 
representations. No other irreducible representations of this symmetry group of three ob¬ 
jects exist. (The other representations are the identity and ±1, depending upon whether a 
reflection was involved.) 


- x Notc that, as a consequence of these reflections, det(C) = det(D) = det(E) = — 1. The rotations A and B, of course, have a 
determinant of +1. 
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H 



Figure 4.15 Ruthenocene. 


Dihedral Groups, D n 

A dihedral group D n with an n-fold symmetry axis implies n axes with angular separation 
of 2n/n radians, n is a positive integer, but otherwise unrestricted. If we apply the symme¬ 
try arguments to crystal lattices, then n is limited to 1,2, 3, 4, and 6. The requirement of 
invariance of the crystal lattice under translations in the plane perpendicular to the «-fold 
axis excludes n — 5, 7, and higher values. Try to cover a plane completely with identical 
regular pentagons and with no overlapping. 29 For individual molecules, this constraint does 
not exist, although the examples with n > 6 are rare, n — 5 is a real possibility. As an ex¬ 
ample, the symmetry group for ruthenocene, (CA/AhRu, illustrated in Fig. 4.15, is LA- 30 

Crystallographic Point and Space Groups 

The dihedral groups just considered are examples of the crystallographic point groups. 
A point group is composed of combinations of rotations and reflections (including inver¬ 
sions) that will leave some crystal lattice unchanged. Limiting the operations to rotations 
and reflections (including inversions) means that one point — the origin—remains fixed, 
hence the term point group. Including the cyclic groups, two cubic groups (tetrahedron 
and octahedron symmetries), and the improper forms (involving reflections), we come to a 
total of 32 crystallographic point groups. 


29 For .Dg imagine a plane covered with regular hexagons and the axis of rotation through the geometric center of one of them. 
39 Actually the full technical label is D 5 / 2 , with h indicating invariance under a reflection of the fivefold axis. 
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If, to the rotation and reflection operations that produced the point groups, we add the 
possibility of translations and still demand that some crystal lattice remain invariant, we 
come to the space groups. There are 230 distinct space groups, a number that is appalling 
except, possibly, to specialists in the field. For details (which can cover hundreds of pages) 
see the Additional Readings. 


Exercises 


4.7.1 Show that the matrices 1, A, B, and C of Eq. (4.165) are reducible. Reduce them. 

Note. This means transforming A and C to diagonal form (by the same unitary transfor¬ 
mation). 

Hint. A and C are anti-Hermitian. Their eigenvectors will be orthogonal. 

4.7.2 Possible operations on a crystal lattice include A K (rotation by tv), m (reflection), and i 
(inversion). These three operations combine as 

A 2 = m 2 = i 2 — 1, 

A n ■ m = i, m ■ i — A n , and i ■ A„ — m. 

Show that the group (1, A n , m, i ) is isomorphic with the vierergruppe. 

4.7.3 Four possible operations in the xv-plane are: 


1 . 

2 . 

3. 

4. 


no change 


inversion 


reflection 


reflection 



x 

y 



—x 

-y 



—x 

y 



X 

-y- 


(a) Show that these four operations form a group. 

(b) Show that this group is isomorphic with the vierergruppe. 

(c) Set up a 2 x 2 matrix representation. 


4.7.4 Rearrangement theorem: Given a group of n distinct elements (7, a,b,c ,..., n), show 
that the set of products ( al , a 2 , ab, ac... an) reproduces the n distinct elements in a 
new order. 

4.7.5 Using the 2x2 matrix representation of Exercise 3.2.7 for the vierergruppe, 


(a) Show that there are four classes, each with one element. 
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(b) Calculate the character (trace) of each class. Note that two different classes may 
have the same character. 

(c) Show that there are three two-element subgroups. (The unit element by itself al¬ 
ways forms a subgroup.) 

(d) For any one of the two-element subgroups show that the subgroup and a single 
coset reproduce the original vierergruppe. 

Note that subgroups, classes, and cosets are entirely different. 

4.7.6 Using the 2x2 matrix representation, Eq. (4.165), of C 4 , 

(a) Show that there are four classes, each with one element. 

(b) Calculate the character (trace) of each class. 

(c) Show that there is one two-element subgroup. 

(d) Show that the subgroup and a single coset reproduce the original group. 


4.7.7 Prove that the number of distinct elements in a coset of a subgroup is the same as the 
number of elements in the subgroup. 

4.7.8 A subgroup H has elements /;, . Let x be a fixed element of the original group G and 
not a member of H. The transform 


xlijx 1 , i = l, 2 ,... 

generates a conjugate subgroup xHx~ l . Show that this conjugate subgroup satisfies 
each of the four group postulates and therefore is a group. 

4.7.9 (a) A particular group is abelian. A second group is created by replacing g, by g ~ 1 

for each element in the original group. Show that the two groups are isomorphic. 
Note. This means showing that if a,T>; — ci, then — c~ l . 

(b) Continuing part (a), if the two groups are isomorphic, show that each must be 
abelian. 


4.7.10 (a) Once you have a matrix representation of any group, a one-dimensional represen¬ 

tation can be obtained by taking the determinants of the matrices. Show that the 
multiplicative relations are preserved in this determinant representation. 

(b) Use determinants to obtain a one-dimensional representative of £> 3 . 


4.7.11 Explain how the relation 


J2 n t = h 

i 

applies to the vierergruppe (/; = 4) and to the dihedral group £>3 with h = 6 . 

4.7.12 Show that the subgroup (1, A, B) of £>3 is an invariant subgroup. 

4.7.13 The group £>3 may be discussed as a permutation group of three objects. Matrix B, for 
instance, rotates vertex a (originally in location 1 ) to the position formerly occupied by c 
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4.7.14 


4.7.15 


4.7.16 


4.7.17 


4.7.18 


(location 3). Vertex b moves from location 2 to location 1, and so on. As a permutation 
(abe) -> (bca). In three dimensions 


°\ 

( a\ 


(b\ 

1 

b 

= 

c 

0 / 

\ c ) 


\ a J 


(a) Develop analogous 3x3 representations for the other elements of Dj. 

(b) Reduce your 3x3 representation to the 2x2 representation of this section. 

(This 3x3 representation must be reducible or Eq. (4.174) would be violated.) 

Note. The actual reduction of a reducible representation may be awkward. It is often 
easier to develop directly a new representation of the required dimension. 

(a) The permutation group of four objects P 4 has 4! = 24 elements. Treating the four 
elements of the cyclic group C4 as permutations, set up a 4 x 4 matrix representa¬ 
tion of C 4 . C 4 that becomes a subgroup of P 4 . 

(b) How do you know that this 4x4 matrix representation of C 4 must be reducible? 
Note. C4 is abelian and every abelian group of h objects has only h one-dimensional 
irreducible representations. 

(a) The objects (abed) are permuted to ( dacb ). Write out a 4 x 4 matrix representation 
of this one permutation. 

(b) Is the permutation ( abdc ) —»• (dacb) odd or even? 

(c) Is this permutation a possible member of the D4 group? Why or why not? 

The elements of the dihedral group D n may be written in the form 

S ; ‘R(''(27r/«), 1 = 0,1 

H = 0, 1 ,..., n — 1, 

where R z (2n/n) represents a rotation of 2 jt/u about the n-fold symmetry axis, whereas 
S represents a rotation of n about an axis through the center of the regular polygon and 
one of its vertices. 

For S = E show that this form may describe the matrices A, B, C, and D of £> 3 . 

Note. The elements R- and S are called the generators of this finite group. Similarly, 
i is the generator of the group given by Eq. (4.164). 

Show that the cyclic group of n objects, C n , may be represented by r m , m — 
0, 1,2,..., n — 1. Here r is a generator given by 

r — exp( 2 jtis/n). 

The parameter 5 takes on the values 5 = 1,2, 3, ...,n, each value of s yielding a differ¬ 
ent one-dimensional (irreducible) representation of C„. 

Develop the irreducible 2x2 matrix representation of the group of operations (rotations 
and reflections) that transform a square into itself. Give the group multiplication table. 
Note. This is the symmetry group of a square and also the dihedral group D4. (See 
Fig. 4.16.) 
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4.7.19 

4.7.20 

4.7.21 



Figure 4.16 
Square. 



Figure 4.17 Hexagon. 

The permutation group of four objects contains 4! = 24 elements. From Exercise 4.7.18, 

£> 4 , the symmetry group for a square, has far fewer than 24 elements. Explain the rela¬ 
tion between D\ and the permutation group of four objects. 

A plane is covered with regular hexagons, as shown in Fig. 4.17. 

(a) Determine the dihedral symmetry of an axis perpendicular to the plane through the 
common vertex of three hexagons (A). That is, if the axis has n-fold symmetry, 
show (with careful explanation) what n is. Write out the 2x2 matrix describing 
the minimum (nonzero) positive rotation of the array of hexagons that is a member 
of your D n group. 

(b) Repeat part (a) for an axis perpendicular to the plane through the geometric center 
of one hexagon (B). 

In a simple cubic crystal, we might have identical atoms at r — (la, ma, na), with /, in, 

and n taking on all integral values. 

(a) Show that each Cartesian axis is a fourfold symmetry axis. 

(b) The cubic group will consist of all operations (rotations, reflections, inversion) that 
leave the simple cubic crystal invariant. From a consideration of the permutation 





304 


Chapter 4 Group Theory 


N. X 



y\ 

1 

A - - 

1 

1 

1 - - 

A 

A 

A - - 


Figure 4.18 
Multiplication table. 


of the positive and negative coordinate axes, predict how many elements this cubic 
group will contain. 


4.7.22 (a) From the £>3 multiplication table of Fig. 4.18 construct a similarity transform table 

showing xyx~ l , where x and y each range over all six elements of Dy. 

(b) Divide the elements of £>3 into classes. Using the 2x2 matrix representation of 
Eqs. (4.169)-(4.172) note the trace (character) of each class. 

4.8 Differential Forms 

In Chapters 1 and 2 we adopted the view that, in n dimensions, a vector is an n -tuple of real 
numbers and that its components transform properly under changes of the coordinates. In 
this section we start from the alternative view, in which a vector is thought of as a directed 
line segment, an arrow. The point of the idea is this: Although the concept of a vector as 
a line segment does not generalize to curved space-time (manifolds of differential geom¬ 
etry), except by working in the flat tangent space requiring embedding in auxiliary extra 
dimensions, Elie Cartan’s differential forms are natural in curved space-time and a very 
powerful tool. Calculus can be based on differential forms, as Edwards has shown by his 
classic textbook (see the Additional Readings). Cartan’s calculus leads to a remarkable 
unification of concepts and theorems of vector analysis that is worth pursuing. In differ¬ 
ential geometry and advanced analysis (on manifolds) the use of differential forms is now 
widespread. 

Cartan’s notion of vector is based on the one-to-one correspondence between the linear 
spaces of displacement vectors and directional differential operators (components of the 
gradient form a basis). A crucial advantage of the latter is that they can be generalized to 
curved space-time. Moreover, describing vectors in terms of directional derivatives along 
curves uniquely specifies the vector at a given point without the need to invoke coordinates. 
Ultimately, since coordinates are needed to specify points, the Cartan formalism, though 
an elegant mathematical tool for the efficient derivation of theorems on tensor analysis, has 
in principle no advantage over the component formalism. 


1-Forms 

We define dx,dy,dz in three-dimensional Euclidean space as functions assigning to a 
directed line segment P Q from the point P to the point Q the corresponding change in 
x,y,z. The symbol dx represents “oriented length of the projection of a curve on the 
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x-axis,” etc. Note that dx. dy , dz can be, but need not be, infinitesimally small, and they 
must not be confused with the ordinary differentials that we associate with integrals 
and differential quotients. A function of the type 

Adx + Bdy + Cdz, A, B, C real numbers (4.175) 

is defined as a constant 1-form. 


Example 4.8.1 Constant 1 -Form 

For a constant force F = (A, B, C), the work done along the displacement from P — 
(3, 2, 1) to Q — (4, 5, 6) is therefore given by 

W = A( 4 - 3) + B(5 - 2) + C(6 — 1) = A + 3B + 5C. 

If F is a force field, then its rectangular components A(x, y, z ), B(x. y, z), C (x . y, z) 
will depend on the location and the (nonconstant) 1-form dW — F ■ dr corresponds to 
the concept of work done against the force field F(r) along dr on a space curve. A finite 
amount of work 

W — J \A(x,y,z)dx + B(x,y,z)dy + C(x,y,z)dz\ (4.176) 

involves the familiar line integral along an oriented curve C, where the 1-form dW de¬ 
scribes the amount of work for small displacements (segments on the path C). In this light, 
the integrand f{x)dx of an integral f f (x) dx consisting of the function / and of the 
measure dx as the oriented length is here considered to be a 1-form. The value of the 
integral is obtained from the ordinary line integral. ■ 


2-Forms 

Consider a unit flow of mass in the "-direction, that is, a flow in the direction of increasing 
z so that a unit mass crosses a unit square of the xy-plane in unit time. The orientation 
symbolized by the sequence of points in Fig. 4.19, 

( 0 , 0 , 0 )-> ( 1 , 0 , 0 )-* ( 1 , 1 , 0 )-* ( 0 , 1 , 0 ) —> ( 0 , 0 , 0 ), 

will be called counterclockwise, as usual. A unit flow in the 7 -direction is defined by the 
function dx t/y 31 assigning to oriented rectangles in space the oriented area of their projec¬ 
tions on the xy-plane. Similarly, a unit flow in the x -direction is described by dy dz and a 
unit flow in the y-direction by dzdx. The reverse order, dzdx, is dictated by the orienta¬ 
tion convention, and dzdx — —dxdz by definition. This antisymmetry is consistent with 
the cross product of two vectors representing oriented areas in Euclidean space. This no¬ 
tion generalizes to polygons and curved differentiable surfaces approximated by polygons 
and volumes. 


11 Many authors denote this wedge product as dx A dy with dy A dx = —dx A dy. Note that the product dxdy = dy dx for 
ordinary differentials. 
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Figure 4.19 

Counterclockwise-oriented 

rectangle. 


Example 4.8.2 Magnetic Flux Across an Oriented Surface 

If B = (A, B, C) is a constant magnetic induction, then the constant 2-form 

Ady clz + B dzdx + C dx dy 

describes the magnetic flux across an oriented rectangle. If B is a magnetic induction field 
varying across a surface S , then the flux 

= J [B x (r)dydz + B y (r)dzdx + B z (r)dxdy] (4.177) 

across the oriented surface S involves the familiar (Riemann) integration over approximat¬ 
ing small oriented rectangles from which S is pieced together. ■ 

The definition of / to relies on decomposing to = JT &>,-, where the differential forms &>; 
are each nonzero only in a small patch of the surface S that covers the surface. Then it can 
be shown that JT f to, converges, as the patches become smaller and more numerous, to 
the limit / or, which is independent of these decompositions. For more details and proofs, 
we refer the reader to Edwards in the Additional Readings. 


3-Forms 

A 3-form dx dy dz represents an oriented volume. For example, the determinant of three 
vectors in Euclidean space changes sign if we reverse the order of two vectors. The 
determinant measures the oriented volume spanned by the three vectors. In particular, 
f v p(x, y, z)dx dydz represents the total charge inside the volume V if p is the charge 
density. Higher-dimensional differential forms in higher-dimensional spaces are defined 

similarly and are called /.'-forms, with k — 0, 1,2,_ 

If a 3-form 


cu = A(x i, X 2 , x-i) dx i dx 2 dx 3 = A'(x\ , x r 2 , x 2 ) dx\ dx' 2 dx 2 


(4.178) 
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on a 3-dimensional manifold is expressed in terms of new coordinates, then there is a one- 
to-one, differentiable map x- = x\ (xi, xi, X3) between these coordinates with Jacobian 


d(x\, x' 2 , A 3 ) 
3 (ai, A2, A3) 


and A — A! J — A! so that 



A dx 1 dx 2 dx 3 = 



A! dx\ dx' 2 dxy 


(4.179) 


This statement spells out the parameter independence of integrals over differential forms, 
since parameterizations are essentially arbitrary. The rules governing integration of differ¬ 
ential forms are defined on manifolds. These are continuous if we can move continuously 
(actually we assume them differentiable) from point to point, oriented if the orientation of 
curves generalizes to surfaces and volumes up to the dimension of the whole manifold. The 
rules on differential forms are: 


• If co — aw\ + a’(o \, with a , a' real numbers, then f s <x> — a f s a>i+a'f s a>' 1 , where S is 
a compact, oriented, continuous manifold with boundary. 

• If the orientation is reversed, then the integral f s a> changes sign. 


Exterior Derivative 

We now introduce the exterior derivative d of a function /, a 0-form: 

3 f 3/ 3 f 3 f 

df = -fdx + -fdy + -fdz = dx , , (4.180) 

dx ay az ox, 

generating a 1-form &>i = df, the differential of / (or exterior derivative), the gradient 
in standard vector analysis. Upon summing over the coordinates, we have used and will 
continue to use Einstein’s summation convention. Applying the exterior derivative d to a 
1 -form we define 


d(Adx + B dy + Cdz) = dAdx + dBdy + dCdz (4.181) 


with functions A, B,C . This definition in conjunction with df as just given ties vectors 
to differential operators 3,• = . Similarly, we extend d to A'-forms. However, applying 

d twice gives zero, ddf = 0, because 


3 f 3 f 

d(df) = d—dx + d—d\ 
dx dy 


9 2 / , , 9 2 / , 

+ -x—x-dy 
dx L ox dy 


dx 


9 2 / , , 9 2 / 

——t/x + —-jdy 
dyox dy L 


dy 


d 2 f d 2 f 


dy dx dx dy 


dx dy = 0 . 


(4.182) 


This follows from the fact that in mixed partial derivatives their order does not matter 
provided all functions are sufficiently differentiable. Similarly we can show ddo>\ — 0 for 
a 1 -form o >\, etc. 
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The rules governing differential forms, with a>k denoting a A:-form, that we have used so 
far are 

• dx dx — 0 = dy dy — dzdz, dxf — 0 ; 

• dx dy — —dy dx, dx , dxj — —dx j dxi, i ^ j, 

• dx i dx 2 • • • dxk is totally antisymmetric in the dxj , i = 1 , 2 ,..., k. 

• d f = dk dxi '- 

• d(cok + ^ 2 *) = dcok + d£2k, linearity; 

• dda>k = 0. 


Now we apply the exterior derivative d to products of differential forms, starting with 
functions (0-forms). We have 

d{fg) = d( / 8) dx, = + T^-g) dxi = fdg + dfg. (4.183) 

0Xi y oX( oXi J 

If &)] = yyydxj is a 1-form and / is a function, then 


d(fcoi) =d(f^-dx,'j =d(f-^j dxi 

9 (/H) , (df dg d 2 g 

dxj dxi — I -— -h / -—— I dx j dxi 


j \ dxj dxj dxi dxj 


dx 

= dfw i + / dco\, 
J _ 3/ 


as expected. But if — j^-dxj is another 1-form, then 

t/(&)]&)'j) = d(-^-dxj dx: ) = d( ——— ) dxi dx: 
\ dxi dxj ) \ dxj dxj / 

3(°L*L) 

a \9xj 3 xj) 
dxk 


-dxkdxjdx: 


d 2 g df dg d 2 f 

-dxkdxi-—dx j — - — dxi-—-—dxkdxj 


dx/ dxk 


dx: 


dxi dxj dXk 


— dan <x>\ — u>\ dco\. 


(4.184) 


(4.185) 


This proof is valid for more general 1-forms o> — fidxj with functions /, . In general, 
therefore, we define for /.'-forms: 


d(cok(o' k ) — (da>k)co' k + (—l) k a>k(dco' k ). 
In general, the exterior derivative of a k -form is a (k + l)-form. 


(4.186) 



Example 4.8.3 potential energy 
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As an application in two dimensions (for simplicity), consider the potential V (r), a 0-form, 
and dV , its exterior derivative. Integrating V along an oriented path C from ri to r 2 gives 

V (r 2 ) - y(rO = J^dV = (j^dx + Jfdy^j = £ VV • dr, (4.187) 

where the last integral is the standard formula for the potential energy difference that forms 
part of the energy conservation theorem. The path and parameterization independence are 
manifest in this special case. ■ 


Pullbacks 


If a linear map £2 from the wri-plane to the xy-plane has the form 

x = au + bv + c, y = eu + fv + g, (4.188) 

oriented polygons in the wr-plane are mapped onto similar polygons in the xy-plane, pro¬ 
vided the determinant af — be of the map £2 is nonzero. The 2-form 

dxdy = (adu + bdv)(edu + f dv) — (af — be)dudv (4.189) 


can be pulled back from the xy- to the wr-plane. That is to say, an integral over a simply 
connected surface S becomes 

I dxdy —{af —be) I dudv, (4.190) 

JC 2 (S) ' ' Js 

and (af — be) dudv is the pullback of dx dy, opposite to the direction of the map £2 from 
the wr-plane to the xy-plane. Of course, the determinant af — be of the map £2 is simply 
the Jacobian, generated without effort by the differential forms in Eq. (4.189). 

Similarly, a linear map £3 from the wiW2W3-space to the xi x'2X3-space 


Xi—aijUj+bi , i = l,2, 3, 
automatically generates its Jacobian from the 3-form 

dx] dxidxi = I a 1 / duj II ^^02 jduj II a-jj du t 
0=1 '^j =l ''j= 1 

— ( fl llt?22Ll , 33 — a 12^21^33 i • • • )du \ du2 duj, 

( All 012 O13 \ 

021 022 023 I du\ du 2 du^. 

031 O 32 O 33 / 


(4.191) 


(4.192) 


Thus, differential forms generate the rules governing determinants. 

Given two linear maps in a row, it is straightforward to prove that the pullback under 
a composed map is the pullback of the pullback. This theorem is the differential-forms 
analog of matrix multiplication. 
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Let us now consider a curve C defined by a parameter t in contrast to a curve defined 
by an equation. For example, the circle {(cost, sinr); 0 < t < 2tc] is a parameterization 
by t, whereas the circle {(x, y): x 2 + y 2 = 1} is a definition by an equation. Then the line 
integral 


J [A(x, y)dx + B(x, y) dy\ — 


r 

dx dy 

A - V B — 

Jti 

dt dt 


dt 


(4.193) 


for continuous functions A, B, dx/dt, dy/dt becomes a one-dimensional integral over the 
oriented interval tj <t < tf. Clearly, the 1-form [A hj + B'j 2 -] dt on the f-line is obtained 
from the 1-form Adx + B dy on the xy-plane via the map x — x(t), y — y(t) from the 
f-line to the curve C in the .vv-plane. The 1-form [A hj + B $] dt is called the pullback of 
the 1-form Adx + B dy under the map x — x(t), y — y(t). Using pullbacks we can show 
that integrals over 1-forms are independent of the parameterization of the path. 

In this sense, the differential quotient ‘-p- can be considered as the coefficient of dx in the 
pullback of dy under the function y = f ix), or dy — f{x)dx. This concept of pullback 
readily generalizes to maps in three or more dimensions and to k-forms with k > 1. In 
particular, the chain rule can be seen to be a pullback: If 


yi — fi{x i,X 2 , ■ ■ ■, x„), i — 1,2,... ,1 and 

zj=gjiyuyi,--.-,yi), j = l,2,...,m (4.194) 

are differentiable maps from R" -> R 7 and R 7 —> R'", then the composed map R" -> R m 
is differentiable and the pullback of any k-form under the composed map is equal to the 
pullback of the pullback. This theorem is useful for establishing that integrals of k-forms 
are parameter independent. 

Similarly, we define the differential df as the pullback of the 1-form dz under the func¬ 
tion z = fix, y): 


df df 

dz—df= —dx H— —dy. 
dx dy 


(4.195) 


Example 4.8.4 Stokes’Theorem 


As another application let us first sketch the standard derivation of the simplest version 
of Stokes’ theorem for a rectangle S = [a<x<b,c<y<d] oriented counterclockwise, 
with dS its boundary 


/< 


iAdx + Bdy)= ( Afx, c) dx + f B)b,y)dy+ I Aix,d)dx + I Bia,y)dy 
Ja Jc Jb Jd 

— / \Bib, y) — Bia, y)] dy — / [A(x, d) — A(x, c)] dx 
J c Ja 


s: 


r 

Jd 


pd rb 

J c J a 


dB 

—dx dy 
dx 


b rd 


_ r/dB d a 
Js \ dx dy 


-// 

dx dy 


dA 

—dy dx 
dy 


(4.196) 
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which holds for any simply connected surface S that can be pieced together by rectangles. 

Now we demonstrate the use of differential forms to obtain the same theorem (again in 
two dimensions for simplicity): 


d(Adx + B dy ) — dAdx + dB dy 


(dA dA \ 

I —dx H- dy ) dx + 

\ dx dy " ) 


(dB dB 

W X+ 3^ dy]dy = 




dx dy, 


(4.197) 


using the rules highlighted earlier. Integrating over a surface S and its boundary dS, re¬ 
spectively, we obtain 

[ (Adx + Bdy) = f d(Adx + Bdy)— [ (— - —]dxdy. (4.198) 

Jas Js Js\° x °y J 


Here contributions to the left-hand integral from inner boundaries cancel as usual because 
they are oriented in opposite directions on adjacent rectangles. For each oriented inner 
rectangle that makes up the simply connected surface S we have used. 


/ ddx = I dx = 0. 
Jr JaR 


(4.199) 


Note that the exterior derivative automatically generates the z component of the curl. 

In three dimensions, Stokes’ theorem derives from the differential-form identity involv¬ 
ing the vector potential A and magnetic induction B = V x A, 


d(A x dx + A y dy + A z dz) = dA x dx + dA y dy + dA z dz 

( 3 A x 3A V 3A v \ 

= ( - 7 —dx + ——dy + ———dz )dx H- 

\ ox dy dz J 



3A V \ 

— \dydz + 




dz dx + 


V dx 



dx dy, 


(4.200) 


generating all components of the curl in three-dimensional space. This identity is integrated 
over each oriented rectangle that makes up the simply connected surface S (which has no 
holes, that is, where every curve contracts to a point of the surface) and then is summed 
over all adjacent rectangles to yield the magnetic flux across S, 


4> = J [B x dy dz + By dzdx + B z dx dy] 

— / [A x dx + Aydy + A z dz], 

Jas 

or, in the standard notation of vector analysis (Stokes’ theorem. Chapter 1), 

/ B da = j (V x A) • da = / A • dr. 

Js Js Jas 


(4.201) 


(4.202) 
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Example 4.8.5 Gauss’Theorem 


Consider Gauss’ law. Section 1.14. We integrate the electric density p — • E over 

the volume of a single parallelepiped V — [a < x < b, c < y < d, e < z < f ] oriented by 
dxdydz (right-handed), the side x = b of V is oriented by dydz (counterclockwise, as 
seen from x > /; ), and so on. Using 

f h 3 E 

E x (b,y,z)-E x (a,y,z)= -yr^dx, (4.203) 

Ja OX 

we have, in the notation of differential forms, summing over all adjacent parallelepipeds 
that make up the volume V, 

[ E x dydz = [ d—^dxdydz. (4.204) 

J ay ' Jv dx 

Integrating the electric flux (2-form) identity 


d(E x dydz + E y dzdx + E z dx dy) — dE x dydz + dE y dzdx + dE z dx dy 


( dE 


3 E v 


dE- 


= Ur + 17 + -s?) dxdydz 

across the simply connected surface 3 V we have Gauss’ theorem. 


/< 

JdV 


(E x dydz + E y dz dx + E z dx dy) 


__ f /d E x 3 Ey 3 E- 
Jv\ dx 3y dz 


or, in standard notation of vector analysis, 


[ E • r/a = f 

JdV Jv 


V ’ 


V • E dv’r — 


eo 


(4.205) 


dxdydz, (4.206) 


(4.207) 


These examples are different cases of a single theorem on differential forms. To explain 
why, let us begin with some terminology, a preliminary definition of a differentiable 
manifold M: It is a collection of points (m -tuples of real numbers) that are smoothly (that 
is, differentiably) connected with each other so that the neighborhood of each point looks 
like a simply connected piece of an m -dimensional Cartesian space “close enough” around 
the point and containing it. Here, m, which stays constant from point to point, is called the 
dimension of the manifold. Examples are the m -dimensional Euclidean space M m and the 
m -dimensional sphere 



..,x m+l y. 


m+1 

£(*f 


i=t 



Any surface with sharp edges, corners, or kinks is not a manifold in our sense, that 
is, is not differentiable. In differential geometry, all movements, such as translation and 
parallel displacement, are local, that is, are defined infinitesimally. If we apply the exterior 
derivative d to a function fix 1 ,, x m ) on M, we generate basic 1-forms: 

df = dx 1 , 

3 Xi 


(4.208) 
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where x' (P) are coordinate functions. As before we have d{df) — 0 because 

. 


d{df) — d(~~~ t ^ dx' = ^ f d x j d x l 

\dx l ) dxJ dx‘ 

= E 


j<i 


3 2 f 


a 2 / 


dxJ dx' dx' dxJ 


dx J dx' = 0 


(4.209) 


because the order of derivatives does not matter. Any 1-form is a linear combination co = 
Wi dx' with functions coj . 


Generalized Stokes’ Theorem on Differential Forms 


Let cu be a continuous (k — l)-form in x\X 2 ■ ■ ■ a„ -space defined everywhere on a compact, 
oriented, differentiable ^-dimensional manifold S with boundary dS in a i a 2 • • • a„ -space. 
Then 


Here 



(4.210) 


dco — d(Adx\ dx2 ■ ■ ■ dx^-x H-) = dAdx\ dx2 ■ ■ ■ dx^-i H-■ (4.211) 

The potential energy in Example 4.8.3 given this theorem for the potential w — V, a 0-form; 
Stokes’ theorem in Example 4.8.4 is this theorem for the vector potential 1-form A/ dx, 
(for Euclidean spaces dx 1 — (/ a , ); and Gauss’ theorem in Example 4.8.5 is Stokes’ theorem 
for the electric flux 2-form in three-dimensional Euclidean space. 

The method of integration by parts can be generalized to differential forms using 
Eq. (4.186): 

/ dco\a> 2 = I CO1C02 — (— l)^ 1 / coidu >2 ■ (4.212) 

Js JdS Js 

This is proved by integrating the identity 

d(co\co2) = dco 1 ft >2 + (— 1) * 1 rw 1 dco 2 , (4.213) 

with the integrated term f s d(a)ia)2) — f ds cd\u> 2 - 

Our next goal is to cast Sections 2.10 and 2.11 in the language of differential forms. So 
far we have worked in two- or three-dimensional Euclidean space. 


Example 4.8.6 riemann manifold 

Let us look at the curved Riemann space-time of Sections 2.10-2.11 and reformulate 
some of this tensor analysis in curved spaces in the language of differential forms. Re¬ 
call that dishinguishing between upper and lower indices is important here. The metric gjj 
in Eq. (2.123) can be written in terms of tangent vectors, Eq. (2.114), as follows: 

dx 1 dx 1 

8ij ~dq [ dqJ’ 


(4.214) 
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where the sum over the index l denotes the inner product of the tangent vectors. (Here 
we continue to use Einstein’s summation convention over repeated indices. As before, the 
metric tensor is used to raise and lower indices.) The key concept of connection involves 
the Christoffel symbols, which we address first. The exterior derivative of a tangent vector 
can be expanded in terms of the basis of tangent vectors (compare Eq. (2.131a)), 


dx 


dx 




(4.215) 


thus introducing the Christoffel symbols of the second kind. Applying d to Eq. (4.214) we 
obtain 


d S „ = ^d„"=d( *£)?» + 3 Xj( •» 

3 q m \ dq 1 ) dqJ 3 q' \3 q< 


(4.216) 


_ , dx, dx 

1 "" dq k dq ' 


J J 3 a' da k 1 V 


dq 1 dq k ) 

Comparing the coefficients of dq m yields 


iSkj 


jm 


8ik)dq" 


— r imgkj + r jingik- 


Using the Christoffel symbol of the first kind. 


we can rewrite Eq. (4.217) as 


[ij, m] = gkm^ij. 


^- = [im,j] + [jm,i ], 


which corresponds to Eq. (2.136) and implies Eq. (2.137). We check that 

d Jij' 
dq" 

is the unique solution of Eq. (4.219) and that 


J 2 V 3 q ’ 3 q' 


(4.217) 


(4.218) 


(4.219) 


(4.220) 


r*.. — 

1 ij — 


<4221) 


follows. 


Hodge * Operator 


The differentials dx 1 , i = 1,2,..., m, form a basis of a vector space that is (seen to be) 
dual to the derivatives 3/ = they are basic 1-forms. For example, the vector space V = 
{(«i, fl 2 . < 23 )} is dual to the vector space of planes (linear functions /) in three-dimensional 
Euclidean space V* = {/ = + < 72*2 + fl 3*3 — d = 0}. The gradient 


, 9/ 3/ 3/ 

V/ = —, —, — = C01,02,03) 
\axi ox 2 ox 3 / 


(4.222) 
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provides a one-to-one, differentiable map from V* to V. Such dual relationships are gener¬ 
alized by the Hodge * operator, based on the Levi-Civita symbol of Section 2.9. 

Let the unit vectors x, be an oriented orthonormal basis of three-dimensional Euclidean 
space. Then the Hodge * of scalars is defined by the basis element 

*1 = ^s ,jk XiXjX k = X!X 2 X 3 , (4.223) 

which corresponds to (xi x x 2 ) • x 3 in standard vector notation. Here XjXjXk is the totally 
antisymmetric exterior product of the unit vectors that corresponds to (x,- x xj) ■ x k in 
standard vector notation. For vectors, * is defined for the basis of unit vectors as 

*Xj = ^Si jk XjX k . (4.224) 

In particular, 

*xj=x 2 x 3 , *x 2 = x 3 xi, *x 3 =xix 2 . (4.225) 

For oriented areas, * is defined on basis area elements as 

*(xjXj) =s k ijX k , (4.226) 

SO 

*(XlX 2 ) = £ 3 1 2 X 3 = X 3 , *(XlX 3 ) = £ 2 1 3 X 2 = X 2 , 

*(x 2 x 3 ) = £ X 23 xi = Xi . (4.227) 

For volumes, * is defined as 

*(xix 2 x 3 ) = £i 23 = 1. (4.228) 


Example 4.8.7 Cross Product of Vectors 
The exterior product of two vectors 


a=^<j'x ; -, b = Yb'xj 
i=l ;=1 

is given by 

ab = ^ b' xj = J2( a 'b j ~ a-* b')xjXj, 

\=l ^7=1 i <j 

whereas Eq. (4.224) implies that 

*(ab) = a x b. 


(4.229) 


(4.230) 


(4.231) 


Next, let us analyze Sections 2.1-2.2 on curvilinear coordinates in the language of dif¬ 
ferential forms. 
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Example 4.8.8 Lapuuiian in Orthogonal Coordinates 


Consider orthogonal coordinates where the metric (Eq. (2.5)) leads to length elements 

dsi—hjclqi, not summed. (4.232) 

Here the dq, are ordinary differentials. The 1-forms associated with the directions q, are 


s'= hjdqi , not summed. 
Then the gradient is defined by the 1-form 

df= v dqi ^(]_v\ l 


dq t 


hi dqt ) 


S . 


(4.233) 


(4.234) 


We apply the hodge star operator to d /, generating the 2-form 


*df = 


= (IVT e , = (TVt 


hi dq, 
h 2 h3 df 
h\ dq\ 


hi dqi ) 
dqidq 3 


eV + 


hih?, df 


hi dqi 


J__V\ 

hi dqi) 
dqidqi 


£ V + 


l_v\ 

hi dqi) 


£ 1 £ 2 


hih 2 df 
hi dqi 


dqi dqi. 

(4.235) 


Applying another exterior derivative d , we get the Laplacian 

9 (hih 3 df\ d (hihi df \ 

d(*df) — -— ——-— dqi dqi dqi + -— ——-— dqidqi dqidqi 
dqi \ hi dqij dq 2 \ h 2 dq 2 ) 

9 (hihi df 


dq 3 V hi dqi 

1 


dqi dqi dqi dqi 


hihihi 


9 fhihi df 
dqi V hi dqi 


+ 


u 


hihi df 


d (hihi df 




dqi\ hi dqij dqi\ hi dqi 


■ S l S l S i = V-fdqi dqidqi. 


(4.236) 


Dividing by the volume element gives Eq. (2.22). Recall that the volume elements dx dy dz 
and e 1 e 2 e 3 must be equal because s' and dx, dy, dz are orthonormal 1 -forms and the map 
from the xyz to the q, coordinates is one-to-one. ■ 


Example 4.8.9 maxwell’s equations 


We now work in four-dimensional Minkowski space, the homogeneous, flat space-time of 
special relativity, to discuss classical electrodynamics in terms of differential forms. We 
start by introducing the electromagnetic field 2 -form (field tensor in standard relativistic 
notation): 

F — —E x dt dx — Eydt dy — E z dt dz + B x dydz+ B y dzdx + B- dx dy 
— -F^ v dx^ dx v , 


(4.237) 
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which contains the electric 1-form E = E x dx + E v dy + E z dz and the magnetic flux 
2-form. Here, terms with 1-forms in opposite order have been combined. (For Eq. (4.237) 
to be valid, the magnetic induction is in units of c; that is, B, —»• cB, , with c the velocity of 
light; or we work in units where c — 1. Also, F is in units of 1 /go, the dielectric constant 
of the vacuum. Moreover, the vector potential is defined as Ao = £o</>, with the nonstatic 
electric potential </> and A 1 = ^,...; see Section 4.6 for more details.) The field 2-form 
F encompasses Faraday’s induction law that a moving charge is acted on by magnetic 
forces. 

Applying the exterior derivative d generates Maxwell’s homogeneous equations auto¬ 
matically from F: 


dF — 


dE x dE x 

~^—dy + —— dz 
ay dz 


dt dx 


dty dty \ 

i7 d * + irv 


dE, , dE ? 

—-dx H- -dy ) dt dz + 

dx dy 


dB x dB x 

- dx H- dt 

dx dt 


dt dy 


dy dz 


(d By dBy \ (d B z 95, \ 

+ ( —-dt H- -dy I dzdx + I —-dt H- -dz I dx dy 

\ dt dy ) \ dt dz J 


d E x 


dEy 


dB- 


dy 


dx 


dt 


= —I H zr~ ) dt dx dy + I —— + —^ - —— \dtdxdz 


dE. dE 7 


dBy 


dz 


dx 


dt 


dEy dEy dBy , 

-^7 + jt + — )d,dydz =° 


(4.238) 


which, in standard notation of vector analysis, takes the familiar vector form of Maxwell’s 
homogeneous equations, 


9B 

V x EH-= 0. 

dt 


(4.239) 


Since dF = 0, that is, there is no driving term so that F is closed, there must be a 1-form 
at — A/y dx M so that F — dco. Now, 


dco = d v Au dx 1 ’ dx ^, 


(4.240) 


which, in standard notation, leads to the conventional relativistic form of the electromag¬ 
netic field tensor. 


Ffxv = d^A v — dyAfy. (4.241) 

Maxwell’s homogeneous equations, dF — 0, are thus equivalent to 9 1 ' F flv — 0. 

In order to derive similarly the inhomogeneous Maxwell’s equations, we introduce the 
dual electromagnetic field tensor 

(4.242) 

and, in terms of differential forms, 

= *(F IJV dx* dx v ) = F, lv * (dx 11 dx v ) = ^F^e^ap dx 01 dx p . (4.243) 
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Applying the exterior derivative yields 

d(*F) = ^ v af i(dyF^ v )dx y dx 0l dx f> , (4.244) 

the left-hand side of Maxwell’s inhomogeneous equations, a 3-form. Its driving term is the 
dual of the electric current density, a 3-form: 

*J — Jot^dx 01 ) — J a s a ^vxdx^ dx v dx x 

— p dx dydz— J x dt dy dz — J v dt dzdx — J z dt dx dy. (4.245) 

Altogether Maxwell’s inhomogeneous equations take the elegant form 

d(*F) = *J. (4.246) 


The differential-form framework has brought considerable unification to vector algebra 
and to tensor analysis on manifolds more generally, such as uniting Stokes’ and Gauss’ 
theorems and providing an elegant reformulation of Maxwell’s equations and an efficient 
derivation of the Laplacian in curved orthogonal coordinates, among others. 


Exercises 

4.8.1 Evaluate the 1 -form a dx + 2b dy + 4c dz on the line segment P Q, with / J = (3. 5,7), 
G = (7,5,3). 

4.8.2 If the force field is constant and moving a particle from the origin to (3, 0, 0) requires a 
units of work, from (—1, —1,0) to (—1,1,0) takes b units of work, and from (0, 0,4) 
to (0, 0, 5) c units of work, find the 1-form of the work. 

4.8.3 Evaluate the flow described by the 2-form dx dy + 2 dy dz + 3 dz dx across the oriented 
triangle PQR with corners at 

P = (3,1,4), Q = (-2,1,4), R = (1,4,1). 

4.8.4 Are the points, in this order, 

(0,1,1), (3,-1,-2), (4,2,-2), (-1,0,1) 

coplanar, or do they form an oriented volume (right-handed or left-handed)? 

4.8.5 Write Oersted’s law, 

f H <ir = f VxH <?a~7, 

Jds Js 

in differential form notation. 

4.8.6 Describe the electric field by the 1-form E\ dx + Eidy + E$dz and the magnetic induc¬ 
tion by the 2-form B\ dydz+ lh dz dx + If dx dy. Then formulate Faraday’s induction 
law in terms of these forms. 
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4.8.7 Evaluate the 1-form 

xdy ydx 
x 2 + y 2 x 2 + y 2 

on the unit circle about the origin oriented counterclockwise. 

4.8.8 Find the pullback of dx dz under x — u cos v, y — u — v, z — u sin v. 

4.8.9 Find the pullback of the 2-form dy dz + dzdx + dx dy under the map x = sin 0 cos <p, 
y = sin 0 sin <p, z = cos 9 . 

4.8.10 Parameterize the surface obtained by rotating the circle (x — 2) 2 + z 2 = 1, y = 0, about 
the "-axis in a counterclockwise orientation, as seen from outside. 

4.8.11 A 1-form A dx + B dy is defined as closed if It is called exact if there is a 

function / so that |^ — A and |£ = B. Determine which of the following 1-forms are 
closed, or exact, and find the corresponding functions / for those that are exact: 

ydx+xdy r , , x 

ydx + xdy, — -z - -= —, ln(xy) + 1 \dx H— dy, 

x~ + y z y 

ydx x dy 

~-y-—y + t 7 , f (z)dz with z = x + iy. 
x z + y z x- + y z 

4.8.12 Show that 1 xf — a 2 defines a differentiable manifold of dimension D — n ~ 1 if 
a ^ 0 and D — 0 if a — 0. 

4.8.13 Show that the set of orthogonal 2x2 matrices form a differentiable manifold, and 
determine its dimension. 

4.8.14 Determine the value of the 2-form Ady dz + B dzdx + C dx dy on a parallelogram 
with sides a, b. 

4.8.15 Prove Forentz invariance of Maxwell’s equations in the language of differential forms. 

Additional Readings 


Buerger, M. J., Elementary Crystallography. New York: Wiley (1956). A comprehensive discussion of crystal 
symmetries. Buerger develops all 32 point groups and all 230 space groups. Related books by this author in¬ 
clude Contemporary Crystallography. New York: McGraw-Hill (1970); Crystal Structure Analysis. New York: 
Krieger (1979) (reprint, 1960); and Introduction to Crystal Geometry. New York: Krieger (1977) (reprint, 
1971). 

Bums, G., and A. M. Glazer, Space Groups for Solid-State Scientists. New York: Academic Press (1978). A well- 
organized, readable treatment of groups and their application to the solid state. 

de-Shalit, A., and I. Talmi, Nuclear Shell Model. New York: Academic Press (1963). We adopt the Condon- 
Shortley phase conventions of this text. 

Edmonds, A. R., Angular Momentum in Quantum Mechanics. Princeton, NJ: Princeton University Press (1957). 

Edwards, H. M., Advanced Calculus: A Differential Forms Approach. Boston: Birkhauser (1994). 

Falicov, L. M., Group Theory and Its Physical Applications. Notes compiled by A. Luehrmann. Chicago: Uni¬ 
versity of Chicago Press (1966). Group theory, with an emphasis on applications to crystal symmetries and 
solid-state physics. 
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Gell-Mann, M., and Y. Ne’eman, The Eightfold Way. New York: Benjamin (1965). A collection of reprints of 
significant papers on SU(3) and the particles of high-energy physics. Several introductory sections by Gell- 
Mann and Ne’eman are especially helpful. 

Greiner, W., and B. Muller, Quantum Mechanics Symmetries. Berlin: Springer (1989). We refer to this textbook 
for more details and numerous exercises that are worked out in detail. 

Hamermesh, M., Group Theory and Its Application to Physical Problems. Reading, MA: Addison-Wesley (1962). 
A detailed, rigorous account of both finite and continuous groups. The 32 point groups are developed. The 
continuous groups are treated, with Lie algebra included. A wealth of applications to atomic and nuclear 
physics. 

Hassani, S., Foundations of Mathematical Physics. Boston: Allyn and Bacon (1991). 

Heitler, W., The Quantum Theory of Radiation, 2nd ed. Oxford: Oxford University Press (1947). Reprinted, New 
York: Dover (1983). 

Higman, B., Applied Group-Theoretic and Matrix Methods. Oxford: Clarendon Press (1955). A rather complete 
and unusually intelligible development of matrix analysis and group theory. 

Jackson, J. D., Classical Electrodynamics, 3rd ed. New York: Wiley (1998). 

Messiah, A., Quantum Mechanics, Vol. II. Amsterdam: North-Holland (1961). 

Panofsky, W. K. H., and M. Phillips, Classical Electricity and Magnetism, 2nd ed. Reading, MA: Addison-Wesley 
(1962). The Lorentz covariance of Maxwell’s equations is developed for both vacuum and material media. 
Panofsky and Phillips use contravariant and covariant tensors. 

Park, D., Resource letter SP-1 on symmetry in physics. Am. J. Phys. 36: 577-584 (1968). Includes a large selection 
of basic references on group theory and its applications to physics: atoms, molecules, nuclei, solids, and 
elementary particles. 

Ram, B., Physics of the SU(3) symmetry model. Am. J. Phys. 35: 16 (1967). An excellent discussion of the 
applications of SU(3) to the strongly interacting particles (baryons). For a sequel to this see R. D. Young, 
Physics of the quark model. Am. J. Phys. 41: 472 (1973). 

Rose, M. E., Elementary Theory of Angular Momentum. New York: Wiley (1957). Reprinted. New York: Dover 
(1995). As part of the development of the quantum theory of angular momentum, Rose includes a detailed and 
readable account of the rotation group. 

Wigner, E. R, Group Theory and Its Application to the Quantum Mechanics of Atomic Spectra (translated by 
J. J. Griffin). New York: Academic Press (1959). This is the classic reference on group theory for the physicist. 
The rotation group is treated in considerable detail. There is a wealth of applications to atomic physics. 
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Infinite Series 


5.1 Fundamental Concepts 

Infinite series, literally summations of an infinite number of terms, occur frequently in both 
pure and applied mathematics. They may be used by the pure mathematician to define func¬ 
tions as a fundamental approach to the theory of functions, as well as for calculating ac¬ 
curate values of transcendental constants and transcendental functions. In the mathematics 
of science and engineering infinite series are ubiquitous, for they appear in the evaluation 
of integrals (Sections 5.6 and 5.7), in the solution of differential equations (Sections 9.5 
and 9.6), and as Fourier series (Chapter 14) and compete with integral representations for 
the description of a host of special functions (Chapters 11, 12, and 13). In Section 16.3 the 
Neumann series solution for integral equations provides one more example of the occur¬ 
rence and use of infinite series. 

Right at the start we face the problem of attaching meaning to the sum of an infinite 
number of terms. The usual approach is by partial sums. If we have an infinite sequence of 
terms mi, ui, M3, «4, «5, ..., we define the ;th partial sum as 

i 

*i =y^M«- (5.i) 

n=1 

This is a finite summation and offers no difficulties. If the partial sums .v, converge to a 
(finite) limit as i -> oo, 

lim Si = S , (5.2) 

i —>oo 

the infinite series u n is said to be convergent and to have the value S. Note that we 

reasonably, plausibly, but still arbitrarily define the infinite series as equal to S and that a 
necessary condition for this convergence to a limit is that lim^oo u n — 0. This condition, 
however, is not sufficient to guarantee convergence. Equation (5.2) is usually written in 
formal mathematical notation: 
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The condition for the existence of a limit S is that for each e > 0, there is a fixed 
N = N(s) such that 

15 — Si | < s, for i > N. 

This condition is often derived from the Cauchy criterion applied to the partial sums sy. 

The Cauchy criterion is: 

A necessary and sufficient condition that a sequence fsy ) converge is that for each e > 0 
there is a fixed number N such that 

|sj — si | < s, for all i, j > N. 

This means that the individual partial sums must cluster together as we move far out in 
the sequence. 

The Cauchy criterion may easily be extended to sequences of functions. We see it in this 
form in Section 5.5 in the definition of uniform convergence and in Section 10.4 in the 
development of Hilbert space. Our partial sums s, may not converge to a single limit but 
may oscillate, as in the case 

oo 

y ' u n = 1 — 1 + 1 — 1 + 1 + -- -— (—1 )”+••• . 

n =1 

Clearly, .sy = 1 for i odd but .sy = 0 for i even. There is no convergence to a limit, and 
series such as this one are labeled oscillatory. Whenever the sequence of partial sums 
diverges (approaches ±oo), the infinite series is said to diverge. Often the term divergent 
is extended to include oscillatory series as well. Because we evaluate the partial sums 
by ordinary arithmetic, the convergent series, defined in terms of a limit of the partial 
sums, assumes a position of supreme importance. Two examples may clarify the nature of 
convergence or divergence of a series and will also serve as a basis for a further detailed 
investigation in the next section. 


Example 5.1.1 The Geometric Series 


The geometrical sequence, starting with a and with a ratio r (= a n+ \ /«„ independent of n), 
is given by 

a + ar + ar 2 + ar 2 + • • • + ar"~ l + • • • . 

The /7 th partial sum is given by 1 

1 -r" 

s„ = a- -. (5.3) 

1 — r 

Taking the limit as n -> oo, 

a 

lim s„ = 

n —> oo 


1 Multiply and divide s n = _ l Q ar ' n by 1 —r. 


1 -r’ 


for |r| < 1. 


(5.4) 
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Hence, by definition, the infinite geometric series converges for |r| < 1 and is given by 


oo 



(5.5) 


On the other hand, if |r | > 1, the necessary condition u n -» 0 is not satisfied and the infinite 
series diverges. ■ 


Example 5.1.2 The FIarmonic Series 


As a second and more involved example, we consider the harmonic series 


“1 111 
E“- 1 + 7 + ^ + Z' 


n =1 


(5.6) 


We have the lim„^oo u n — 1 / n — 0, but this is not sufficient to guarantee conver¬ 

gence. If we group the terms (no change in order) as 

1 + 2 + (3 + 1 ) + (5 + § + 1 + g) + (5 H - h Te) + ’ 

each pair of parentheses encloses p terms of the form 

11 1 p I 

- 7 ^-+ • • • H-> -— — —. 

p +1 p + 2 P + P 2p 2 

Forming partial sums by adding the parenthetical groups one by one, we obtain 


(5.7) 


(5.8) 


si = 1 , 


52 = 2* 


54 >2’ 


55 > r 


(5.9) 


S3> 2’ 


Sn > 


The harmonic series considered in this way is certainly divergent. 2 An alternate and inde¬ 
pendent demonstration of its divergence appears in Section 5.2. ■ 


If the u n > 0 are monotonically decreasing to zero, that is, u n > M;(+i for all n, then 
Y2 n u n I s converging to S if, and only if, s n — nu n converges to S. As the partial sums s n 
converge to .S', this theorem implies that nu n -> 0, for n -> oc. 

To prove this theorem, we start by concluding from 0 < u n +\ < u n and 


Su ) 1 (n -f 1 )nn-\-\ — 7,1 nu n+ i — s n nu n -F n(u n w n ^_^) >■ s n nu n 

that s„ — nu n increases as n -> 00 . As a consequence of s„ — nu n < s n < S, s„ — nu n 
converges to a value s < S. Deleting the tail of positive terms m ; - — u„ from i = v + 1 to n, 


“The (finite) harmonic series appears in an interesting note on the maximum stable displacement of a stack of coins. P. R. John¬ 
son, The Leaning Tower of Lire. Am. J. Phys. 23: 240 (1955). 
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we infer from s„ — nu„ > u o + (mi — u n ) + • • • + ( u v — m„) = s v — vu„ that s„ — nu n > s v 
for n -> oo. Hence also s > S, so s — S and nu„ —> 0. 

When this theorem is applied to the harmonic series ^ with n ^ = I it implies that 
it does not converge; it diverges to +oo. 

Addition, Subtraction of Series 

If we have two convergent series u„ -> s and v n -> S, their sum and difference 
will also converge to 5 ± S because their partial sums satisfy 

| Sj ± Sj - (Sj ± S{) | = | Sj - si ± (,Sj - Sj) | < | ^ -St | + | Sj -Sj | < 2e 

using the triangle inequality 

\a\ — \b\ < \a + b\ < \a\ + \b\ 

for a = Sj — Si, b — Sj — Si. 

A convergent series u n -> S may be multiplied termwise by a real number a. The 
new series will converge to a S because 

| as j — asj\ — | a(sj — s,-)| = |a||s; — s,-| < |a|e. 

This multiplication by a constant can be generalized to a multiplication by terms c n of a 
bounded sequence of numbers. 

IfJ2 n 11 n converges to S and 0 < c„ < M are bounded, then u n c„ is convergent. If 
u n is divergent and c n > M > 0, then '£2 n u n c„ diverges. 

To prove this theorem we take i, j sufficiently large so that \sj — Si \ < e. Then 

j j 

Y] u n c n < M u n = M\sj — Si | < Me. 

i-\-1 i -f-1 

The divergent case follows from 

Y UnC * > M u h —>• oo. 

n n 

Using the binomial theorem 3 (Section 5.6), we may expand the function (1 + x)~ l : 

- i — = l-x+x 2 -x 3 + --- + (-x) n ~'+-- - . (5.10) 

1 +x 

If we let x — y 1, this series becomes 

1 — 1 + 1 — 1 + 1 — 1H-, (5.11) 

a series that we labeled oscillatory earlier in this section. Although it does not converge 
in the usual sense, meaning can be attached to this series. Euler, for example, assigned a 
value of 1 /2 to this oscillatory sequence on the basis of the correspondence between this 
series and the well-defined function (1 +.r) -1 . Unfortunately, such correspondence be¬ 
tween series and function is not unique, and this approach must be refined. Other methods 

3 Actually Eq. (5.10) may be verified by multiplying both sides by 1 + x. 
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of assigning a meaning to a divergent or oscillatory series, methods of defining a sum, 
have been developed. See G. H. Hardy, Divergent Series , Chelsea Publishing Co. 2nd ed. 
(1992). In general, however, this aspect of infinite series is of relatively little interest to the 
scientist or the engineer. An exception to this statement, the very important asymptotic or 
semiconvergent series, is considered in Section 5.10. 


Exercises 


5.1.1 


5.1.2 


Show that 


E 


i 

(2 n - 1)(2 n + 1) 


1 

2 ' 


Hint. Show (by mathematical induction) that s m — m/(2m + 1). 


Show that 


E 


i 

n(n + 1) 


= 1 . 


Find the partial sum s m and verify its correctness by mathematical induction. 

Note. The method of expansion in partial fractions. Section 15.8, offers an alternative 
way of solving Exercises 5.1.1 and 5.1.2. 


5.2 Convergence Tests 

Although nonconvergent series may be useful in certain special cases (compare Sec¬ 
tion 5.10), we usually insist, as a matter of convenience if not necessity, that our series be 
convergent. It therefore becomes a matter of extreme importance to be able to tell whether 
a given series is convergent. We shall develop a number of possible tests, starting with the 
simple and relatively insensitive tests and working up to the more complicated but quite 
sensitive tests. For the present let us consider a series of positive terms a n > 0, postponing 
negative terms until the next section. 

Comparison Test 

If term by term a series of terms 0 < u n < a n , in which the a n form a convergent series, 
the series u n is also convergent. If Un — U n for all n, then u n < a n and u„ 
therefore is convergent. If term by term a series of terms v n > b „, in which the b n , form a 
divergent series, the series v n is also divergent. Note that comparisons of u„ with b„ 
or v n with a n yield no information. If Vn — bn for all n, then v„ > b„ and v n 
therefore is divergent. 

For the convergent series a n we already have the geometric series, whereas the harmonic 
series will serve as the divergent comparison series b n . As other series are identified as 
either convergent or divergent, they may be used for the known series in this comparison 
test. All tests developed in this section are essentially comparison tests. Figure 5.1 exhibits 
these tests and the interrelationships. 
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Example 5.2. 7 A Dirichlet Series 

Test 22^1 n~ p , p — 0.999, for convergence. Since n ll ' m > « _1 and b n — n~ l forms the 
divergent harmonic series, the comparison test shows that 22n n -0 " 9 is divergent. Gener¬ 
alizing, 22 n n ~ p is seen to be divergent for all p < 1 but convergent for p > 1 (see Exam¬ 
ple 5.2.3). ■ 

Cauchy Root Test 

if (u,,) 1 /" < /■ < 1 for all sufficiently large n, with r independent of n, then 22 n a n is 
convergent. If (a n ) l/ " > 1 for all sufficiently large n, then 22 n a " i s divergent. 

The first part of this test is verified easily by raising («„ j 1 '" < r to the nth power. We 


Since r n is just the nth term in a convergent geometric series, 22 n a n is convergent by the 
comparison test. Conversely, if (a n ) l ^ n > 1, then a„ > 1 and the series must diverge. This 
root test is particularly useful in establishing the properties of power series (Section 5.7). 

D’Alembert (or Cauchy) Ratio Test 

If a n+ i/a n < r < 1 for all sufficiently large n and r is independent of n, then 22 n a n is 
convergent. If a n+ \/a n > 1 for all sufficiently large n, then 22 n a n is divergent. 

Convergence is proved by direct comparison with the geometric series (1 +r + r 2 -\ -). 

In the second part, a n+ \ > a„ and divergence should be reasonably obvious. Although not 
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quite so sensitive as the Cauchy root test, this D’Alembert ratio test is one of the easiest to 
apply and is widely used. An alternate statement of the ratio test is in the form of a limit: If 


.. fl «+1 . 
lim - < 1, 


H *-00 fl 


> 1, 
= 1, 


convergence, 

divergence, 

indeterminate. 


(5.12) 


Because of this final indeterminate possibility, the ratio test is likely to fail at crucial points, 
and more delicate, sensitive tests are necessary. The alert reader may wonder how this 
indeterminacy arose. Actually it was concealed in the first statement, a n+ \/a n < r < 1. 
We might encounter a n +\/a n < 1 for all finite n but be unable to choose an r < 1 and 
independent of n such that a n +\ /a„ < r for all sufficiently large n. An example is provided 
by the harmonic series 


Qn+l M . 

- = - < 1. 

a n n + 1 


(5.13) 


Since 


r ttn +1 1 

lim -= 1, 

n->o o a n 


(5.14) 


no fixed ratio r < 1 exists and the ratio test fails. 


Example 5.2.2 D’Alembert Ratio Test 

Test n/ 2" for convergence. 

a n +1 _ (n + l)/2" +1 _ 1 n + 1 
a n n /2" 2 n 


Since 


a n 4 

we have convergence. Alternatively, 

lim 


a n +1 3 

< - for n > 2, 


\ 1 1 


fi >-oo a n 2 


(5.15) 


(5.16) 


(5.17) 


and again — convergence. 


Cauchy (or Maclaurin) Integral Test 

This is another sort of comparison test, in which we compare a series with an integral. 
Geometrically, we compare the area of a series of unit-width rectangles with the area under 


a curve. 
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a b 

Figure 5.2 (a) Comparison of integral and sum-blocks leading, 

(b) Comparison of integral and sum-blocks lagging. 


Let f{x ) be a continuous, monotonic decreasing function in which fin ) = a n . Then 
'f2 n a i, converges if f l fix) dx is finite and diverges if the integral is infinite. For the ith 
partial sum, 


But 


Si = ^2 a n = '^2.f(n). 


n =1 


n= 1 


(5.18) 


Si > 



fix)dx 


(5.19) 


from Fig. 5.2a, fix) being monotonic decreasing. On the other hand, from Fig. 5.2b, 


Si 


— a\ < 



(5.20) 


in which the series is represented by the inscribed rectangles. Taking the limit as i —> oo, 
we have 



fix) dx < 



fix)dx + a\. 


(5.21) 


Hence the infinite series converges or diverges as the corresponding integral converges or 
diverges. This integral test is particularly useful in setting upper and lower bounds on the 
remainder of a series after some number of initial terms have been summed. That is. 


where 


OO 

n= 1 


N oo 

n= 1 n=N+\ 



f (x ) dx < V a„< 

n=N +1 


AM-1 


fix)dx + aN+i. 
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To free the integral test from the quite restrictive requirement that the interpolating func¬ 
tion f(x) be positive and monotonic, we show for any function f(x) with a continuous 
derivative that 


N f 

/(") 


n=Nj +1 



C N f 

f(x)dx + / (x — [x])/ , (x)t/x 

JNi 


(5.22) 


holds. Here [x] denotes the largest integer below x, so x — [x] varies sawtoothlike between 
0 and 1. To derive Eq. (5.22) we observe that 


r N f 

JNt 


xf'(x)dx = N f f (N f ) - Nif(Ni) 


using integration by parts. Next we evaluate the integral 



(5.23) 



N f -1 

f'(x)dx = ^2 n{f(n + l)-f(n)} 

n=Ni 


N f 

= ~ J2 f{n)-Nif{Ni) + Nff{Nf). (5.24) 

n=Nj +1 


Subtracting Eq. (5.24) from (5.23) we arrive at Eq. (5.22). Note that f(x) may go up or 
down and even change sign, so Eq. (5.22) applies to alternating series (see Section 5.3) as 
well. Usually fix) falls faster than f(x) for x -* oo, so the remainder term in Eq. (5.22) 
converges better. It is easy to improve Eq. (5.22) by replacing x — [x] by x — [x] — which 
varies between — j and j: 


Y f(n)= f f(x)dx+ [ (x - [x] - \)f{x)dx 

,n<N, J Ni JN t 


Ni <n<Nf 


+ 2 f(Ni)}. (5.25) 

Then the f'(x)- integral becomes even smaller, if f’(x) does not change sign too often. For 
an application of this integral test to an alternating series see Example 5.3.1. 


Example 5.2.3 riemann zeta function 

The Riemann zeta function is defined by 


$(P) = ^2 n P ’ 

n =1 


provided the series converges. We may take f(x) —x p , and then 


s; 


p dx — 


r~P +1 


-P+ 1 


P #1 


(5.26) 


= lnx|r =1 . 


P= I- 


(5.27) 




330 


Chapter 5 Infinite Series 


The integral and therefore the series are divergent for p < 1, convergent for p > 1. Hence 
Eq. (5.26) should carry the condition p > 1. This, incidentally, is an independent proof 
that the harmonic series (p = 1) diverges logarithmically. The sum of the first million 
terms ^i . 000,000 n -\ j s on jy 24 392 726 _ ■ 

This integral comparison may also be used to set an upper limit to the Euler-Mascheroni 
constant , 4 defined by 



Returning to partial sums, Eq. (5.20) yields 


Sn 


1 

m= 1 


In n 


4 


dx 

-In n - 

x 


1. 


(5.28) 


(5.29) 


Evaluating the integral on the right, s„ < 1 for all n and therefore y < 1. Exer¬ 
cise 5.2.12 leads to more restrictive bounds. Actually the Euler-Mascheroni constant is 


0.57721566.... 


Kummer’s Test 

This is the first of three tests that are somewhat more difficult to apply than the preceding 
tests. Their importance lies in their power and sensitivity. Frequently, at least one of the 
three will work when the simpler, easier tests are indecisive. It must be remembered, how¬ 
ever, that these tests, like those previously discussed, are ultimately based on comparisons. 
It can be shown that there is no most slowly converging series and no most slowly diverg¬ 
ing series. This means that all convergence tests given here, including Kummer’s, may fail 
sometime. 

We consider a series of positive terms iij and a sequence of finite positive constants < 7 , . 
If 

-A„ + i > C > 0 (5.30) 

m>i +1 

for all n > N , where N is some fixed number, 5 then u i converges. If 

a n —--fl/j+i < 0 (5.31) 

Un -\-1 

and J2hLi «r' diverges, then w; diverges. 


4 This is the notation of National Bureau of Standards, Handbook of Mathematical Functions, Applied Mathematics Series-55 
(AMS-55). New York: Dover (1972). 

5 With u m finite, the partial sum Sfj will always be finite for N finite. The convergence or divergence of a series depends on the 
behavior of the last infinity of terms, not on the first N terms. 
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The proof of this powerful test is remarkably simple. From Eq. (5.30), with C some 
positive constant. 


CUN+I < CltfUN — ®N+l u N+l 

Cun+2 < ON+lUN+l ~ ON+2UN+2 
('ll,, < ct n —\u n —\ a n u n . 

Adding and dividing by C (and recalling that C ^ 0), we obtain 

n 

Cl U ft ClfiUfi 


J2 u i 

i=N +1 


c 


c 


Hence for the partial sum , 


< 




i =1 
N 


< 


J2 u ‘ 


c 


cinun 


C 


i=t 


c 


a constant, independent of n. 


(5.32) 


(5.33) 


(5.34) 


The partial sums therefore have an upper bound. With zero as an obvious lower bound, the 
series w; must converge. 

Divergence is shown as follows. From Eq. (5.31) for u n+ \ > 0, 


(hi l hi cH Qn— Fbz — 1 — * * * ^ GNU tv , 


n > N. 


(5.35) 


Thus, for a n > 0, 


and 


CIj^Un 

Un — 

Q-n 


oo oo 

Ui >a N u N t/i 

! = iV+l I = iV+l 


(5.36) 


(5.37) 


If | cii 1 diverges, then by the comparison test JT it; diverges. Equations (5.30) and 
(5.31) are often given in a limit form: 


lim (a „— - a„+i) = C. (5.38) 

n^oo\ Un+ l ) 

Thus for C > 0 we have convergence, whereas for C < 0 (and uj 1 divergent) we have 
divergence. It is perhaps useful to show the close relation of Eq. (5.38) and Eqs. (5.30) and 
(5.31) and to show why indeterminacy creeps in when the limit C = 0. From the definition 
of limit. 


u n 

a n &n -\-1 

Un +1 


C 


< s 


(5.39) 
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for all n > N and all e > 0, no matter how small s may be. When the absolute value signs 
are removed, 

C — e <ci n —-- ci n +1 < C + e. (5.40) 

M >1 +1 

Now, if C > 0, Eq. (5.30) follows from s sufficiently small. On the other hand, if C < 0, 
Eq. (5.31) follows. However, if C — 0, the center term, a n (u n /u n . |_i) — a„+i, maybe either 
positive or negative and the proof fails. The primary use of Rummer’s test is to prove other 
tests, such as Raabe’s (compare also Exercise 5.2.3). 

If the positive constants a n of Rummer’s test are chosen a„ = n, we have Raabe’s test. 


Raabe’s Test 

If Un > 0 and if 

n (^--\\>P>\ (5.41) 

V^n+1 / 

for all n > N, where N is a positive integer independent of n, then w, converges. Here, 
P — C + 1 of Rummer’s test. If 

- l) < 1, (5.42) 

\Mn +1 / 

then Uj diverges (as /C 1 diverges). The limit form of Raabe’s test is 

lim n(-^~ - l) = P. (5.43) 

n^oo \u n+ l ) 

We have convergence for P > 1, divergence for P < 1, and no conclusion for P — 1, 
exactly as with the Rummer test. This indeterminacy is pointed up by Exercise 5.2.4, which 
presents a convergent series and a divergent series, with both series yielding P = 1 in 
Eq. (5.43). 

Raabe’s test is more sensitive than the d’Alembert ratio test (Exercise 5.2.3) because 
n~ l diverges more slowly than 1. We obtain a more sensitive test (and one 

that is still fairly easy to apply) by choosing a n — n In n. This is Gauss’ test. 


Gauss’ Test 


If lift > 0 for all finite n and 


u„ h B(n) 

—— = H-1——, 

u „+1 n n 2 


(5.44) 


in which B(n) is a bounded function of n for n —>• oo, then m, converges for h > 1 and 
diverges for h < 1: There is no indeterminate case here. 
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The Gauss test is an extremely sensitive test of series convergence. It will work for all 
series the physicist is likely to encounter. For /z > 1 or /z < 1 the proof follows directly 
from Raabe’s test 


lim zz 1 

H—>0O 


h 

n 




B(n) 

= lim 

h + - 

H —>00 

n 


= h. 


(5.45) 


If h = 1, Raabe’s test fails. However, if we return to Rummer’s test and use a n — n ln/z, 
Eq. (5.38) leads to 


lim 

n —>oo 


zz In zz 


1 B{n) 
1 + - + —^- 


(n + 1) ln(zz + 1) 


= lim 

n—>oo 


zz 4~ 1 

zz lnzz •-(zz + l)ln(zz + 1) 


= lim (zz + 1) 

n —>oo 


In/z — lnzz — In I 1 H— 
zz 


(5.46) 


Borrowing a result from Section 5.6 (which is not dependent on Gauss’ test), we have 


1 


lim -(zz + l)ln 1 + - = lim -(zz + 1)- —j + 

-- n^oo y zz 2zz z 3 zz J 

= -1 < 0 . 


1 1 


1 


(5.47) 


Hence we have divergence for h = 1. This is an example of a successful application of 
Rummer’s test when Raabe’s test had failed. 


Example 5.2.4 Legendre Series 

The recurrence relation for the series solution of Legendre’s equation (Exercise 9.5.5) may 
be put in the form 


a 2j+2 _ 2j(2j + 1) — /(/ + !) 
a 2 j ~ (2y + l)(2./ + 2) 

For Uj — ci 2 j and B(j) — 0(1/ j 2 ) -» 0 (that is, \B(j)j 2 \ < C, C > 0, a constant) as 
j —» oc in Gauss’ test we apply Eq. (5.45). Then, for j '^> /, 6 


u j (2 j + 1)(2 j + 2) — 2j + 2 ^ ^ 1 

M.z+1 2 j (2j + 1) 2 j j' 


(5.49) 


By Eq. (5.44) the series is divergent. 


®The l dependence enters B(j) but does not affect h in Eq. (5.45). 
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Improvement of Convergence 


This section so far has been concerned with establishing convergence as an abstract math¬ 
ematical property. In practice, the rate of convergence may be of considerable importance. 
Here we present one method of improving the rate of convergence of a convergent series. 
Other techniques are given in Sections 5.4 and 5.9. 

The basic principle of this method, due to Kummer, is to form a linear combination of 
our slowly converging series and one or more series whose sum is known. For the known 
series the collection 


a i 


E 


i 

-= i 

n (n + 1) 


012 


E 


i 

n(n + \)(n + 2) 


1 

4 


a 3 


E 


i 

n(n + I )(n + 2)(n + 3) 


1 

18 


OO 

°'p=E 

n =1 


i 

n(n + 1) •••(« + p) 


1 


p- p\ 


is particularly useful. 7 The series are combined term by term and the coefficients in the 
linear combination chosen to cancel the most slowly converging terms. 


Example 5.2.5 riemann zeta function, £(3 ) 


Let the series to be summed be n 3 . In Section 5.9 this is identified as the Riemann 
zeta function, £(3). We form a linear combination 


OO OO 

n -3 + O2oi2 =« -3 

n= 1 n= 1 


Cl2 

~4' 


u | is not included since it converges more slowly than £(3). Combining terms, we obtain 
on the left-hand side 



! oo 

_ yo 

_ 


n 2 (l + ai) + 3n + 2 
n 3 (;r + 1)(« + 2) 


If we choose 02 — —l, the preceding equations yield 


c (3) = y >- 3 

n= 1 


1 y, 3« + 2 
4 n?(n + \){n + 2) 

n =1 


(5.50) 


7 These series sums may be verified by expanding the forms by partial fractions, writing out the initial terms, and inspecting the 
pattern of cancellation of positive and negative terms. 
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The resulting series may not be beautiful but it does converge as n , faster than n . 
A more convenient form comes from Exercise 5.2.21. There, the symmetry leads to con¬ 
vergence as n~ 5 . ■ 

The method can be extended, including <230:3 to get convergence as n~ 5 , C/4CY4 to get 
convergence as n ~ 6 , and so on. Eventually, you have to reach a compromise between how 
much algebra you do and how much arithmetic the computer does. As computers get faster, 
the balance is steadily shifting to less algebra for you and more arithmetic for them. 


Exercises 

5.2.1 (a) Prove that if 

lim n p u n — A < 00, p > 1, 

ft —>00 

the series u n converges. 

(b) Prove that if 

lim nu„ = A > 0, 

ft —>00 

the series diverges. (The test fails for A = 0.) 

These two tests, known as limit tests, are often convenient for establishing the conver¬ 
gence of a series. They may be treated as comparison tests, comparing with 

J2 n ~ q ’ 

ft 

5 . 2.2 if 

bfi 

lim — = K, 

ft-»oo a n 

a constant with 0 < K < oo, show that b n converges or diverges with J2 a n- 
Hint. If converges, use b' n — T l ^b n . If a n diverges, use = \b„. 

5.2.3 Show that the complete d’Alembert ratio test follows directly from Kummer’s test with 

aj = 1. 

5.2.4 Show that Raabe’s test is indecisive for P — 1 by establishing that P — 1 for the series 

1 

(a) u n = -and that this series diverges. 

n In n 

1 

(b) u„ =- 4 and that this series converges. 

n(\\\n) 1 

Note. By direct addition ^J, (M) ' (M)0 [/7(lnH) 2 ] -1 = 2.02288. The remainder of the series 
n > 10 5 yields 0.08686 by the integral comparison test. The total, then, 2 to oo, is 
2.1097. 
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5.2.5 Gauss’ test is often given in the form of a test of the ratio 


5.2.7 


n~ + a\n + ciq 


u n+ 1 n 2 + bin + bo 

For what values of the parameters a i and b\ is there convergence? divergence? 


ANS. Convergent for a\ — b\ > 1, 
divergent for u\ — b\ < 1. 


5.2.6 Test for convergence 


(a)^(lnn) 1 


n=2 

n=1 

oo , 

„ n - 

(b) > - 

^ 10" 
n= 1 

oo 

(e)E 

n=0 

oo , 

(c) V 

^2n{2n + \) 

n= 1 



(d) J][«(n+ 1)] 

1 

2n + 1' 


- 1/2 


Test for convergence 

oo 1 

»£: 


n= 1 
oo 


(b)E 


n (n + 1) 

1 


°o , 

W)E>" > + ; 


n—1 
oo 


n=2 
oo 


n In « 


( g ) E 

«=i 


i 


• n 


(c) y — 

^ n2« 


n= 1 


5.2.8 For what values of p and q will the following series converge? Y^= 


l 


2 /; P (In n )1 ' 


ANS. Convergent for 


| p > 1, all q , 

I p = 1, q > 1, 


divergent for 


| p < 1, all , 
P=l. ?< !• 


5.2.9 Determine the range of convergence for Gauss’s hypergeometric series 

zrr a a(a + 1)0(0 + 1) 2 , 

F(a, 0, y; x) = 1 H-* H-x H-. 

1 ly 2!y(y + l) 

Hint. Gauss developed his test for the specific purpose of establishing the convergence 
of this series. 


ANS. Convergent for — 1 < x < 1 and x = ±1 if y > a + 0. 


5.2.10 A pocket calculator yields 


too 


^H -3 = 1.202 007. 


n=1 
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5.2.11 


5.2.12 


5.2.13 


5.2.14 


5.2.15 


Show that 


oo 

1.202056 < J2 n ~ 3 - 1202 057 • 

n =1 

Hint. Use integrals to set upper and lower bounds on ,!_3 - 

Note. A more exact value for summation of f (3) = « -3 is 1.202 056 903 ...; 

C (3) is known to be an irrational number, but it is not linked to known constants such as 
e, n, y, ln2. 

Set upper and lower bounds on °°° n ~ l > assuming that 

(a) the Euler-Mascheroni constant is known. 


1,000,000 

ANS. 14.392726 < ^ n~ x < 14.392 727. 

n =1 


(b) The Euler-Mascheroni constant is unknown. 

Given n ~ 1 = 7.485 470... set upper and lower bounds on the Euler-Mascheroni 

constant. 


ANS. 0.5767 < y < 0.5778. 

(From (libers’ paradox.) Assume a static universe in which the stars are uniformly 
distributed. Divide all space into shells of constant thickness; the stars in any one shell 
by themselves subtend a solid angle of cdq. Allowing for the blocking out of distant 
stars by nearer stars, show that the total net solid angle subtended by all stars, shells 
extending to infinity, is exactly 47 T. [Therefore the night sky should be ablaze with 
light. For more details, see E. Harrison, Darkness at Night: A Riddle of the Universe. 
Cambridge, MA: Harvard University Press (1987).] 

Test for convergence 



l-3-5---(2n- 1) 
2 • 4 • 6 • • • (2 n) 


2 


1 9 25 

4 + 64 + 256 + ’" ' 


The Legendre series JT even it j (x) satisfies the recurrence relations 


. , (j + 1)0 + 2) — /(/ + 1) 2 , , 

=-(y + 2)U + 3)- X " l(X) ' 


in which the index j is even and / is some constant (but, in this problem, not a non¬ 
negative odd integer). Find the range of values of x for which this Legendre series is 
convergent. Test the endpoints. 


ANS. -1 <x < 1. 
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5 . 2.16 A series solution (Section 9.5) of the Chebyshev equation leads to successive terms 
having the ratio 

Uj+2(x) _ (k + j ) 2 - ?r 2 
Uj(x) (k + j + \)(k + j + 2) 

with k — 0 and k — 1. Test for convergence at x — ± 1 . 


ANS. Convergent. 


5 . 2.17 A series solution for the ultraspherical (Gegenbauer) function C“ (x ) leads to the recur¬ 
rence 

(k + j)(k + j + 2a) — n(n + 2a) 
aj+1 = aj (k + j + W + j+2) ' 

Investigate the convergence of each of these series at x — ±1 as a function of the para¬ 
meter a. 

ANS. Convergent for a < 1, 
divergent for a > 1. 

5 . 2.18 A series expansion of the incomplete beta function (Section 8.4) yields 


Bx(p, q) =x p 


1 

P 


P+ 1 


(l-q)(2-q) 2 

2\(p + 2) 


(1 — q)(2 — q) ■ ■ ■ (n — q) 

H----- x + 

n\(p + n) 


Given that 0 < x < 1, p > 0, and q > 0, test this series for convergence. What happens 
at x — 1 ? 


5 . 2.19 Show that the following series is convergent. 

y, (25-1)!! 

“! (25)!! (2s + 1)' 

Note. (25-1)!! = (25-l)(2s-3) • • • 3• 1 with (-1)!! = 1; (2s)!! = (2s)(25-2) • •-4-2 
with 0!! = 1. The series appears as a series expansion of sin _1 (l) and equals jr/2, and 
sin -1 x = arcsinx ^ (sin.r)“*. 

5 . 2.20 Show how to combine £(2) = n~ 2 with a\ and «2 to obtain a series converging 

-4 

as n . 

Note. t;(2) is known: t;(2) = tz 2 /6 (see Section 5.9). 

5 . 2.21 The convergence improvement of Example 5.2.5 may be carried out more expediently 
(in this special case) by putting «2 into a more symmetric form: Replacing n by n — 1, 
we have 


“2 = 

n=2 


i 

(n — 1 )n(n + 1) 


1 

4' 
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(a) Combine £(3) and a' 2 to obtain convergence as n~ 5 . 

(b) Let a' 4 be 04 with n —> n — 2. Combine £(3 ),a' n . and a' 4 to obtain convergence as 
n -7 . 

(c) If £(3) is to be calculated to six = decimal = place accuracy (error 5 x ICC 7 ), how 
many terms are required for £(3) alone? combined as in part (a)? combined as in 
part (b)? 


5 . 2.22 


Note. The error may be estimated using the corresponding integral. 


ANS. (a) £(3) = 


5 

4 


OO 


E 


1 

n 3 (n 2 — 1 ) 


Catalan’s constant (ft (2) of M. Abramowitz and I. A. Stegun, Handbook of Mathemati¬ 
cal Functions with Formulas, Graphs, and Mathematical Tables (AMS-55), Wash, D. C. 
National Bureau of Standards (1972); reprinted Dover (1974), Chapter 23) is defined 
by 


m = E(-d*( 2 k +D“ 2 = i - 4 

k =0 


1 


5 2 "' ' 


Calculate /3( 2) to six-digit accuracy. 

Hint. The rate of convergence is enhanced by pairing the terms: 

n n 16 k 

(4k - 1 - (4k + 1 )“ 2 =-^ 

(16k 2 — l ) 2 

If you have carried enough digits in your series summation, X!i<£<Ar I6k/(l6k 2 - l) 2 , 
additional significant figures may be obtained by setting upper and lower bounds on the 
tail of the series, Y^k^N+i- These bounds may be set by comparison with integrals, as 
in the Maclaurin integral test. 


ANS. P(2) = 0.9159 6559 4177 


5.3 Alternating Series 

In Section 5.2 we limited ourselves to series of positive terms. Now, in contrast, we con¬ 
sider infinite series in which the signs alternate. The partial cancellation due to alternating 
signs makes convergence more rapid and much easier to identify. We shall prove the Leib¬ 
niz criterion, a general condition for the convergence of an alternating series. For series 
with more irregular sign changes, like Fourier series of Chapter 14 (see Example 5.3.1), 
the integral test of Eq. (5.25) is often helpful. 


Leibniz Criterion 

Consider the series l)" + 1 a„ with a n > 0. If a n , is monotonically decreasing (for 

sufficiently large n) and lim„^oo a„ = 0, then the series converges. To prove this theorem. 



340 


Chapter 5 Infinite Series 


we examine the even partial sums 


sin = a\ — ai + 03 — • •• — din , 
Sln +2 = Sin + (« 2 n+l — ain+l)- 

Since ai n +i > ai n +i, we have 


Sln+2 > Shi ■ 


On the other hand. 


Sln+2 = a 1 — (ai — (13) — («4 — < 25 ) — ' ' ' — Uln+1- 


(5.51) 


(5.52) 

(5.53) 


Hence, with each pair of terms ai p — ai p +\ > 0, 


Sln+2 < a 1. 


(5.54) 


With the even partial sums bounded si n < si n +i < a\ and the terms u n decreasing 
monotonically and approaching zero, this alternating series converges. 

One further important result can be extracted from the partial sums of the same alternat¬ 
ing series. From the difference between the series limit S and the partial sum s n , 


S S n — U n +l Gi-(-2 4“ U n +3 An +4 4“ * * * 


— ®n + l ( a n+ 2 a n+ 3 ) (&n +4 ^/i+5) ‘ ‘ ? (5.55) 


or 


S-s n <a n+ 1 . (5.56) 

Equation (5.56) says that the error in cutting off an alternating series whose terms are 
monotonically decreasing after n terms is less than a„+ 1 , the first term dropped. A knowl¬ 
edge of the error obtained this way may be of great practical importance. 


Absolute Convergence 


Given a series of terms u„ in which «„ may vary in sign, if ^ \u n \ converges, then ^ u n is 
said to be absolutely convergent. If u n converges but ^ \ u n diverges, the convergence 

is called conditional. 

The alternating harmonic series is a simple example of this conditional convergence. We 
have 


OO , 

^(- 1)"- 1 „- 1 = 1 -I + 


1 

3 


1 

4 


convergent by the Leibniz criterion; but 





i 

3 


1 

4 


(- 1)”" 1 

n 


4-, 


1 

n 


4 - 


(5.57) 


has been shown to be divergent in Sections 5.1 and 5.2. 
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Note that most tests developed in Section 5.2 assume a series of positive terms. Therefore 
these tests in that section guarantee absolute convergence. 


Example 5.3.1 Series with Irregular Sign Changes 


For 0 < x < 2 tt the Fourier series (see Chapter 14.1) 


E 


cos (nx) 
n 


— — In 



(5.58) 


converges, having coefficients that change sign often, but not so that the Leibniz conver¬ 
gence criterion applies easily. Let us apply the integral test of Eq. (5.22). Using integration 
by parts we see immediately that 



cos(nx) 

- an 

n 


sin(nT) 

nx 


1 f°° sin(nT) 

- / - ~—dn 

x J n= \ n- 


converges, and the integral on the right-hand side even converges absolutely. The derivative 
term in Eq. (5.22) has the form 



x cos {nx) 

- sin(nx)-■=— 

n n z 


dn, 


where the second term converges absolutely and need not be considered further. Next we 
observe that g(N) = (n — [«]) sin(n.r) dn is bounded for N -> oo, just as f sin(nx) dn 
is bounded because of the periodic nature of sin(nx) and its regular sign changes. Using 
integration by parts again. 


f°°g'(n ) , 

/ - an = 

i 

oq 

S' 

_1 

J l n 

L n J 




dn, 


we see that the second term is absolutely convergent and that the first goes to zero at the 
upper limit. Hence the series in Eq. (5.58) converges, which is hard to see from other 
convergence tests. 

Alternatively, we may apply the q — 1 case of the Euler-Maclaurin integration formula 
inEq. (5.168b), 


E/(V) = f" n*)dx + \{m + /(!)} + ^{/'(«) - /'(!)} 



n— 1 


-]^f"(x + v)dx. 


u=l 


which is straightforward but more tedious because of the second derivative. 
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Exercises 


5.3.1 


5.3.2 


5.3.3 


(a) From the electrostatic two-hemisphere problem (Exercise 12.3.20) we obtain the 
series 


£(-D'(4s 

s=0 


+ 3) 


(2s- 1)!! 
(2s+ 2)!!' 


Test it for convergence. 

(b) The corresponding series for the surface charge density is 


^(-l)*(4s + 3) 

s=0 


(2s — 1)!! 
(2s)!! 


Test it for convergence. 

The !! notation is explained in Section 8.1 and Exercise 5.2.19. 


Show by direct numerical computation that the sum of the first 10 terms of 


lim 


iln(l+x) = ln2 = J](—1) 


n ~\r l 


n= 1 


differs from ln2 by less than the eleventh term: ln2 = 0.69314 71806_ 

In Exercise 5.2.9 the hypergeometric series is shown convergent for x = ±1, if y > 
a + /3. Show that there is conditional convergence for x = — 1 for y down to y > 
a + P — 1 . 

Hint. The asymptotic behavior of the factorial function is given by Stirling’s series, 
Section 8.3. 


5.4 Algebra of Series 

The establishment of absolute convergence is important because it can be proved that ab¬ 
solutely convergent series may be reordered according to the familiar rules of algebra or 
arithmetic. 

• If an infinite series is absolutely convergent, the series sum is independent of the order 
in which the terms are added. 

• The series may be multiplied with another absolutely convergent series. The limit of the 
product will be the product of the individual series limits. The product series, a double 
series, will also converge absolutely. 

No such guarantees can be given for conditionally convergent series. Again consider the 
alternating harmonic series. If we write 

1 2 ' 3 4 ' ~ 1 \2 3/ V4 5/ 


(5.59) 
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it is clear that the sum 

oo 

^(-ly'-'n- 1 < 1. (5.60) 

n= 1 

However, if we rearrange the terms slightly, we may make the alternating harmonic series 
converge to f. We regroup the terms of Eq. (5.59), taking 

( ! + 3 + s) - ( 2 ) + (7 + 9 + A + A + b) “ (i) 

+ (l7 H - h Z 5 ) ~ (§) + (?7 H - h 5s)~ (§) + •••• ( 5 - 61 ) 

Treating the terms grouped in parentheses as single terms for convenience, we obtain the 
partial sums 


,v 1 = 1.5333 
53 = 1-5218 
55 = 1.5143 
= 1-5103 
59 = 1-5078 


52 = 1-0333 
54 = 1.2718 
5 6 = 1.3476 
5 8 = 1.3853 
510 = 1.4078 


From this tabulation of 5,, and the plot of 5,, versus n in Fig. 5.3, the convergence to 
| is fairly clear. We have rearranged the terms, taking positive terms until the partial sum 
was equal to or greater than | and then adding in negative terms until the partial sum just 
fell below | and so on. As the series extends to infinity, all original terms will eventually 
appear, but the partial sums of this rearranged alternating harmonic series converge to |. 

By a suitable rearrangement of terms, a conditionally convergent series may be made 
to converge to any desired value or even to diverge. This statement is sometimes given 



Figure 5.3 Alternating harmonic series—terms 
rearranged to give convergence to 1.5. 
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as Riemann’s theorem. Obviously, conditionally convergent series must be treated with 
caution. 

Absolutely convergent series can be multiplied without problems. This follows as a 
special case from the rearrangement of double series. However, conditionally convergent 
series cannot always be multiplied to yield convergent series, as the following example 
shows. 


Example 5.4.1 Square of a Conditionally Convergent Series May Diverge 


The series ( — converges, by the Leibniz criterion. Its square, 

11 11 11 " 
VT ~Jn — 1 \/2 — 2 — 1 sf\ _ 



has the general term in brackets consisting of n — 1 additive terms, each of which is greater 
than J -^== , so the product term in brackets is greater than and does not go to 

zero. Hence this product oscillates and therefore diverges. ■ 


Hence for a product of two series to converge, we have to demand as a sufficient con¬ 
dition that at least one of them converge absolutely. To prove this product convergence 
theorem that if ^ u„ converges absolutely to U , v n converges to V , then 


E 


Cn > 


n 


Cn 


n 


^ ' Wm Vn—m 
m =0 


converges to U V , it is sufficient to show that the difference terms /.)„ = cq + cj + • • • + 
C2n — U„ V„ 0 for n oc. where U n , V„ are the partial sums of our series. As a result, 
the partial sum differences 


D n — m 0 uo + (wont + m ii>o) H-b (uovin + u\V2 n -\ H-b M 2 /H 0 ) 

— (M 0 + Ml + • • • + U n )(v 0 + V\ + • • • + v n ) 

— no(n«+l + • • • + V2 n ) + M 1 (T/j + I + • • • + n2 ( i-l) + • • • + Mn+lWn+l 
+ n„+i (l>0 + • • • + V n -i) + • • • + U2nV0, 


so for all sufficiently large n, 

I All < e(|Mol + • • • + |m« —1 1 ) + Tf(|t<;i + l| + • • • + | M 2n | ) < €(A + M), 

because |u„+i + v n +2 H-b v n + m \ < e for sufficiently large n and all positive integers m 

as ^ v n converges, and the partial sums V n < B of ^ (1 v„ are bounded by M, because the 
sum converges. Finally we call \u n \ — a, as u„ converges absolutely. 

Two series can be multiplied, provided one of them converges absolutely. Addition and 
subtraction of series is also valid termwise if one series converges absolutely. 
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Improvement of Convergence, 

Rational Approximations 


The series 


ln(l + x) — (—1)" _1 —, -1 < x < 1, 

L —' n 


(5.61a) 


converges very slowly as x approaches +1. The rate of convergence may be improved 
substantially by multiplying both sides of Eq. (5.61a) by a polynomial and adjusting the 
polynomial coefficients to cancel the more slowly converging portions of the series. Con¬ 
sider the simplest possibility: Multiply ln(l + x) by 1 + a\x\ 


(1 +fliv)ln(l + x) = ^(-1)" l — +ai^(-l)" 1 


r n+l 


n = 1 n = 1 

Combining the two series on the right, term by term, we obtain 

oo 


(1 +a\x)ln(l +*) = x + 1 (- 

n=2 
oo 

= x +E (_i ) 


_i / 1 a i 


n=2 


n n — 1 

„_i nil - at) - 1 
n(n — 1) 


x . 


Clearly, if we take a\ — 1, the n in the numerator disappears and our combined series 
converges as n~ 2 . 

Continuing this process, we find that (1 + 2x + x 2 ) ln(l + x) vanishes as n -3 and that 
(1 + 3x + 3x 2 + x 3 )ln(l + x) vanishes as n~ 4 . In effect we are shifting from a simple 
series expansion of Eq. (5.61a) to a rational fraction representation in which the function 
ln(l + x) is represented by the ratio of a series and a polynomial: 

W1 , , * + £~=2(-l)"*7[n(H-l)] 

ln(l + x) = -—-. 

I + x 

Such rational approximations may be both compact and accurate. 


Rearrangement of Double Series 


Another aspect of the rearrangement of series appears in the treatment of double series 
(Fig. 5.4): 


Let us substitute 


OO OO 

EE Mn,m • 

m =0 n=0 


n = q > 0, 


m — p — q > 0 (q < p ). 
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Figure 5.4 Double 
series — summation over n 
indicated by vertical dashed 
lines. 


This results in the identity 


OO OO OO p 

^ ^ ^ U n jn — ^ ^ g. (5.62) 

m =0 n=0 p=0q=0 

The summation over p and q of Eq. (5.62) is illustrated in Fig. 5.5. The substitution 


n — s > 0, m — r — 2s > 0 


r 

s < - 
~ 2 


leads to 


oo oo oo [r/2] 

^ ^ ' ^hun — ^ ^ ' ®s,r—2si 

m= 0 n =0 r= 05=0 


(5.63) 



p = 0 1 2 3 

q = 0 

n 00 fl 0l a 02 fl 03 

1 

a [0 fl ll a l2 

2 

a 20 a 2l 

3 

a 30 


Figure 5.5 Double series 
— again, the first summation 
is represented by vertical 
dashed lines, but these 
vertical lines correspond to 
diagonals in Fig. 5.4. 
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r = 0 

1 

2 

3 

4 

11 

0 

O 

O 

a 01 

a Q2 

a Q3 

«04 

1 



a io 

Gl 

a \2 

2 





Cl 20 


Figure 5.6 Double series. The 
summation over s corresponds to a 
summation along the almost-horizontal 
dashed lines in Fig. 5.4. 


with [r/2] = r /2 for r even and (r — l)/2 for r odd. The summation over r and v of 
Eq. (5.63) is shown in Fig. 5.6. Equations (5.62) and (5.63) are clearly rearrangements of 
the array of coefficients a nm , rearrangements that are valid as long as we have absolute 
convergence. 

The combination of Eqs. (5.62) and (5.63), 

oo p oo [r/2] 

= a s,r-2s> (5.64) 

p=0q=0 r =0 s=0 

is used in Section 12.1 in the determination of the series form of the Legendre polynomials. 


Exercises 


5.4.1 


5.4.2 

5.4.3 


Given the series (derived in Section 5.6) 

2 3 4 

X X J X* 

ln(l +x) = x - 1 -, 

2 3 4 


show that 


In 


1 + x 

1 — X 


= 2 



— 1 < x < 1 , 


— 1 < X < 1. 


The original series, ln(l + x), appears in an analysis of binding energy in crystals. It 
is ^ the Madelung constant (2 In2) for a chain of atoms. The second series is useful 
in normalizing the Legendre polynomials (Section 12.3) and in developing a second 
solution for Legendre’s differential equation (Section 12.10). 

Determine the values of the coefficients a \, cn, and <23 that will make 
(1 + a\x + ci 2 X 2 + fl 3 X 3 ) ln(l + x) converge as n ~ 4 . Find the resulting series. 


Show that 


OO OO 

(a) £[?(") - 1] = 1, (b) £(-l)"[f(n) - 1] = 

n=2 n =2 


where £(n) is the Riemann zeta function. 
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5.4.4 


Write a program that will rearrange the terms of the alternating harmonic series to make 
the series converge to 1.5. Group your terms as indicated in Eq. (5.61). List the first 100 
successive partial sums that just climb above 1.5 or just drop below 1.5, and list the new 
terms included in each such partial sum. 


n 

i 

2 

3 

4 

5 

Sn 

1.5333 

1.0333 

1.5218 

1.2718 

1.5143 


5.5 Series of Functions 


We extend our concept of infinite series to include the possibility that each term u n may be 
a function of some variable, u„ = u n (x). Numerous illustrations of such series of functions 
appear in Chapters 11-14. The partial sums become functions of the variable x, 

s n (x) = U \{x) + M2 CO H-1- Unix ), (5.65) 


as does the series sum, defined as the limit of the partial sums: 


OO 


E 


u„(x) — S(x) — lim s„ix). 

n —>oo 


(5.66) 


So far we have concerned ourselves with the behavior of the partial sums as a function 
of n. Now we consider how the foregoing quantities depend on x. The key concept here is 
that of uniform convergence. 


Uniform Convergence 

If for any small s > 0 there exists a number N , independent of x in the interval [a, b] (that 
is, a < x < b) such that 

| SCO — s n OO| < £, for all n>N, (5.67) 

then the series is said to be uniformly convergent in the interval [a,b]. This says that for 
our series to be uniformly convergent, it must be possible to find a finite N so that the tail 
of the infinite series, | Y^uLn+ l u i( x ) l> will be less than an arbitrarily small s for all x in 
the given interval. 

This condition, Eq. (5.67), which defines uniform convergence, is illustrated in Fig. 5.7. 
The point is that no matter how small s is taken to be, we can always choose n large enough 
so that the absolute magnitude of the difference between Six) and s n (x) is less than s for 
all x, a < x < b. If this cannot be done, then u„ (x) is not uniformly convergent in [a, b]. 


Example 5.5.1 Nonuniform Convergence 


U n (x) = -. 

^ ^ [in - \)x + l][nx + 1] 

n =1 n = 1 


(5.68) 
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Figure 5.7 Uniform convergence. 


The partial sum s n (x) = nx(nx + 1) _1 , as may be verified by mathematical induction. 
By inspection this expression for s n (x) holds for n = 1,2. We assume it holds for n terms 
and then prove it holds for n + 1 terms: 


■Sn+iM = s„(x) + 


X 


[nx + l][(n + \)x + 1] 

nx x 

+ 


[nx + 1] [nx + l][(n + l)x + 1] 


(n + 1 )x 
(n + l)x + 1 ’ 


completing the proof. 

Letting n approach infinity, we obtain 

5(0) = lim s„(0) = 0, 

n — y cxd 

S(x ^ 0) = lim s n (x^ 0) = 1. 

ft—>oo 

We have a discontinuity in our series limit at x = 0. However, s n (x ) is a continuous func¬ 
tion of x, 0 < x < 1, for all finite n. No matter how small s may be, Eq. (5.67) will be 
violated for all sufficiently small x. Our series does not converge uniformly. ■ 


Weierstrass M (Majorant) Test 

The most commonly encountered test for uniform convergence is the Weierstrass M test. 
If we can construct a series of numbers M/, in which M, > \u,(x)\ for all x in the 
interval [a, b] and M; is convergent, our series n, (x) will be uniformly convergent 
in [a, b]. 
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The proof of this Weierstrass M test is direct and simple. Since JT Mj converges, some 
number N exists such that for n + 1 > N, 

oo 

Y. Mj < e. (5.69) 

i=n +1 

This follows from our definition of convergence. Then, with |n ( - (x)\ < Mj for all x in the 
interval a <x < b. 


Hence 


OO 

Y \ u i( x )\ < s ■ 

i=n +1 


|S(*) - s n (x )| 


OO 

Y. u i( x ) 

i=n +1 


< 


(5.70) 


(5.71) 


and by definition w, (x) is uniformly convergent in [a, b]. Since we have specified 
absolute values in the statement of the Weierstrass M test, the series YluLi u i( x ) i s a l so 
seen to be absolutely convergent. 

Note that uniform convergence and absolute convergence are independent properties. 
Neither implies the other. For specific examples, 


and 


y, (- 1 )” 

n + x 2 ’ 


— OO < X < oo, 


(5.72) 


CXJ n 

Y (~1)" -1 — = ln(l + x). 


0 < x < 1, 


(5.73) 


converge uniformly in the indicated intervals but do not converge absolutely. On the other 
hand. 


OO 

7> — x)x n = 1, 0<x<l 

n =0 


= 0, x = l. 


(5.74) 


converges absolutely but does not converge uniformly in [0,1], 

From the definition of uniform convergence we may show that any series 

OO 

f(x) = Y u n(x) (5.75) 

n= 1 

cannot converge uniformly in any interval that includes a discontinuity of fix) if all u„ (x) 
are continuous. 

Since the Weierstrass M test establishes both uniform and absolute convergence, it will 
necessarily fail for series that are uniformly but conditionally convergent. 
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Abel’s Test 


A somewhat more delicate test for uniform convergence has been given by Abel. If 

U n (x) = Cl n fn(x), 

Ya n — A, convergent 


and the functions f n (x) are monotonic [/„+i(x) < f n (x)] and bounded, 0 <f n (x)<M, 
for all x in [a, /;], then ll n(x) converges uniformly in [a, /;]. 

This test is especially useful in analyzing power series (compare Section 5.7). Details of 
the proof of Abel’s test and other tests for uniform convergence are given in the Additional 
Readings listed at the end of this chapter. 

Uniformly convergent series have three particularly useful properties. 


1. If the individual terms u n (x ) are continuous, the series sum 


fix) = Y u n(x) 


(5.76) 


n =1 


is also continuous. 

2. If the individual terms u n (x) are continuous, the series may be integrated term by 
term. The sum of the integrals is equal to the integral of the sum. 


f 


oo b 

f(x)dx = Y 

, Ja 
n= 1 


u„{x)dx. 


(5.77) 


3. The derivative of the series sum f{x) equals the sum of the individual term deriva¬ 
tives: 


d d 

3 -/(*)=> —u„ix), 
dx Z —' rir 


n= 1 


1 dx 


(5.78) 


provided the following conditions are satisfied: 


u n ix) and — " ^ ^ are continuous in [a, b]. 
dx 


°° du n (x) 

Y, —j -is uniformly convergent in [a,b]. 


n =1 


dx 


Term-by-term integration of a uniformly convergent series 8 requires only continuity of 
the individual terms. This condition is almost always satisfied in physical applications. 
Term-by-term differentiation of a series is often not valid because more restrictive condi¬ 
tions must be satisfied. Indeed, we shall encounter Fourier series in Chapter 14 in which 
term-by-term differentiation of a uniformly convergent series leads to a divergent series. 


Term-by-term integration may also be valid in the absence of uniform convergence. 
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Exercises 


5.5.1 


5.5.2 

5.5.3 

5.5.4 


Find the range of uniform convergence of the Dirichlet series 
(-l)"” 1 ^ 1 

— (b)C(x) = V—• 

' n x 


( a >E 

n=l 


n =1 


ANS. (a) 0 < j < x < oo. 

(b) 1 < s < x < oo. 

For what range of x is the geometric series YlnLo x " uniformly convergent? 

ANS. — 1 < — s < jc < s < 1. 

For what range of positive values of x is 1/(1 + x") 

(a) convergent? (b) uniformly convergent? 

If the series of the coefficients a n and ]C b n are absolutely convergent, show that the 
Fourier series 


E 


(i a n cos nx + b n sinn.r) 


is uniformly convergent for — oo < x < oo. 


5.6 Taylor’s Expansion 


This is an expansion of a function into an infinite series of powers of a variable x or into 
a finite series plus a remainder term. The coefficients of the successive terms of the series 
involve the successive derivatives of the function. We have already used Taylor’s expansion 
in the establishment of a physical interpretation of divergence (Section 1.7) and in other 
sections of Chapters 1 and 2. Now we derive the Taylor expansion. 

We assume that our function f(x) has a continuous nth derivative 9 in the interval a < 
x < b. Then, integrating this nth derivative n times. 


f f (n \xx)dx x = f n ~ l \x i) * = f n ~ l \x) - 
Ja a 

f dx 2 ( dx l f {n) (xi)= f dx 2 [f (n ~ l) (X 2 ) - (a)] 

J a J a J a 


(5.79) 


= f (n ~ 2 \x) - r~^{a) -(x- a)r~ l >(a). 


f(n- 2) 


(n-l), 


Continuing, we obtain 


[ dx 3 f dx 2 f dxif (n \xi) = f (n 3 \x)-f in 3) (a) - (x -a)f ( " 2 \a) 
J a J a J a 


(x 


2 ! 




(5.80) 


^Taylor’s expansion may be derived under slightly less restrictive conditions; compare H. Jeffreys and B. S. Jeffreys, Methods 
of Mathematical Physics, 3rd ed. Cambridge: Cambridge University Press (1956), Section 1.133. 
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Finally, on integrating for the nth time. 


J a J a 


dx] f (n) (x ]) = f(x) - f (a) - (x - a)f'(a) 


(x — ay 
2! 


/» 


— - (5.8D 

(n - 1)! 

Note that this expression is exact. No terms have been dropped, no approximations made. 
Now, solving for fix), we have 


(5.82) 


The remainder, R n , is given by the n-fold integral 

R n = [ X dx n ■ ■ ■ r d Xl f (n \ Xl ). (5.83) 

J a J a 

This remainder, Eq. (5.83), may be put into a perhaps more practical form by using the 
mean value theorem of integral calculus: 



dx = (* -fl)g(f). 


(5.84) 


with a < f < x. By integrating n times we get the Lagrangian form 10 of the remainder: 


R 


n 


(x - a) n 
n ! 




(5.85) 


With Taylor’s expansion in this form we are not concerned with any questions of infinite 
series convergence. This series is finite, and the only questions concern the magnitude of 
the remainder. 

When the function fix) is such that 


lim R n = 0, 

n—> oo 


Eq. (5.82) becomes Taylor’s series: 


fix) = f (a) + (x - a)f'(a) + ^ ^ f"(a) H- 

= ~ (x-of (n) n 

^ n! 
n =0 


(5.86) 


(5.87) 


10 An alternate form derived by Cauchy is 


with a < f <x. 

1 'Note that 0! = 1 (compare Section 8.1). 


(n — 1)! 
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Our Taylor series specifies the value of a function at one point, x, in terms of the value 
of the function and its derivatives at a reference point a. It is an expansion in powers of the 
change in the variable. Ax = x — a in this case. The notation may be varied at the user’s 
convenience. With the substitution x -> x + h and a —> x we have an alternate form, 

00 h" 

f {x+h ) = J2^f in) (*)■ 

L —' n\ 

n= 0 

When we use the operator D — d/dx, the Taylor expansion becomes 

^ h n D" hn 

f(x + h) = Y] - —fix) = e hD fix). 

A —' n\ 

n= 0 

(The transition to the exponential form anticipates Eq. (5.90), which follows.) An equiva¬ 
lent operator form of this Taylor expansion appears in Exercise 4.2.4. A derivation of the 
Taylor expansion in the context of complex variable theory appears in Section 6.5. 

Maclaurin Theorem 

If we expand about the origin ia — 0), Eq. (5.87) is known as Maclaurin’s series: 

(5.88) 

An immediate application of the Maclaurin series (or the Taylor series) is in the expan¬ 
sion of various transcendental functions into infinite (power) series. 

Example 5 . 6.1 exponential function 

Let fix) — e x . Differentiating, we have 

f (n) i 0) = 1 (5.89) 

for all n, n = 1, 2, 3,_Then, with Eq. (5.88), we have 

(5.90) 

This is the series expansion of the exponential function. Some authors use this series to 
define the exponential function. 

Although this series is clearly convergent for all x, we should check the remainder term, 
R n . By Eq. (5.85) we have 

Rn = ^f ( " ) it)=^7eS, 0<|§|<t. (5.91) 

n\ n\ 







5.6 Taylor’s Expansion 


355 


Therefore 


and 


\R,A < 


lim R n — 0 

n —>oo 


(5.92) 


(5.93) 


for all finite values of x, which indicates that this Maclaurin expansion of e x converges 
absolutely over the range — oo < x < oo. ■ 


Example 5.6.2 


Logarithm 


Let f(x ) = ln(l + x). By differentiating, we obtain 

f'(x) = (l+xrK 
f^\x) = (-ir-\n-mi+xy n . 
The Maclaurin expansion (Eq. (5.88)) yields 


2 3 


ln(l+T)=X-— +y- — 


Rn 


(5.94) 


= E ( - 1) ' , “ 1 — + R >" 
U P 


In this case our remainder is given by 


Rn = 

n\ 


0 < £ < x 


(5.95) 


< 0 < | < x < 1. 

n 


(5.96) 


Now, the remainder approaches zero as n is increased indefinitely, provided 0 < x < l. 12 
As an infinite series. 


(5.97) 


converges for —1 < x < 1. The range — 1 < x < 1 is easily established by the d’Alembert 
ratio test (Section 5.2). Convergence at x = 1 follows by the Leibniz criterion (Section 5.3). 
In particular, at x = 1 we have 



1111 

In 2 = 1-1--+ - 

2 3 4 5 


■ = E(- 1 )"“ 1 ' r1 ’ 


(5.98) 


n —1 


the conditionally convergent alternating harmonic series. 


12' 


This range can easily be extended to — 1 < x < 1 but not to x = — 1 . 
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Binomial Theorem 


A second, extremely important application of the Taylor and Maclaurin expansions is the 
derivation of the binomial theorem for negative and/or nonintegral powers. 

Let f(x) — (1 + x) m , in which m may be negative and is not limited to integral values. 
Direct application of Eq. (5.88) gives 

(1 + X ) m = 1 + mx + —-—V + ••• + /?„. (5.99) 

For this function the remainder is 

x 11 

R n = — (1 + f) m_ "m(m - 1) • • • (m - n + 1) (5.100) 

/?! 

and § lies between 0 and x, 0 < £ < x. Now, for n > m, (1 + f) m_ " is a maximum for 
|=0. Therefore 

x n 

R n < — m(m — 1) • • • (m — n + 1). (5.101) 

n! 


Note that the m dependent factors do not yield a zero unless m is a nonnegative integer; R n 
tends to zero as n —> oo if .r is restricted to the range 0 < x < I. The binomial expansion 
therefore is shown to be 


(1 + jc )™ = 1 ■ 


m (m 


2 ! 


1 ) 2 m(m 
—x H- 


1 ) (m 


3! 


' 2) 3j _ 
—x + • • 


(5.102) 


In other, equivalent notation. 


(l+x) m = 



n =0 



(5.103) 


The quantity which equals m!/[n!(m — «)!], is called a binomial coefficient. Al¬ 
though we have only shown that the remainder vanishes. 


lim R n =0, 

n —> oo 

for 0 < x < 1, the series in Eq. (5.102) actually may be shown to be convergent for the 
extended range — 1 < x < 1. For m an integer, (in — n)\ = ±oo if n > m (Section 8.1) and 
the series automatically terminates at n — m. 


Example 5.6.3 relativistic energy 

The total relativistic energy of a particle of mass m and velocity v is 

2 ( v 2 \~ 1 ' 2 

E — me 2 1 1 — j . (5.104) 

Compare this expression with the classical kinetic energy, mv 2 /2. 
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By Eq. (5.102) with x = —v 2 /c 2 and m = -l/2we have 


E — m& 




(— 1 /2) (—3/2) / v 


2 ! 


i.2 \ 2 


+ 


(—1/2)(—3/2)(—5/2) f v 


2 \ 3 


3! 


\ c 2 


2 1 9 ^ 2 ^ 5 2 / ^ 

£ = me H—mu H—mu • -^r H-mu • —r- 

2 8 c 2 16 Vc 2 


2 \ 2 


(5.105) 


The first term, me, is identified as the rest mass energy. Then 


^kinetic — HIV 


3v 2 5 / u 2 x 2 

1 + 4? + 8l? 


(5.106) 


For particle velocity v <£ c, the velocity of light, the expression in the brackets reduces 
to unity and we see that the kinetic portion of the total relativistic energy agrees with the 
classical result. ■ 

For polynomials we can generalize the binomial expansion to 


(fll + fl 2 + • • • + dmY 1 — y ' 


n\ !n 2 !---n OT ! 


Cl I Cl'-) 


where the summation includes all different combinations of n\, n 2 , ■.., n m with 
n > = n - Here n,- and n are all integral. This generalization finds considerable use 
in statistical mechanics. 

Maclaurin series may sometimes appear indirectly rather than by direct use of Eq. (5.88). 
For instance, the most convenient way to obtain the series expansion 


OO 

sin -1 .r = ^2 

n = 0 


(2 n - 1)!! 
( 2 «)!! 


x 2 „+\ x 3 3x 5 

^TY)- x + ~ 6 + ^o + 


(5.106a) 


is to make use of the relation (from sin v = x, get dy/dx = 1 /Vl — x 2 ) 

• -i f X dt 

sin x = Jo 

We expand (1 — f 2 ) -1 / 2 (binomial theorem) and then integrate term by term. This term- 
by-term integration is discussed in Section 5.7. The result is Eq. (5.106a). Finally, we may 
take the limit as x —> 1. The series converges by Gauss’ test. Exercise 5.2.5. 
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Taylor Expansion — More Than One Variable 


If the function / has more than one independent variable, say, / = fix, v), the Taylor 
expansion becomes 

9 f df 

fix, y ) = f(a,b) + (x - a)— + (y - b) — 

ox oy 

IT , 9 2 / 9 2 f ? 9 2 /' 

+ - (X- a ) 2 -4 + 2{x - a)(y - b)—— + (y - b ) 2 — T 
2 ! |_ dx z dvdy d;y z _ 

9 3 / 


+ ^[ (X - a)3 ^ + 3(X - a)2( ^^9x 2 9y 


+ 3(x - a)(y - b ) 2 -^-4 + (y - ^) 3 ^y 
axdy z 9y J 


+ ••• 


(5.107) 


with all derivatives evaluated at the point (a, b). Using a/t — xj — Xjo, we may write the 
Taylor expansion for m independent variables in the symbolic form 


^ f" /v- 9 V 

/(.T 1 , > — > a/— f{x 1 

“ « ! V“ 9 ^/ 

A convenient vector form for m = 3 is 


• , X m ) 


ixk=Xko,k=l,...,m) 


(5.108) 


OO J 

Vr(r + a) = y --(a- V)"tfr(r). 


(5.109) 


n= 0 


Exercises 


5.6.1 Show that 


(a) 

(b) 


sinx = 




n= 0 


^2n+l 

(2 n+l)!’ 


COS V = 


Ec-h‘ 


n=0 


x 2n 

(2*0! 


In Section 6.1, e 1 * is defined by a series expansion such that 

= cosx + i sinx. 

This is the basis for the polar representation of complex quantities. As a special case we 
find, with x = n, the intriguing relation 


e' 71 = —1. 
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5.6.2 


5.6.3 


5.6.4 


5.6.5 


5.6.6 


5.6.7 


5.6.8 


5.6.9 


5.6.10 


Derive a series expansion of cot x in increasing powers of x by dividing cos x by sin x. 
Note. The resultant series that starts with 1 /x is actually a Laurent series (Section 6.5). 
Although the two series for sin x and cos x were valid for all x, the convergence of the 
series for cot x is limited by the zeros of the denominator, sin x (see Analytic Continu¬ 
ation in Section 6.5). 

The Raabe test for ff n in Inn) -1 leads to 

[ (n + 1) ln(n + 1) " 

lim n - 1 . 

n- s-oo nlnn 

Show that this limit is unity (which means that the Raabe test here is indeterminate). 
Show by series expansion that 

1 TlQ -f* 1 I 

x In — -- = coth 1 ? 7 o, |»?ol > 1. 

2 770—1 

This identity may be used to obtain a second solution for Legendre’s equation. 

Show that /(x) = x 1 ' 2 (a) has no Maclaurin expansion but (b) has a Taylor expansion 
about any point xo f- 0. Find the range of convergence of the Taylor expansion about 

x — XQ. 


Let x be an approximation for a zero of f(x) and Ax be the correction. Show that by 
neglecting terms of order (Ax) 2 , 


Ax = — 


fix} 

/'(*)' 


This is Newton’s formula for finding a root. Newton’s method has the virtues of illus¬ 
trating series expansions and elementary calculus but is very treacherous. 

Expand a function <J>(x, y, z) by Taylor’s expansion about (0,0, 0) to 0(a 3 ). Evaluate 
<I>, the average value of <t>, averaged over a small cube of side a centered on the origin 
and show that the Laplacian of O is a measure of deviation of <J> from <l>(0, 0, 0). 


The ratio of two differentiable functions /(x) and g(x ) takes on the indeterminate form 
0/0 at x = xq. Using Taylor expansions prove L’HopitaTs rule. 


With n > 1, show that 


(a) - - In 
n 



lim 

fix) 

— 11 m 

fix) 

g(x) 

— illll 

*->*() 

g'ix) 

1 

(b) - 

n 

-H 

f n + 1 ^ 

)>0. 

V n ) 


Use these inequalities to show that the limit defining the Euler-Mascheroni constant, 
Eq. (5.28), is finite. 

Expand (1 —2 tz + t 2 )~ 1 ^ 2 in powers of t. Assume that t is small. Collect the coefficients 
of t°. t l , and t 2 . 
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5.6.11 


ANS. a 0 = P 0 (z)= 1, 
a l = P\ (z) = Z, 

«2 = P 2 (z) — j(3z 2 — 1), 

where a n = P n (z ), the nth Legendre polynomial. 
Using the double factorial notation of Section 8.1, show that 


( 2 


E(-d 


12=0 


(m + 2n — 2 )!! n 
2 "n\(m — 2 )!! 


for /77 = 1,2,3. 

5.6.12 Using binomial expansions, compare the three Doppler shift formulas: 

-I 


(a) v' = v 1 + - 


(b) i/ = v(l± — 


(c) v' = v( 1 ±- )( 1 


moving source; 

moving observer; 

„ 2 \-l /2 


relativistic. 


Note. The relativistic formula agrees with the classical formulas if terms of order v 2 /c 2 
can be neglected. 

5.6.13 In the theory of general relativity there are various ways of relating (defining) a velocity 
of recession of a galaxy to its red shift, 8. Milne’s model (kinematic relativity) gives 


(a) vi =c<5( 1 + -8 ), 


(b) V2 = c5{1 + -S}(1+S) 


-2 


(c) 1+3 = 


1 + t>3 /C 
1 - v 3 /c 


1/2 


1. Show that for 5<<1 (and 1)3 /c <+ 1) all three formulas reduce to v = cS. 

2. Compare the three velocities through terms of order 8 2 . 

Note. In special relativity (with 8 replaced by z), the ratio of observed wavelength /, to 
emitted wavelength /,o is given by 

X 0 \c-i)J 

5.6.14 The relativistic sum w of two velocities u and v is given by 

w u/c + v/c 
c 1 + uv/c 2 
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If 

v u 

- = — = 1 — a, 
c c 

where 0 < a < 1, find w/c in powers of a through terms in a 3 . 


5.6.15 


5.6.16 


The displacement x of a particle of rest mass m o, resulting from a constant force mog 
along the x-axis, is 





1 


including relativistic effects. Find the displacement x as a power series in time t. Com¬ 
pare with the classical result. 


x = 



By use of Dirac’s relativistic theory, the fine structure formula of atomic spectroscopy 
is given by 

- 1/2 


where 


E — mc z 


1 + 


o ■ 


\k\y 


* = (|£| 2 - k 2 ) 1/2 , k = ±1, ±2, ±3,.... 


Expand in powers of y 2 through order y 4 (y 2 — Ze 2 /4neohc, with Z the atomic num¬ 
ber). This expansion is useful in comparing the predictions of the Dirac electron theory 
with those of a relativistic Schrodinger electron theory. Experimental results support the 
Dirac theory. 


5.6.17 In a head-on proton-proton collision, the ratio of the kinetic energy in the center of mass 
system to the incident kinetic energy is 

R — [ j2mc 2 [Ek +2 me 2 ) — 2 mc 2 ~\/Ek. 

Find the value of this ratio of kinetic energies for 


(a) Ek me 2 (nonrelativistic) 

(b) Ek me 2 (extreme-relativistic). 


ANS. (a) (b) 0. The latter answer is a sort of law 

of diminishing returns for high-energy particle 
accelerators (with stationary targets). 

5.6.18 With binomial expansions 

OO 

n =0 

Adding these two series yields Y^n=-oo x " = 

Hopefully, we can agree that this is nonsense, but what has gone wrong? 


* _Yx n x - 

1 — X ' x — 1 1 — x~ l 

n = 1 
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5.6.19 


5.6.20 


5.6.21 


5.6.22 


(a) Planck’s theory of quantized oscillators leads to an average energy 

_ J2T= l ngoexp(-neo/AT) 

J2T=o ex P^ n£ o/ kT ) 

where so is a fixed energy. Identify the numerator and denominator as binomial 
expansions and show that the ratio is 

(s) = £ o 

exp(s 0 / kT) — 1' 

(b) Show that the (e) of part (a) reduces to kT , the classical result, for kT so- 

(a) Expand by the binomial theorem and integrate term by term to obtain the Gregory 
series for y = tan -1 x (note that tan y = x): 


' X -J„ TT ?~l (i ■-)d, 


tan x = 


= B-»" 


n =0 


r 2«+l 


2 n + 1 


(b) By comparing series expansions, show that 


— 1 1 
tan x — - In 
2 


— 1 < jc < 1. 


1 — ix 


1 + ix 


Hint. Compare Exercise 5.4.1. 

In numerical analysis it is often convenient to approximate d 2 ij/ (x)/dx 2 by 

d 2 1 r n 

^2 VK*) ~ + /?) _ 2i/f(x) + fix - h)\. 

Find the error in this approximation. 


ANS. Error = —f w (x). 
12 


You have a function y(x) tabulated at equally spaced values of the argument 

I y n = y(x n ) 

I x„ = x + nh. 

Show that the linear combination 


yields 


1 

— {-V 2 + 8yi - 8y_i + y_ 2 } 
12 h 


I /;4 (5) 

y o-30 y ° 


Hence this linear combination yields y' 0 if (7 z 4 /30) Vq 5) and higher powers of h and 
higher derivatives of y(x) are negligible. 
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5.6.23 In a numerical integration of a partial differential equation, the three-dimensional Lapla- 
cian is replaced by 

V 2 i/r(x, y, z) -> h~ 2 [i[r(x + h, y, z) + VK* — h, y, z) 

+ Tjf(x, y + h , z) + is(x, y — h,z) + y, z + h) 

+ i/(x, y, z — h) — 6 \/f(x, y, z)]. 

Determine the error in this approximation. Here h is the step size, the distance between 
adjacent points in the x-, y-, or ’-direction. 

5.6.24 Using double precision, calculate e from its Maclaurin series. 

Note. This simple, direct approach is the best way of calculating e to high accuracy. 
Sixteen terms give e to 16 significant figures. The reciprocal factorials give very rapid 
convergence. 

5.7 Power Series 

The power series is a special and extremely useful type of infinite series of the form 

OO 

f(x) = ao + a\x + aix 1 + ayx 3 + ■ ■ ■ = a n x n , (5.110) 

n =0 

where the coefficients a ; are constants, independent of v. 12 

Convergence 

Equation (5.110) may readily be tested for convergence by either the Cauchy root test or 
the d’Alembert ratio test (Section 5.2). If 

lim =R~\ (5.111) 

n^oo a n 

the series converges for —R < x < R. This is the interval or radius of convergence. Since 
the root and ratio tests fail when the limit is unity, the endpoints of the interval require 
special attention. 

For instance, if a n = n -1 , then R — 1 and, from Sections 5.1, 5.2, and 5.3, the series 
converges for x = — 1 but diverges for x = +1. If a„ = n\, then R — 0 and the series 
diverges for all v / 0. 

Uniform and Absolute Convergence 

Suppose our power series (Eq. (5.110)) has been found convergent for — R < x < R: then 
it will be uniformly and absolutely convergent in any interior interval, —S < x < .S', where 
0< S< R. 

This may be proved directly by the Weierstrass M test (Section 5.5). 

'^Equation (5.110) may be generalized to z = x + iy , replacing x. The following two chapters will then yield uniform conver¬ 
gence, integrability, and differentiability in a region of a complex plane in place of an interval on the x-axis. 
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Continuity 

Since each of the terms u„(x) = a n x n is a continuous function of x and fix.) = a n x n 
converges uniformly for — .S' < x < S, f (x ) must be a continuous function in the interval 
of uniform convergence. 

This behavior is to be contrasted with the strikingly different behavior of the Fourier se¬ 
ries (Chapter 14), in which the Fourier series is used frequently to represent discontinuous 
functions such as sawtooth and square waves. 

Differentiation and Integration 

With u n (x) continuous and a n x n uniformly convergent, we find that the differentiated 
series is a power series with continuous functions and the same radius of convergence as 
the original series. The new factors introduced by differentiation (or integration) do not 
affect either the root or the ratio test. Therefore our power series may be differentiated or 
integrated as often as desired within the interval of uniform convergence (Exercise 5.7.13). 

In view of the rather severe restrictions placed on differentiation (Section 5.5), this is 
a remarkable and valuable result. 

Uniqueness Theorem 

In the preceding section, using the Maclaurin series, we expanded e x and ln(l + x) into 
infinite series. In the succeeding chapters, functions are frequently represented or perhaps 
defined by infinite series. We now establish that the power-series representation is unique. 
If 

OO 

f(x) = ~ R a <X <R a 

n =0 
oo 

= £>*", -R h <x<R h , (5.112) 

n =0 

with overlapping intervals of convergence, including the origin, then 

a„ = b n (5.113) 

for all n; that is, we assume two (different) power-series representations and then proceed 
to show that the two are actually identical. 

From Eq. (5.112), 

OO OO 

^fl„x" = ^&„x”, —R<x<R, (5.114) 

n =0 n =0 

where R is the smaller of R a , R/,. By setting x = 0 to eliminate all but the constant terms, 
we obtain 


a 0 — b 0 . 


( 5 . 115 ) 
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Now, exploiting the differentiability of our power series, we differentiate Eq. (5.114), get¬ 
ting 


oo oo 

Y J ' ia n x n ~ { — Ynb n x n ~\ (5.116) 

n =1 n =1 

We again set x — 0, to isolate the new constant terms, and find 

ai = bu (5.117) 

By repeating this process n times, we get 

a„=b n , (5.118) 

which shows that the two series coincide. Therefore our power-series representation is 
unique. 

This will be a crucial point in Section 9.5, in which we use a power series to develop 
solutions of differential equations. This uniqueness of power series appears frequently in 
theoretical physics. The establishment of perturbation theory in quantum mechanics is one 
example. The power-series representation of functions is often useful in evaluating indeter¬ 
minate forms, particularly when THopital’s rule may be awkward to apply (Exercise 5.7.9). 


Example 5.7.1 l’Hopital’s rule 

Evaluate 


1 — cosx 


lim 

x —0 X z 


(5.119) 


Replacing cos x by its Maclaurin-series expansion, we obtain 

1 — COS X 1 — (1 — \x 2 + ^X 4 -) 1 X 2 

^2 - x 2 “ 2! ~ 4\ 


Letting x -* 0, we have 


1 — cos x 1 


lim 

r-s-0 X z 


(5.120) 


The uniqueness of power series means that the coefficients a n may be identified with the 
derivatives in a Maclaurin series. From 

1 


fix) = ^fl„x" = Y —f {n) i 0)*" 


72=0 


22=0 


we have 


a n = -f (n \ 0)- 

n\ 
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Inversion of Power Series 

Suppose we are given a series 


OO 

y - vo = u\ (x - xq) + «2 (x - xq ) 2 H-= a n (x - .to)". (5.121) 

n= 1 

This gives (y — vo) in terms of (x — vo). However, it may be desirable to have an explicit 
expression for (x — vo) in terms of (y — vo). We may solve Eq. (5.121) for x — xq by 
inversion of our series. Assume that 

OO 

V - XQ = y, b n (y - vo)", (5.122) 

n =1 

with the b„ to be determined in terms of the assumed known a n . A brute-force approach, 
which is perfectly adequate for the first few coefficients, is simply to substitute Eq. (5.121) 
into Eq. (5.122). By equating coefficients of (x — xo)" on both sides of Eq. (5.122), since 
the power series is unique, we obtain 

1 

Cl\ ' 

02 
fl l ' 

-^■(2a| — (5.123) 

Cl j 

— (5flia2fl3 — — 5 c(t), and so on. 

Some of the higher coefficients are listed by Dwight. 14 A more general and much more 
elegant approach is developed by the use of complex variables in the first and second 
editions of Mathematical Methods for Physicists. 


b\ = 
bi = 

b 3 = 

b4 = 


Exercises 


5.7.1 


The classical Langevin theory of paramagnetism leads to an expression for the magnetic 
polarization. 


P{x) — c 


coshx 
sinh x 



Expand P(x) as a power series for small x (low fields, high temperature). 


1 1 H. B. Dwight, Tables of Integrals and Other Mathematical Data , 4th ed. New York: Macmillan (1961). (Compare Formula 
No. 50.) 
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5.7.2 


5.7.3 


5.7.4 


5.7.5 


The depolarizing factor L for an oblate ellipsoid in a uniform electric field parallel to 
the axis of rotation is 

L = ~ (1 + foX 1 -?o cot - ' 1 f 0 )» 

£() 

where £o defines an oblate ellipsoid in oblate spheroidal coordinates (§, f, <p). Show that 


1 

lim L — - (sphere), 

fo^°o 3eo 


1 

lim L — — 

fo-S’O So 


(thin sheet). 


The depolarizing factor (Exercise 5.7.2) for a prolate ellipsoid is 

»?o+ 1 




'? o- 


1 


- 1 


Show that 

1 

lim L = - (sphere), lim L — 0 (long needle). 

ijo^oo 3g 0 m->o 

The analysis of the diffraction pattern of a circular opening involves 


p2n 

Jo ' 


cos(ccos <p) d(p. 
Expand the integrand in a series and integrate by using 


fhr (2nV C l7T 

cos 2 " <pd(p= l2 n( n ^ 2 • 2jr ’ J q c °s 2 ' !+1 <pd<p = 0. 

The result is 2:r times the Bessel function Jo(c). 

Neutrons are created (by a nuclear reaction) inside a hollow sphere of radius R. The 
newly created neutrons are uniformly distributed over the spherical volume. Assuming 
that all directions are equally probable (isotropy), what is the average distance a neutron 
will travel before striking the surface of the sphere? Assume straight-line motion and 
no collisions. 


(a) Show that 






k 2 sin - 6k~ dk sin 0 dO. 


(b) Expand the integrand as a series and integrate to obtain 
7=R' ' " 1 


!-3V- 

^ Or , - 


n = 1 


(2n-l)(2n + l)(2n + 3) 


(c) Show that the sum of this infinite series is 1/12, giving r — | R. 

Hint. Show that s„ — 1/12 — [4(2n + 1)(2« + 3)] _1 by mathematical induction. Then 
let n —*■ oo. 



368 


Chapter 5 Infinite Series 


5.7.6 


5.7.7 


Given that 


f 

Jo 


dx 

1 + x 2 


— tan 1 x 


n 

4’ 


expand the integrand into a series and integrate term by term obtaining 15 


7r 

4 


1111 

1-1-h- 

3 5 7 9 




1 


2n + 1 


which is Leibniz’s formula for jt. Compare the convergence of the integrand series and 
the integrated series at x = 1. See also Exercise 5.7.18. 


Expand the incomplete factorial function 


y(n + 1, x) = I e ’t n dt 
in a series of powers of .v. What is the range of convergence of the resulting series? 


/V, 

Jo 


ANS. / e~'t n dt=x n+l 
Jo 

(-i y x p 

p ! (n + p + 1) + 

5.7.8 Derive the series expansion of the incomplete beta function 


1 x x 

n + I n + 2 + 2! (n + 3) 


5.7.9 


B x (p,q)= /’V- 1 (l-f ) ,_1 

Jo 


dt 


= yP 


1 1 -q 


P P+ 1 

for 0 < x < 1, p > 0, and q > 0 fif x — 1). 
Evaluate 


(!-«)••• (n ~ q ) „ 

- x ■ 

n\(p + n ) 


(a) lim [sin(tanx) — tan(sinx)]x 


-7 


(b) lim x " j n (x), n — 3, 

x—>-0 


where j n (x) is a spherical Bessel function (Section 11.7), defined by 


jn(x) = (-l) n X n ( --f 

x dx 


sinx 

x 

1 


ANS. (a)-, (b)- 

30 ; 1 • 3 • 5 • • • (2n + 1) 


1 

105 


for n — 3. 


15 The series expansion of tan -1 x (upper limit 1 replaced by x) was discovered by James Gregory in 1671, 3 years before 
Leibniz. See Peter Beckmann’s entertaining book, A History of Pi, 2nd ed., Boulder, CO: Golem Press (1971) and L. Berggren, 
J. and P Borwein, Pi: A Source Book, New York: Springer (1997). 
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5.7.10 

5.7.11 

5.7.12 

5.7.13 

5.7.14 

5.7.15 

5.7.16 


Neutron transport theory gives the following expression for the inverse neutron diffusion 
length of k: 


a — b 
k 


tanh 1 



= 1 . 


By series inversion or otherwise, determine k 2 as a series of powers of b/a. Give the 
first two terms of the series. 

ANS. k 2 = 3a/?^l — 

Develop a series expansion of y — sinh -1 x (that is, sinh y — x ) in powers of x by 


(a) inversion of the series for sinh y, 

(b) a direct Maclaurin expansion. 


A function f(z) is represented by a descending power series 

OO 

f(z) — '^2,a n z~ n , R<z< oo. 

n= 0 

Show that this series expansion is unique; that is, if f(z) — J2T=o^iiZ~ n 
R < Z < o o, then a n — b n for all n. 


A power series converges for —R < x < R. Show that the differentiated series and 
the integrated series have the same interval of convergence. (Do not bother about the 
endpoints x — ±R.) 

Assuming that f(x ) may be expanded in a power series about the origin, f(x) — 
Y^Lo a nX n , with some nonzero range of convergence. Use the techniques employed 
in proving uniqueness of series to show that your assumed series is a Maclaurin series: 

a„ = -f (n \ 0). 
n\ 

The Klein-Nishina formula for the scattering of photons by electrons contains a term 
of the form 

2 + 2 s ln(l + 2s) 

1 + 2 s s 

Here s — hv/mc 2 , the ratio of the photon energy to the electron rest mass energy. Find 


/(£) = 


(1 +s) 


lim /(e). 

E-S-0 


ANS. f. 

The behavior of a neutron losing energy by colliding elastically with nuclei of mass A 
is described by a parameter f i, 


$1 = 1 + 


(A — l) 2 A-l 

-In-. 

2 A A + 1 
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5.7.17 


5.7.18 


5.7.19 


An approximation, good for large A, is 

?2 = 


A+ 2/3 


Expand + and + in powers of A . Show that £2 agrees with /) through (A ) z . Find 
the difference in the coefficients of the (A -1 ) 3 term. 

Show that each of these two integrals equals Catalan’s constant: 


(a) / arc tan t —, (b) — / ln.r- 

J 0 t J 0 1 + 

Note. See ft (2) in Section 5.9 for the value of Catalan’s constant. 

Calculate n (double precision) by each of the following arc tangent expressions: 

7 r = 16tan _1 (l/5) —4tan _1 (l/239) 

7T = 24 tan -1 (1/8) + 8 tan -1 (1/57) +4tan“ 1 (l/239) 

jr = 48 tan -1 (1/18) + 32 tan -1 (1/57) - 20tan _1 (l/239). 

Obtain 16 significant figures. Verify the formulas using Exercise 5.6.2. 

Note. These formulas have been used in some of the more accurate calculations of 7r. 16 


dt 

arc tan t —, (b) 

t 


-f 


dx 




An analysis of the Gibbs phenomenon of Section 14.5 leads to the expression 

2 r n sin£ 

n Jo I 


~dft. 


(a) Expand the integrand in a series and integrate term by term. Find the numerical 
value of this expression to four significant figures. 

(b) Evaluate this expression by the Gaussian quadrature if available. 


ANS. 1.178980. 


5.8 Elliptic Integrals 

Elliptic integrals are included here partly as an illustration of the use of power series and 
partly for their own intrinsic interest. This interest includes the occurrence of elliptic inte¬ 
grals in physical problems (Example 5.8.1 and Exercise 5.8.4) and applications in mathe¬ 
matical problems. 


Example 5.8.1 Period of a Simple Pendulum 

For small-amplitude oscillations, our pendulum (Fig. 5.8) has simple harmonic motion with 
a period T — 2n(l/g) 1 ^ 2 . For a maximum amplitude 6m large enough so that sin % / 
Newton’s second law of motion and Lagrange’s equation (Section 17.7) lead to a nonlinear 
differential equation (sin 6 is a nonlinear function of 6), so we turn to a different approach. 


*®D. Shanks and J. W. Wrench. Computation of n to 100000 decimals. Math. Comput. 16: 76 (1962). 
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Figure 5.8 Simple 
pendulum. 


The swinging mass m has a kinetic energy of ml 2 (dO/dt) 1 /2 and a potential energy of 
—mgl cos 6(6 — 7r/2 taken for the arbitrary zero of potential energy). Since dO /dt — 0 at 
9 — 9m, conservation of energy gives 



— mgl cos 9 — —mgl cos 9m- 


Solving for dO/dt we obtain 


dO 

dt 




1/2 

(COS0 — COS 0m) 1 / 2 . 


(5.124) 


(5.125) 


with the mass m canceling out. We take t to be zero when 9 — 0 and d9/dt > 0. An 
integration from 9 — 0 to 9 — 9m yields 



(cos 9 — cos 9m) 1//2 d9 = 



(5.126) 


This is ^ of a cycle, and therefore the time t is ^ of the period T. We note that 0 < 9m, 
and with a bit of clairvoyance we try the half-angle substitution 


sin 




(5.127) 


With this, Eq. (5.126) becomes 


T — 4 




(5.128) 


Although not an obvious improvement over Eq. (5.126), the integral now defines the com¬ 
plete elliptic integral of the first kind, K (sin 2 9m /2). From the series expansion, the period 
of our pendulum may be developed as a power series —powers of sin 9m /2: 


T = 2jt 



1/2 


1 + - sin 2 
4 


0m 

~2 



(5.129) 
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Definitions 


Generalizing Example 5.8.1 to include the upper limit as a variable, the elliptic integral of 
the first kind is defined as 


or 


p(p 

F((p\a)— / (l — sin 2 a sin 2 0) ^~dd, 

Jo 

F(x\m) = f [(1 — f 2 )(l — mf 2 )] 0<m<l. 

Jo 


(5.130a) 


(5.130b) 


(This is the notation of AMS-55 see footnote 4 for the reference.) For <p = n/2, x = 1, we 
have the complete elliptic integral of the first kind. 


K{m)= f (l — msin 2 #) ^ dO 

Jo 

= [\{l-t 2 )(l-mt 2 )]- 1/2 dt, 

Jo 


with m — sin 2 a, 0 < m < 1. 

The elliptic integral of the second kind is defined by 


or 


r<p 

E (■ (p\a ) — (1 — sin" a sin 

Jo 

f v / 1 — mt 2 \ 1/2 


e) '~de 


E(x\m ) = 


r 

Jo 


1 - 1 2 


dt, 


0 < m < 1. 


(5.131) 


(5.132a) 


(5.132b) 


Again, for the case <p — it/2, x — 1, we have the complete elliptic integral of the second 
kind: 


E(m) = 


= ( (1 — m sin 2 #) 1 / dO 

Jo 


-ffi 


Vl -mtW 2 


dt. 


0 < m < 1 . 


(5.133) 


Exercise 5.8.1 is an example of its occurrence. Figure 5.9 shows the behavior of K (in ) and 
E(m). Extensive tables are available in AMS-55 (see Exercise 5.2.22 for the reference). 


Series Expansion 


For our range 0 < m < 1, the denominator of K(m) may be expanded by the binomial 
series 


(i 


• 2M —1/2 , , 1 

■ m sin 6) — 1 + -in sin 


1 -|—m sin 6 + ■ 


OO 


= E 

n =0 


(2 n - 1)!! 
(2 «)!! 


/I n . 


(5.134) 
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0.5 m 1.0 

Figure 5.9 Complete elliptic integrals, 
K(m) and E(m). 


For any closed interval [0, w max ], >n mm < 1, this series is uniformly convergent and may 
be integrated term by term. From Exercise 8.4.9, 


Hence 


Similarly, 



6dG = 


(In - 1)!! 
(2/7)!! 


ix 

2 ' 


K(m) = ^ 



(In - 1)!! 
( 2 ;?)!! 



E(m) 


■ 

2 



( 2 n - l )!!] 2 
(277)!! 


m n } 
277 — 1 J 


(5.135) 


(5.136) 


(5.137) 


(Exercise 5.8.2). In Section 13.5 these series are identified as hypergeometric functions, 
and we have 
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Limiting Values 

From the series Eqs. (5.136) and (5.137), or from the defining integrals, 

lim K(m) — —, (5.140) 

m—> 0 2 

lim E (m) = —. (5.141) 

m—*0 2 

For m -> 1 the series expansions are of little use. However, the integrals yield 

lim K(in) — oo, (5.142) 

m —» 1 

the integral diverging logarithmically, and 

lim E(m) = 1. (5.143) 

m —1 

The elliptic integrals have been used extensively in the past for evaluating integrals. For 
instance, integrals of the form 

rx 

1 = / R(t, y/a^t 4 + t/3? 3 + «2 ?2 + a\t l + flo) dt, 

Jo 

where R is a rational function of t and of the radical, may be expressed in terms of elliptic 
integrals. Jahnke and Emde, Tables of Functions with Formulae and Cun’es. New York: 
Dover (1943), Chapter 5, give pages of such transformations. With computers available 
for direct numerical evaluation, interest in these elliptic integral techniques has declined. 
However, elliptic integrals still remain of interest because of their appearance in physical 
problems — see Exercises 5.8.4 and 5.8.5. 

For an extensive account of elliptic functions, integrals, and Jacobi theta functions, you 
are directed to Whittaker and Watson’s treatise A Course in Modern Analysis, 4th ed. Cam¬ 
bridge, UK: Cambridge University Press (1962). 


Exercises 

5.8.1 


5.8.2 


The ellipse .r 2 /a 2 + y 2 /b 2 = 1 may be represented parametrically by x = a sin 0. y ■ 
bcosO. Show that the length of arc within the first quadrant is 

'7T/2 


f [ (1 — m sin 2 dO — aE(m). 

Jo 


Here 0 <m — (a 2 — b 2 )/a 2 < 1. 
Derive the series expansion 


E{m) = ^ 


1 \ 9 m 


1-U -- 


1 • 3 \ ? m 2 
~7~A 


lim 


(K - E) jt 


m-* o m 


5.8.3 


Show that 
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5.8.4 


5.8.5 


A circular loop of wire in the .t v-plane, as shown in Fig. 5.10, carries a current I. Given 
that the vector potential is 

ci/iqI f n cos ada 

Ay (p , (f , z) ~z / ~ ^ " s | 9 a , i n ’ 

2jt Jo (a- + p A + z A — 2apcosa) l / z 

show that 


where 


p Q I (a 

A v {p,<p,z)=— 


k 2 = 


V ' 2 


(i - k ^) K {k 2 )-E{k 2 ) 


Aap 


(a + p) 2 + Z 2 ' 


Note. For extension of Exercise 5.8.4 to B, see Smythe, p. 270. 17 


An analysis of the magnetic vector potential of a circular current loop leads to the ex¬ 
pression 


f(k 2 ) = k~ 2 [(2 - k 2 )K(k 2 ) - 2 E(k 2 )], 


where K{k 2 ) and E(k 2 ) are the complete elliptic integrals of the first and second kinds. 
Show that for k 2 « 1 (r » radius of loop) 


f(k 2 ) « 


Ttk 2 

~ 16 ' 


l7 W. R. Smythe, Static and Dynamic Electricity, 3rd ed. New York: McGraw-Hill (1969). 
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5.8.6 Show that 


(a) 


dE(k 2 ) 

dk 


\(E-K ), 
k 


dK(k 2 ) _ E K 

dk ~ k{\ — k 2 ) ~ ~k' 


Elint. For part (b) show that 

E(k 2 ) = (l - k 2 ) [ ’ (1 -ksin 2 0)~ 3/2 d6 

Jo 

by comparing series expansions. 

5.8.7 (a) Write a function subroutine that will compute E(m) from the series expansion, 

Eq. (5.137). 

(b) Test your function subroutine by using it to calculate E(m) over the range 
m — 0.0(0.1)0.9 and comparing the result with the values given by AMS-55 (see 
Exercise 5.2.22 for the reference). 

5.8.8 Repeat Exercise 5.8.7 for K(m). 

Note. These series for E(m), Eq. (5.137), and K(m), Eq. (5.136), converge only very 
slowly for m near 1. More rapidly converging series for E(m) and K(in) exist. See 
Dwight’s Tables of Integrals: 18 No. 773.2 and 774.2. Your computer subroutine for 
computing E and K probably uses polynomial approximations: AMS-55, Chapter 17. 

5.8.9 A simple pendulum is swinging with a maximum amplitude of 9 m - In the limit as 
6m —> 0, the period is 1 s. Using the elliptic integral, K(k 2 ), k = sin(6?M/2), calculate 
the period T for 9m — 0 (10°) 90°. 

Caution. Some elliptic integral subroutines require k — m 1/2 as an input parameter, not 
m itself. 


5.8.10 


Check values. 


6m 

10 ° 

O 

O 

in 

O 

o 

T( sec) 

1.00193 

1.05033 

1.18258 


Calculate the magnetic vector potential A(p, <p, z) — tpA v {p. tp, z) of a circular current 
loop (Exercise 5.8.4) for the ranges p/a = 2, 3,4, and z/a = 0, 1,2,3, 4. 

Note. This elliptic integral calculation of the magnetic vector potential may be checked 
by an associated Legendre function calculation. Example 12.5.1. 


Check value. For p/a — 3 and z/a = 0; A v — 0.029023/xq I- 


5.9 Bernoulli Numbers, 

Euler-Maclaurin Formula 

The Bernoulli numbers were introduced by Jacques (James, Jacob) Bernoulli. There are 
several equivalent definitions, but extreme care must be taken, for some authors introduce 

1 x H. B. Dwight, Tables of Integrals and Other Mathematical Data. New York: Macmillan (1947). 
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variations in numbering or in algebraic signs. One relatively simple approach is to define 
the Bernoulli numbers by the series 19 



E 


n =0 


B n X n 

n\ 


(5.144) 


which converges for |x| < 2 tt by the ratio test substitut Eq. (5.153) (see also Exam¬ 
ple 7.1.7). By differentiating this power series repeatedly and then setting x = 0, we obtain 


Specifically, 


B n = 


' d" 
dx n 


x 


- 1 


.Y=0 


B i 


d 

dx 


/ X \ 

1 

xe x 

\e x -\) 

X 

II 

O 

1 

5-! 

1 

<N_^ 

1 

* 


1 

2 ’ 


(5.145) 


(5.146) 


as may be seen by series expansion of the denominators. Using Bq = 1 and B\ = — j, it is 
easy to verify that the function 



n=2 



(5.147) 


is even in x, so all Bi„+\ — 0. 

To derive a recursion relation for the Bernoulli numbers, we multiply 


e x — 1 x 
x e x — 1 


E 

m =0 
oo 

h-E- 

m =1 
oo 


(m+ 1)! 




I” 9 + E fi2 " 


1 


n= 1 


i 


(2 «)! 


E xiV E 

N=2 l<n<N/2 


(m + 1)! 2m! 

B2n 


(2n)\(N — 2n + 1)! 


(5.148) 


For N > 0 the coefficient of x N is zero, so Eq. (5.148) yields 


1 

2 


(TV + 1) — 1 = 


E Bin 

l<n<N/2 


N+l 

2n 


\(N-D, 


(5.149) 


^The function x/{e x — 1) may be considered a generating function since it generates the Bernoulli numbers. Generating 
functions of the special functions of mathematical physics appear in Chapters 11, 12, and 13. 
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Table 5.1 Bernoulli Numbers 


n 

Bn 

Bn 

0 

1 

1.000000000 

1 

1 

2 

-0.500000000 

2 

1 

6 

0.166666667 

4 

1 

30 

-0.033333333 

6 

1 

42 

0.023809524 

8 

1 

30 

-0.033333333 

10 

5 

66 

0.0757 57576 


Note. Further values are given in National Bureau of Stan¬ 
dards, Handbook of Mathematical Functions (AMS-55). 
See footnote 4 for the reference. 


which is equivalent to 



N 

r. 

n =1 




N -1 

n- i = y B ln 

n= 1 



(5.150) 


From Eq. (5.150) the Bernoulli numbers in Table 5.1 are readily obtained. If the variable x 
in Eq. (5.144) is replaced by 2 ix we obtain an alternate (and equivalent) definition of Ih„ 
(B i is set equal to — ^ by Eq. (5.146)) by the expression 


°° (2x) 2 " 

JfCOtX = y^(— 1)"B2„ -, — 7T < X < 7T . (5.151) 

_ n (2 n)\ 


Using the method of residues (Section 7.1) or working from the infinite product represen¬ 
tation of sinx (Section 5.11), we find that 


(— l)"- 1 2(2n)! 


Bln — 


an) 


2 n 


Up 

p= i 


—2 n 


n = 1,2,3, 


(5.152) 


This representation of the Bernoulli numbers was discovered by Euler. It is readily seen 
from Eq. (5.152) that \ Bi n \ increases without limit as n —> oo. Numerical values have been 
calculated by Glaisher. 20 Illustrating the divergent behavior of the Bernoulli numbers, we 
have 


Bio = -5.291 x 10 2 
fi 2 oo = -3.647 x 10 215 . 


20 J. W. L. Glaisher, table of the first 250 Bernoulli’s numbers (to nine figures) and their logarithms (to ten figures). Trans. 
Cambridge Philos. Soc. 12: 390 (1871-1879). 
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Some authors prefer to define the Bernoulli numbers with a modified version of Eq. (5.152) 
by using 


B n = 


2(2 n)\ y, _ 2 „ 

(27 x) 2n ^ P 

p= 1 


(5.153) 


the subscript being just half of our subscript and all signs positive. Again, when using other 
texts or references, you must check to see exactly how the Bernoulli numbers are defined. 

The Bernoulli numbers occur frequently in number theory. The von Staudt-Clausen the¬ 
orem states that 

111 1 

B 2n = A n -, (5.154) 

Pi P2 P3 Pk 

in which A n is an integer and p \, p 2 . Pk are prime numbers so that pi — 1 is a divisor 

of 2 n. It may readily be verified that this holds for 


fi 6 (A 3 = l, p = 2,3,7), 

fi 8 (A 4 = l, p = 2,3,5), (5.155) 

£io(A 5 = 1, p = 2,3,\ 1), 


and other special cases. 

The Bernoulli numbers appear in the summation of integral powers of the integers, 


N 

j p , p integral, 
7=1 


and in numerous series expansions of the transcendental functions, including tan x, cotx, 
In | sinx|, (sinx) -1 , In | cosx|, In | tan.r|, (cosh.r)" 1 , tanhx, and cothTc. For example. 


(— 1 )"- 1 2 2 "( 2 2 " 


tanv = + — + —x + • • 


(2n)! 


1)B2 " x 2»-' + . 


(5.156) 


The Bernoulli numbers are likely to come in such series expansions because of the defining 
equations (5.144), (5.150), and (5.151) and because of their relation to the Riemann zeta 
function, 

OO 

C(2 n) = J2p~ 2n - (5.157) 

p =i 


Bernoulli Polynomials 


If Eq. (5.144) is generalized slightly, we have 



(5.158) 
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Table 5.2 Bernoulli Polynomials 


*o = l 

B[ =x - j 
*2 = x 2 - x + g 
*3 = x 3 - \x 2 + jX 

B4 = X 4 — 2X 2 ^ X 2 — Jg 

*5 = x 5 - |x 4 + I* 3 - g.v 
B 6 = x 6 - 3x 5 + |x 4 — |x 2 + 42 

B n (0) = , Bernoulli number 


defining the Bernoulli polynomials, B n (s). The first seven Bernoulli polynomials are 
given in Table 5.2. 

From the generating function, Eq. (5.158), 

B„(0) = B„, n = 0,1,2,..., (5.159) 

the Bernoulli polynomial evaluated at zero equals the corresponding Bernoulli number. 
Two particularly important properties of the Bernoulli polynomials follow from the defin¬ 
ing relation, Eq, (5.158): a differentiation relation 

d 

— B n {s) — nB n -\(s), n — 1,2,3,..., (5.160) 

ds 

and a symmetry relation (replace x —> — x in Eq. (5.158) and then set 5 = 1) 

B„(1) = (-1)"B„(0), n = 1,2,3,.... (5.161) 

These relations are used in the development of the Euler-Maclaurin integration formula. 


Euler-Maclaurin Integration 
Formula 


One use of the Bernoulli functions is in the derivation of the Euler-Maclaurin integration 
formula. This formula is used in Section 8.3 for the development of an asymptotic expres¬ 
sion for the factorial function — Stirling’s series. 

The technique is repeated integration by parts, using Eq. (5.160) to create new deriva¬ 
tives. We start with 



f (x)Bq(x) dx. 


From Eq. (5.160) and Exercise 5.9.2, 


(5.162) 


B[ (x) — Bq(x) = 1 . 


(5.163) 
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Substituting B\ (x) into Eq. (5.162) and integrating by parts, we obtain 


f 


f(x)dx = f (1)2?! (1) — f(0)B[ (0) 


-fr 

[f (1) + /(0)] — [' f(x)B 1 (x)dx. 
Jo 


(x)B\ (x) dx 


Again using Eq. (5.160), we have 


and integrating by parts we get 
• 1 


B i(x) = -B' 2 (x), 


(5.164) 


(5.165) 


f f Wdx = l -[f{ 1) + /(0)] - ^[/'(l)fi 2 (l) - /'(0)fl 2 (0)] 
1 f 1 

+ — / f (2 \x)B 2 (x)dx. 

3! Jo 


Using the relations 


B 2 „(l) — B 2n ( 0) = Ih n . 


fi 2 »+i(l) = fi 2 »+ 1 (0) = 0, 
and continuing this process, we have 
• l 


n — 0, 1,2,.. 
n = 1,2,3,.. 


(5.166) 


(5.167) 


J o f(x)dx= 1 -[f(l) + f(0)]-J2^B 2p [fCP- 1 \l)-fCP- l \0)] 


+ — f 1 f (2q H- 

(2q)\Jo 


x)B 2 q (x)dx. 


(5.168a) 


This is the Euler-Maclaurin integration formula. It assumes that the function f(x) has the 
required derivatives. 

The range of integration in Eq. (5.168a) may be shifted from [0, 1] to [1,2] by replacing 
fix) by fix + 1). Adding such results up to [n — 1, n], we obtain 


f 


fix)dx = i/(0) + /(1) + / (2) + ■ ■ ■ + fin - 1) + l fin) 


^(^)!^ [/(2P ' 1)(n)_/(2P ' 1)(0)] 


1 f 1 " _1 

+ — / S 2 9 (x) V f (2q) ix + v)dx. (5.168b) 

W Jo 

The terms ^/(0) + /(l) + • • • + J fin) appear exactly as in trapezoidal integration, or 
quadrature. The summation over p may be interpreted as a correction to the trapezoidal 
approximation. Equation (5.168b) may be seen as a generalization of Eq. (5.22); it is the 
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Table 5.3 Riemann Zeta Function 


s 

?C0 

2 

1.6449340668 

3 

1.2020569032 

4 

1.0823232337 

5 

1.0369277551 

6 

1.0173430620 

7 

1.0083492774 

8 

1.0040773562 

9 

1.0020083928 

10 

1.0009945751 


form used in Exercise 5.9.5 for summing positive powers of integers and in Section 8.3 for 
the derivation of Stirling’s formula. 

The Euler-Maclaurin formula is often useful in summing series by converting them to 
integrals. 21 


Riemann Zeta Function 


This series, p~ 2n , was used as a comparison series for testing convergence (Sec¬ 

tion 5.2) and in Eq. (5.152) as one definition of the Bernoulli numbers, Ih„. It also serves 
to define the Riemann zeta function by 


III 

S > l. 

n= 1 



(5.169) 


Table 5.3 lists the values of £(s) for integral s, s = 2, 3,..., 10. Closed forms for even s 
appear in Exercise 5.9.6. Figure 5.11 is a plot of f (s) — 1. An integral expression for this 
Riemann zeta function appears in Exercise 8.2.21 as part of the development of the gamma 
function, and the functional relation is given in Section 14.3. 

The celebrated Euler prime number product for the Riemann zeta function may be de¬ 
rived as 


?W(l-2- s ) = l + ^ + 


1 

3 * 



eliminating all the n s , where n is a multiple of 2. Then 


f( S )(l-2-)(l-3-*) = l + i + i + i 




(5.170) 


(5.171) 


21 


See R. R Boas and C. Stutz, Estimating sums with integrals. Am. J. Phys. 39: 745 (1971), for a number of examples. 
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Figure 5.11 Riemann zeta function, £ (s ) — 1 
versus s. 


eliminating all the remaining terms in which n is a multiple of 3. Continuing, we have 
£0)(1 — 2~ s )(l — 3 _i )(l — 5 _J ) •••(! — P ~ s ), where P is a prime number, and all terms 
n ~ s , in which n is a multiple of any integer up through P, are canceled out. As P —»• oo, 

oo 

?w(l - 2“ s )(l - 3 _i ) • • • (1 - P~ s ) -* S(s) [~[ (1-P~ s ) = l. (5.172) 

P (prime)=2 


Therefore 


OO 

n o-o" 1 . 

P (prime)=2 


(5.173) 


giving t;(s) as an infinite product. 22 

This cancellation procedure has a clear application in numerical computation. Equa¬ 
tion (5.170) will give £(,s)(l — 2 -s ) to the same accuracy as Eq. (5.169) gives £( s ), but 


--This is the starting point for the extensive applications of the Riemann zeta function to analytic number theory. See H. M. Ed¬ 
wards, Riemann’s Zeta Function. New York: Academic Press (1974); A. Ivic, The Riemann Zeta Function. New York: Wiley 
(1985); S. J. Patterson, Introduction to the Theory of the Riemann Zeta Function. Cambridge, UK: Cambridge University Press 
(1988). 
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with only half as many terms. (In either case, a correction would be made for the neglected 
tail of the series by the Maclaurin integral test technique—replacing the series by an inte¬ 
gral, Section 5.2.) 

Along with the Riemann zeta function, AMS-55 (Chapter 23. See Exercise 5.2.22 for 
the reference.) defines three other Dirichlet series related to f (s): 

OO 

40) = D-D"- 1 "-* = (1 - 2 1 -*)C(s), 

n =1 
oo 

Ms) = ^](2n + l)-* = (l-2-*)f(*), 

n =0 

and 


0(s) = £(-l)" (2/1+1)"*. 

n =0 


From the Bernoulli numbers (Exercise 5.9.6) or Fourier series (Example 14.3.3 and Exer¬ 
cise 14.3.13) special values are 


?(2) = 

1 


1 


1 


TT 2 

+ 

22 

+ 

32 

+ •• 

'~~6 

f(4) = 

1 


1 


1 


n 4 

+ 

¥ 

+ 

34 

+ •• 

~ 90 




l 


1 


it 2 

4(2) = 

1 


22 

+ 

32 

+ •• 

n 




1 


1 


in 4 

4(4) = 

1 


¥ 

+ 

34 

+ •• 

720 

M2) = 

1 


1 


1 


it 2 

+ 

32 

+ 

52 

+ •• 

T 

a (4) = 

1 


1 


1 


7T 4 

+ 

34 

+ 

54 


_ 96 




1 

1 


7 r 

>8(1) = 

1 


3 " 


5 


“ 4 




1 


1 


_ 7T 3 

>8(3) = 

1 

— 

33 

+ 

53 

— . . 

32' 


Catalan’s constant. 


1 1 


_1_ 32 + 52 

•• = 0.91596559 


is the topic of Exercise 5.2.22. 
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Improvement of Convergence 

If we are required to sum a convergent series a„ whose terms are rational functions 

of n, the convergence may be improved dramatically by introducing the Riemann zeta 
function. 


Example 5.9.1 Improvement OF Convergence 

The problem is to evaluate the series YlnLi 1/(1 + « 2 )- Expanding (1 + n 2 ) -1 = 
n _2 (l + « -2 ) -1 by direct division, we have 

(1 + n 2 )- 1 = n~ 2 (l - n~ 2 + n~ 4 - j 

1 1 1 1 

n 2 n 4 n 6 n 8 +n 6 

Therefore 

OO J OO 1 

E f (2) - f (4) + ?(6) - E 

L —' 1 + n 1 L — n° + n° 

n =1 n =1 

The ( values are tabulated and the remainder series converges as u -8 . Clearly, the process 
can be continued as desired. You make a choice between how much algebra you will do and 
how much arithmetic the computer will do. Other methods for improving computational 
effectiveness are given at the end of Sections 5.2 and 5.4. ■ 


Exercises 


5.9.1 


5.9.2 


Show that 


OO 

tan* = ^ 

n= 1 


(—1)" _1 2 2 "(2 2 " — 1)Z?2» 

(2 n)\ 


x 2n-l 


Hint, tanx = cotx — 2cot 2x. 

Show that the first Bernoulli polynomials are 


Bois) = 1 
B\(s) = s - \ 

B 2 (s) - s 2 - s + g. 


Tt :x 

< x < —. 
2 2 


5.9.3 


Note that B n (0) = B n , the Bernoulli number. 

Show that B' n (s) — «5 D _i(s), n = 1,2, 3,_ 

Hint. Differentiate Eq. (5.158). 
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5.9.4 


5.9.5 


Show that 

B b (1) = (-1)"5„(0). 

Hint. Go back to the generating function, Eq. (5.158), or Exercise 5.9.2. 

The Euler-Maclaurin integration formula may be used for the evaluation of finite series: 

jz f(m) = f" f(x)dx + l -f(l ) + + ^lf'(n) ~ /'(D] + • • • . 

Show that 

A 1 

(a) 2_ m — —n(w + 1). 
m=l 

" 1 

(b) /7i 2 = -n(n + l)(2n + 1). 

wi=t 

(c) ZZ m3 = + l) 2 . 

777 = 1 

" 1 

(d) ZZ 17,4 — 3o”^ + 1)(3« 2 + 37z — l). 

771 = 1 
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5.9.8 


5.9.9 


Prove that 



x n e x dx 
( e x — l ) 2 


n!f (n). 


Assuming n to be real, show that each side of the equation diverges if n = 1. Hence 
the preceding equation carries the condition n > 1. Integrals such as this appear in the 
quantum theory of transport effects — thermal and electrical conductivity. 


The Bloch-Gruneissen approximation for the resistance in a monovalent metal is 

T 5 r @ / T x 5 dx 
P ~ C &Jo (e* - 1)(1 - e~*)' 
where 0 is the Debye temperature characteristic of the metal. 


(a) For T —>■ oo, show that 


(b) For T -* 0, show that 


P 


C T 
4 ' 02 ' 


P^5!?(5)C 


T 5 

© 6 - 


5.9.10 


5.9.11 


Show that 

r l \n(l+x) 1 

(a) / —- -dx = -U 2), 

Jo x z 


(b) lim f 
a-* 1 Jo 


ln(l — x) 

X 


dx = £(2). 


From Exercise 5.9.6, C, (2) — tt 2 /6. Note that the integrand in part (b) diverges for <7 = 1 
but that the integrated series is convergent. 


The integral 

f 1 r -,2 dx 

/ N 1 -^)] - 

Jo x 

appears in the fourth-order correction to the magnetic moment of the electron. Show 
that it equals 2£(3). 

Hint. Let 1 — x — e~ l . 


5.9.12 


5.9.13 


Show that 


L 


00 (In z) 2 /111 

* = 41 -. + . — 


1 + z 1 


3 3 5 3 7 3 


By contour integration (Exercise 7.1.17), this may be shown equal to 7r 3 /8. 


For “small” values of x. 


OO 

ln(jc!) = -y* + ^(-l)" 

n —2 




where y is the Euler-Mascheroni constant and ((n) is the Riemann zeta function. For 
what values of x does this series converge? 


ANS. -1 <* < 1. 
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Note that if .v = 1, we obtain 


n=2 


Un) 

•> 

n 


a series for the Euler-Mascheroni constant. The convergence of this series is exceed¬ 
ingly slow. For actual computation of y, other, indirect approaches are far superior (see 
Exercises 5.10.11, and 8.5.16). 

5.9.14 Show that the series expansion of ln(x!) (Exercise 5.9.13) may be written as 


(a) 

(b) 


1 / JTX 

I lift!) = — ln( - 

2 V sin jtx 


1 ( JTX 

ln(.r!) = - In -- 

2 \ sin ixx 


yx- + 


n= 1 


2 n + 1 


1 / l+x\ 


oo 

- £[f(2n+1) - l] 

/i=i 


x 2n+\ 

2 n + 1 


Determine the range of convergence of each of these expressions. 

5.9.15 Show that Catalan’s constant, /i(2), may be written as 

oo 2 

/l(2) = 2^(4£-3r 2 -^. 

k=l 


Hint, jt 2 — 6^(2). 

5.9.16 Derive the following expansions of the Debye functions for n > 1: 




1 

n 


x 

2 {n + 1) 


+ E 


k= 1 


B 2k x 2k 
(2k + n)(2k)\ 


t n dt 
e'-l 


E‘~ L ' 

k= 1 



nx n ~ l 

it 2 


n (n - l)x n ~ 2 

P 


\x\ < 2 jx\ 
n\ 

^n+1 


for x > 0. The complete integral (0, oo) equals n!f (n + 1), Exercise 8.2.15. 

5.9.17 (a) Show that the equation ln2 = ^“ 1 (—l)' s+1 5 _1 (Exercise 5.4.1) may be rewritten 

as 

OO OO 

ln2 = £2-'f(s) + £(2 P r n ~ l 

s=2 p= 1 

Hint. Take the terms in pairs. 

(b) Calculate In 2 to six significant figures. 
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5.9.18 


5.9.19 


5.9.20 


(a) Show that the equation 7 t/ 4 = l)" +1 (2n — 1) 1 (Exercise 5.7.6) may be 

rewritten as 


- = 1 - 2 ^ 4 “ 2 ^( 2 s ) - 2 ^( 4 / t )“ 2 "“ 2 1 

5=1 p= 1 



(b) Calculate 7r/4 to six significant figures. 


Write a function subprogram ZETA( N ) that will calculate the Riemann zeta function 
for integer argument. Tabulate f (,?) for s = 2, 3,4,..., 20. Check your values against 
Table 5.3 and AMS-55, Chapter 23. (See Exercise 5.2.22 for the reference.). 

Hint. If you supply the function subprogram with the known values of £(2), f (3), and 
C(4). you avoid the more slowly converging series. Calculation time may be further 
shortened by using Eq. (5.170). 


Calculate the logarithm (base 10) of |Z? 2 nI ,n = 10, 20,..., 100. 
Hint. Program £(n) as a function subprogram. Exercise 5.9.19. 


Check values, log |Z?iooI = 78.45 
log |Z? 20 ol = 215.56. 


5.10 Asymptotic Series 

Asymptotic series frequently occur in physics. In numerical computations they are em¬ 
ployed for the accurate computation of a variety of functions. We consider here two types 
of integrals that lead to asymptotic series: first, an integral of the form 

/ OO 

e~ u f(u)du, 

where the variable x appears as the lower limit of an integral. Second, we consider the 
form 

h(x) = J e ~ u \ du, 

with the function / to be expanded as a Taylor series (binomial series). Asymptotic se¬ 
ries often occur as solutions of differential equations. An example of this appears in Sec¬ 
tion 11.6 as a solution of Bessel’s equation. 

Incomplete Gamma Function 

The nature of an asymptotic series is perhaps best illustrated by a specific example. Sup¬ 
pose that we have the exponential integral function 23 

f x e“ 

Ei (x) = / — du, (5.174) 

J — OO ^ 


23 This function occurs frequently in astrophysical problems involving gas with a Maxwell-Boltzmann energy distribution. 
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-Ei(— x) = I - du = E\{x), 

Jr u 


(5.175) 


to be evaluated for large values of x. Or let us take a generalization of the incomplete 
factorial function (incomplete gamma function), 4 


fOO 

I(x,p)= I e~ u u~ p du = T(1 — p, x), 
JX 


(5.176) 


in which x and p are positive. Again, we seek to evaluate it for large values of .r. 
Integrating by parts, we obtain 


/* C _ 

I{x, p) — - pi e~ u u~ p ~ x du 

X p Jx 


e~ x ve~ x 

= 1F~^T + P(P + Vj x e-“u- p -*du. 


(5.177) 


Continuing to integrate by parts, we develop the series 


,, , -x( _ P , P(P+V 

' P 6 1 X P xP+ l X P+ 2 


■ + (-l) 1 


,-l (P + n —2)\ 
(p- 1 )\xP +n ~ l 


+ c-l )"^±^—— f°° e~ u u-P- n du. 

(P-D! Jx 


(5.178) 


This is a remarkable series. Checking the convergence by the d’Alembert ratio test, we 
find 


,. \Un+i\ ( p + n)\ 1 p + n 

lim -= lim -• — = lim -= oo 


(5.179) 


n-*o o \u n \ n-Hx (p + n — 1)! X n-xx X 

for all finite values of x. Therefore our series as an infinite series diverges everywhere! 
Before discarding Eq. (5.178) as worthless, let us see how well a given partial sum approx¬ 
imates the incomplete factorial function, / (x .p): 

7(x, p) - s f i(x , p) = (-1)” +1 \ P + f e~ u u~ p ~ n ~ 1 du = R n (x, p). (5.180) 

(p-W-Jx 


In absolute value 


1 1 (x, p) - s„ (x, p)\ < \ p + rl) ' [ e "u P " 1 du. 

(p-W-Jx 


When we substitute u — v + x, the integral becomes 


/ oo /»oo 

e- u u-P-n- l du = e- x J e~ v {v + x)- p - n - x dv 

e~ x r°° / v \ ~P~ n ~^ 

= ^/o e ~\ l+ d dv • 


See also Section 8.5. 
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Figure 5.12 Partial sums of e* E\(x)\ x =s- 


For large x the final integral approaches 1 and 


(5.181) 

This means that if we take x large enough, our partial sum s n is an arbitrarily good approx¬ 
imation to the function I(x, p). Our divergent series (Eq. (5.178)) therefore is perfectly 
good for computations of partial sums. For this reason it is sometimes called a semicon- 
vergent series. Note that the power of .r in the denominator of the remainder (p + n + 1) 
is higher than the power of x in the last term included in s n (x, p). (p + n). 

Since the remainder R„(x , p) alternates in sign, the successive partial sums give alter¬ 
nately upper and lower bounds for I (x, p). The behavior of the series (with p — 1) as a 
function of the number of terms included is shown in Fig. 5.12. We have 


-*■/ 


e x E\(x) = e x I - du 


_ 1 1! 2! 3! „ n\ 

= s„(jr)----2 + -2--4+-- + (-1) — J. 

A A A A A 


(5.182) 


which is evaluated at x = 5. The optimum determination of e x E\ (x) is given by the closest 
approach of the upper and lower bounds, that is, between = S(> — 0.1664 and .vj = 0.1741 
for v = 5. Therefore 


0.1664 <e x E l (x)\ x=5 <0.1741. 


(5.183) 


Actually, from tables. 


e x E \{ x )\ x _ 5 = 0 . 1704 , 


( 5 . 184 ) 
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within the limits established by our asymptotic expansion. Note that inclusion of additional 
terms in the series expansion beyond the optimum point literally reduces the accuracy of 
the representation. As .t is increased, the spread between the lowest upper bound and the 
highest lower bound will diminish. By taking .t large enough, one may compute e x E\(x) 
to any desired degree of accuracy. Other properties of E\(x) are derived and discussed in 
Section 8.5. 


Cosine and Sine Integrals 


Asymptotic series may also be developed from definite integrals — if the integrand has the 
required behavior. As an example, the cosine and sine integrals (Section 8.5) are defined 
by 


Ci(x) = 


-l 


00 cost 


t 


-dt, 


(5.185) 


f°° sinf 

si(x) = — / - dt. 

J x 


Combining these with regular trigonometric functions, we may define 


/•OO 

f (x) = Ci(x) sinx — si(x) cos x = / 

Jo 

g(x ) = —Ci(x) cos x — si(x) sinx = / 

Jo 


siny 

y+x 

*° cosy 
y + x 


dy, 

dy, 


(5.186) 


(5.187) 


with the new variable y = t — x. Going to complex variables. Section 6.1, we have 


e ly 

g(x) + if (x) = / —-—dy = 

Jo y + x 


r°° ie~ xu 

Jo 1 + i 


-du, 


(5.188) 


in which u = — iy/x. The limits of integration, 0 to oo, rather than 0 to —too, may be 
justified by Cauchy’s theorem. Section 6.3. Rationalizing the denominator and equating 
real part to real part and imaginary part to imaginary part, we obtain 


g(x) 


-f 


jdu, f(x) 


1 + u 2 ~" ’ J Jq 1 +u 




-du. 


(5.189) 


For convergence of the integrals we must require that IH(x) > 0. 


25 


25 


9t(;t) = real part of (complex) x (compare Section 6.1). 
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j r°o 

fix ) ~ - 

* Jo 


r°° it 2 " i 

L < - i »" 


Now, to develop the asymptotic expansions, let i > — xu and expand the preceding factor 
[1 + (u/x) 2 ] -1 by the binomial theorem. 26 We have 

In _ 

I » * I /.H. I ! 

(5.190) 

0 <n<N " " 0 <n<N 

1 roo .2n+1 i 

E <-')■— *»=- 2 Y. <-»" 

0 0<n<N 0 <n<N 

From Eqs. (5.187) and (5.190), 

sinx . . n (2n)\ cosx 


(2n + 1)! 


r 2 n 


Ci(x) : 


si(x) 


E <-»" 


E <-»' 


(2w + 1)! 


r 2n 


0<«<A^ 
cosx 


E (-i> 


0<n<N 

n (2 n)\ sinx 


E (-D 


„ (2 n + 1)! 


(5.191) 


r 2 n 


0 <n<N 


0 <n<N 


are the desired asymptotic expansions. 

This technique of expanding the integrand of a definite integral and integrating term 
by term is applied in Section 11.6 to develop an asymptotic expansion of the modified 
Bessel function K v and in Section 13.5 for expansions of the two confluent hypergeometric 
functions M{a, c ; x) and U(a, c; x). 


Definition of Asymptotic Series 

The behavior of these series (Eqs. (5.178) and (5.191)), is consistent with the defining 
properties of an asymptotic series. 27 Following Poincare, we take 28 

x n R n (x) = x n [f(x) - s n (x)], (5.192) 

where 

Cl] Cl2 Cln 

s n (x) = ao —- d—|-l-1—^. (5.193) 

X X L X 

The asymptotic expansion of /(x) has the properties that 

lim x"R n (x) = 0, for fixed n, (5.194) 

X—>oo 

and 

lim x n R n (x) = oo, for fixed a . 29 (5.195) 


2 ^This step is valid for v < x. The contributions from v > x will be negligible (for large x) because of the negative exponential. 
It is because the binomial expansion does not converge for v > x that our final series is asymptotic rather than convergent. 

27 It is not necessary that the asymptotic series be a power series. The required property is that the remainder R n (x) be of higher 
order than the last term kept — as in Eq. (5.194). 

28 Poincare’s definition allows (or neglects) exponentially decreasing functions. The refinement of Poincare’s definition is of 
considerable importance for the advanced theory of asymptotic expansions, particularly for extensions into the complex plane. 
However, for purposes of an introductory treatment and especially for numerical computation with x real and positive, Poincare’s 
approach is perfectly satisfactory. 
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See Eqs. (5.178) and (5.179) for an example of these properties. For power series, as as¬ 
sumed in the form of s n (x), R n (x) ~ x~ n ~ l . With conditions (5.194) and (5.195) satisfied, 
we write 

oo 

f(x)^'Y^,a n x~ n . (5.196) 

n =0 

Note the use of ~ in place of =. The function fix) is equal to the series only in the limit 
as x -* oo and a finite number of terms in the series. 

Asymptotic expansions of two functions may be multiplied together, and the result will 
be an asymptotic expansion of the product of the two functions. 

The asymptotic expansion of a given function f(t) may be integrated term by term (just 
as in a uniformly convergent series of continuous functions) from x < t < oo, and the result 
will be an asymptotic expansion of f _ f(t)dt. Term-by-term differentiation, however, is 
valid only under very special conditions. 

Some functions do not possess an asymptotic expansion; e x is an example of such a 
function. However, if a function has an asymptotic expansion, it has only one. The corre¬ 
spondence is not one to one; many functions may have the same asymptotic expansion. 

One of the most useful and powerful methods of generating asymptotic expansions, the 
method of steepest descents, will be developed in Section 7.3. Applications include the 
derivation of Stirling’s formula for the (complete) factorial function (Section 8.3) and the 
asymptotic forms of the various Bessel functions (Section 11.6). Asymptotic series occur 
fairly often in mathematical physics. One of the earliest and still important approximations 
of quantum mechanics, the WKB expansion, is an asymptotic series. 


Exercises 


5.10.1 Stirling’s formula for the logarithm of the factorial function is 

!„(,!) = i ln2„ + (* + 1) In* - * - £ 

n= 1 

The are the Bernoulli numbers (Section 5.9). Show that Stirling’s formula is an 
asymptotic expansion. 

5.10.2 Integrating by parts, develop asymptotic expansions of the Fresnel integrals. 


(a) C(x) = 


=/ 


7TU 

cos- du , 


(b)j(x) = 


-f- 


7XU 

sin- du. 

2 


These integrals appear in the analysis of a knife-edge diffraction pattern. 

5.10.3 Rederive the asymptotic expansions of Ci(x) and si(x) by repeated integration by parts. 
Hint. Ci(x) + i si(x) = — ^-dt. 


29 


This excludes convergent series of inverse powers of x. Some writers feel that this exclusion is artificial and unnecessary. 
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5.10.4 Derive the asymptotic expansion of the Gauss error function 
2 f x _ 2 

erf(x) = —= / e ‘ dt 
Jo 

*Jnx \ 2.r 2 2 2 x 4 2 3 x 6 2 n x ln ) 

Hint : erf(.t) = 1 — erfc(x) = 1-f= f°° e _r c/r. 

y7T 

Normalized so that erf(oo) = 1, this function plays an important role in probability 
theory. It may be expressed in terms of the Fresnel integrals (Exercise 5.10.2), the in¬ 
complete gamma functions (Section 8.5), and the confluent hypergeometric functions 
(Section 13.5). 


5.10.5 


The asymptotic expressions for the various Bessel functions. Section 11.6, contain the 
series 


^(z)~l + £(-l) 

n =1 

(X) 

0,(z)~£(-l)" +1 

n =1 


> , n 2 l 1 [4n 2 -(2,-l) 2 ] 

(2n)!(8z) 2 " 

(2 n - l)!(8z) 2 " -1 


5.10.6 


5.10.7 


Show that these two series are indeed asymptotic series. 
For x > 1, 


1 

1 +x 


£(-d' 


n =0 


i 


X n+l ■ 


Test this series to see if it is an asymptotic series. 

Derive the following Bernoulli number asymptotic series for the Euler-Mascheroni con¬ 
stant: 


n 

y — £s _1 — Inn — 

S= 1 


1 Ihk 

2n (2 k)n 2k 

k= 1 


Hint. Apply the Euler-Maclaurin integration formula to f(x) — x 1 over the interval 
[1, n] for N — 1,2,.... 

5.10.8 Develop an asymptotic series for 

r°° 

/ e~ xv (l + v 2 )~~dv. 

Jo 

Take x to be real and positive. 

1 2! 4! (—l)"(2n)! 

-1--1-. 

x 3 x 5 x 2n+\ 


ANS. 


x 
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5.10.9 Calculate partial sums of e x E\(x) for x — 5, 10, and 15 to exhibit the behavior shown in 
Fig. 5.11. Determine the width of the throat for x = 10 and 15, analogous to Eq. (5.183). 

ANS. Throat width: n = 10, 0.000051 
n = 15, 0.0000002. 


5.10.10 The knife-edge diffraction pattern is described by 

/ = 0.5/ 0 {[C(m 0 ) + 0.5] 2 + [S(uo) +0.5] 2 }, 

where C(«o) and S(iiq) are the Fresnel integrals of Exercise 5.10.2. Here Iq is the 
incident intensity and I is the diffracted intensity; mo is proportional to the distance 
away from the knife edge (measured at right angles to the incident beam). Calculate 
I/Iq for mo varying from —1.0 to +4.0 in steps of 0.1. Tabulate your results and, if a 
plotting routine is available, plot them. 

Check value, uq — 1.0, I/Iq — 1.259226. 


5.10.11 The Euler-Maclaurin integration formula of Section 5.9 provides a way of calculating 
the Euler-Mascheroni constant y to high accuracy. Using fix.) — \/x in Eq. (5.168b) 
(with interval [1, «]) and the definition of y (Eq. 5.28), we obtain 


n 

y = — Inn — 

S= 1 


1 

2m 


£ 

k=l 


Bik 

(2 k)n 2k 


Using double-precision arithmetic, calculate y for N — 1,2,_ 

Note. D. E. Knuth, Euler’s constant to 1271 places. Math. Comput. 16: 275 (1962). An 
even more precise calculation appears in Exercise 8.5.16. 


ANS. For n = 1000, N — 2 

y =0.5772 1566 4901. 


5.11 Infinite Products 


Consider a succession of positive factors f\ ■ f2 • fo • f4 ■■ ■ fn (fi > 0). Using capital pi 
(]~[) to indicate product, as capital sigma (]C) indicates a sum, we have 

n 

f\- h-h---fn = Y\f l - (5.197) 

i=t 

We define p n , a partial product, in analogy with s n the partial sum. 


and then investigate the limit. 


Pn = n 
i=\ 


lim p n = P. 

n—> OO 


(5.198) 


(5.199) 


If P is finite (but not zero), we say the infinite product is convergent. If P is infinite or 
zero, the infinite product is labeled divergent. 
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Since the product will diverge to infinity if 

lim f n > 1 (5.200) 

n —»oo 

or to zero for 

lim f n < 1 (and > 0), (5.201) 

n—> oo 

it is convenient to write our infinite products as 

OO 

[(1 + a n)- 
n =1 

The condition a n —> 0 is then a necessary (but not sufficient) condition for convergence. 

The infinite product may be related to an infinite series by the obvious method of taking 
the logarithm, 

OO OO 

In ]~~[(1 + a„) = ^^ln(l + a„). (5.202) 

n= 1 n =1 

A more useful relationship is stated by the following theorem. 


Convergence of Infinite Product 

IfO < a n < 1, the infinite products P[,TLi (' + a n) an d n^=i(l “ a n) converge if 11 >< 

converges and diverge if a n diverges. 

Considering the term 1 + a n , we see from Eq. (5.90) that 

1 +a n <e“". (5.203) 

Therefore for the partial product p n , with ,v„ the partial sum of the a,, 

Pn<e Sn , (5.204) 


and letting n —> oo. 


J~[(l +fl») <exp^a„ 


n =1 


n =1 


thus establishing an upper bound for the infinite product. 
To develop a lower bound, we note that 


n n n 


p n =^+y, uj +y: y^Qi'Q; -t— >s„, 

<=1 i =1 7 = 1 


since a,- > 0. Hence 


J - [(1 + fl «) >^ 2 a n . 


n= 1 


n =1 


(5.205) 


(5.206) 


(5.207) 
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If the infinite sum remains finite, the infinite product will also. If the infinite sum diverges, 
so will the infinite product. 

The case of ]~[(1 — a n ) is complicated by the negative signs, but a proof that depends 
on the foregoing proof may be developed by noting that for a n < \ (remember a n -* 0 for 
convergence), 

(1 — a n ) < (1 + a n ) 1 
and 

(1 — a n ) > (1 + 2a„) -1 . (5.208) 


Sine, Cosine, and Gamma Functions 


An nth-order polynomial P n (x ) with n real roots may be written as a product of n factors 
(see Section 6.4, Gauss’ fundamental theorem of algebra): 


n 

P n (x) — (x - X\)(x - x 2 ) ■ ■ ■ (x - x n ) = ]~[(.r - Xi). (5.209) 

i=t 


In much the same way we may expect that a function with an infinite number of roots 
may be written as an infinite product, one factor for each root. This is indeed the case for 
the trigonometric functions. We have two very useful infinite product representations. 



(5.210) 


OO i- 

cos r = 1 

n— 1 " 


4.r 2 

(2 n — l) 2 7r 2 _ 


(5.211) 


The most convenient and perhaps most elegant derivation of these two expressions is by 
the use of complex variables. 30 By our theorem of convergence, Eqs. (5.210) and (5.211) 
are convergent for all finite values of x. Specifically, for the infinite product for sin x. a n — 

x 2 /n 2 7r 2 , 


OO 

y. a » 

n =1 


7 


E «- 2 



(5.212) 


by Exercise 5.9.6. The series corresponding to Eq. (5.211) behaves in a similar manner. 
Equation (5.210) leads to two interesting results. First, if we set x = 7r/2, we obtain 



(5.213) 


30 


See Eqs. (7.25) and (7.26). 
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Solving for tt/ 2, we have 

7T (2h) 2 1 2-2 4-4 6-6 

2 iI (2« — l)(2w + 1) _ U3 ' :C5 ' fTT" ’ 

n= 1 


(5.214) 


which is Wallis’ famous formula for 7t/2. 

The second result involves the gamma or factorial function (Section 8.1). One definition 
of the gamma function is 



r 00 / r\ 1 

-1 

rw = 


J 





(5.215) 


where y is the usual Euler-Mascheroni constant (compare Section 5.2). If we take the 
product of T (x) and l’(—x). Eq. (5.215) leads to 


rwr(-*) = - 


xe 


yx 


n > 


r=l 


X 

- \e 
r 


-x/r xe -Y x 


n * 


r=l 





(5.216) 


Using Eq. (5.210) with x replaced by jtx, we obtain 

r(x)T(-x) =---. 

x sin 7 xx 

Anticipating a recturence relation developed in Section 8.1, we have — xT(— x) 
Equation (5.217) may be written as 


r(x)T(l -x)= -. 

sin 7 xx 


(5.217) 

E(l-x). 


(5.218) 


This will be useful in treating the gamma function (Chapter 8). 

Strictly speaking, we should check the range of x for which Eq. (5.215) is convergent. 

Clearly, individual factors will vanish for x = 0,-1, —2,_The proof that the infinite 

product converges for all other (finite) values of x is left as Exercise 5.11.9. 

These infinite products have a variety of uses in mathematics. However, because of rather 
slow convergence, they are not suitable for precise numerical work in physics. 


Exercises 

5.11.1 Using 

OO OO 

In]~[(1 ± a n ) = ^ln(l ±a n ) 

n= 1 n= 1 

and the Maclaurin expansion of ln(l ± a n ), show that the infinite product n^Li d±a„) 
converges or diverges with the infinite series a n . 
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5.11.2 

5.11.3 

5.11.4 

5.11.5 

5.11.6 

5.11.7 

5.11.8 

5.11.9 

5.11.10 


An infinite product appears in the form 


/1 +a/n\ 

\1 + b/n)’ 

where a and b are constants. Show that this infinite product converges only if a = b. 

Show that the infinite product representations of sin.v and cos x are consistent with the 
identity 2 sin x cos x — sin 2x. 

Determine the limit to which 



converges. 
Show that 


Prove that 



(-in 

n ) 



2 

n(n + 1) 


1 

3' 



1 

2 ' 


Using the infinite product representations of sinx, show that 


x cot x 



hence that the Bernoulli number 


n-1 2(2 n)\ 




(2 n) 


Verify the Euler identity 


f7(i + z p ) = f7(i-z 2<? *) kl < l- 

P =1 q =1 


Show that n~id + x/r)e x ' r converges for all finite x (except for the zeros of 
1 +x/r). 

Hint. Write the nth factor as 1 + a n . 


Calculate cosv from its infinite product representation, Eq. (5.211), using (a) 10, 
(b) 100, and (c) 1000 factors in the product. Calculate the absolute error. Note how 
slowly the partial products converge-making the infinite product quite unsuitable for 
precise numerical work. 

ANS. For 1000 factors, cos7r = —1.00051. 
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Additional Readings 


The topic of infinite series is treated in many texts on advanced calculus. 

Bender, C. M., and S. Orszag, Advanced Mathematical Methods for Scientists and Engineers. New York: 
McGraw-Hill (1978). Particularly recommended for methods of accelerating convergence. 

Davis, H. T., Tables of Higher Mathematical Functions. Bloomington, IN: Principia Press (1935). Volume II 
contains extensive information on Bernoulli numbers and polynomials. 

Dingle, R. B., Asymptotic Expansions: Their Derivation and Interpretation. New York: Academic Press (1973). 

Galambos, J., Representations of Real Numbers by Infinite Series. Berlin: Springer (1976). 

Gradshteyn, I. S., and I. M. Ryzhik, Table of Integrals, Series and Products. Corrected and enlarged 6th edition 
prepared by Alan Jeffrey. New York: Academic Press (2000). 

Hamming, R. W., Numerical Methods for Scientists and Engineers. Reprinted, New York: Dover (1987). 

Hansen, E., A Table of Series and Products. Englewood Cliffs, NJ: Prentice-Hall (1975). A tremendous compila¬ 
tion of series and products. 

Hardy, G. H., Divergent Series. Oxford: Clarendon Press (1956), 2nd ed., Chelsea (1992). The standard, com¬ 
prehensive work on methods of treating divergent series. Hardy includes instructive accounts of the gradual 
development of the concepts of convergence and divergence. 

Jeffrey, A., Handbook of Mathematical Formulas and Integrals. San Diego: Academic Press (1995). 

Knopp, K., Theory and Application of Infinite Series. London: Blackie and Son (2nd ed.); New York: Hafner 
(1971). Reprinted: A. K. Peters Classics (1997). This is a thorough, comprehensive, and authoritative work 
that covers infinite series and products. Proofs of almost all of the statements not proved in Chapter 5 will be 
found in this book. 

Mangulis, V., Handbook of Series for Scientists and Engineers. New York: Academic Press (1965). A most 
convenient and useful collection of series. Includes algebraic functions, Fourier series, and series of the special 
functions: Bessel, Legendre, and so on. 

Olver, F. W. J., Asymptotics and Special Functions. New York: Academic Press (1974). A detailed, readable 
development of asymptotic theory. Considerable attention is paid to error bounds for use in computation. 

Rainville, E. D., Infinite Series. New York: Macmillan (1967). A readable and useful account of series constants 
and functions. 

Sokolnikoff, I. S., and R. M. Redheffer, Mathematics of Physics and Modern Engineering, 2nd ed. New York: 
McGraw-Hill (1966). A long Chapter 2 (101 pages) presents infinite series in a thorough but very readable 
form. Extensions to the solutions of differential equations, to complex series, and to Fourier series are included. 



This page intentionally left blank 



Chapter 6 


Functions of a Complex 
Variable I 

Analytic Properties, Mapping 


The imaginary numbers are a wonderful flight of God’s spirit; 
they are almost an amphibian between being and not being. 

Gottfried Wilhelm von Leibniz, 1702 

We turn now to a study of functions of a complex variable. In this area we develop some 
of the most powerful and widely useful tools in all of analysis. To indicate, at least partly, 
why complex variables are important, we mention briefly several areas of application. 

1. For many pairs of functions it and v, both u and v satisfy Laplace’s equation, 

2 3 2 i Jf(x,y) d 2 x[r(x, y) 

v * = ^^ + —^ =0 - 

Hence either u or v may be used to describe a two-dimensional electrostatic potential. The 
other function, which gives a family of curves orthogonal to those of the first function, may 
then be used to describe the electric field E. A similar situation holds for the hydrodynamics 
of an ideal fluid in irrotational motion. The function u might describe the velocity potential, 
whereas the function v would then be the stream function. 

In many cases in which the functions u and v are unknown, mapping or transforming 
in the complex plane permits us to create a coordinate system tailored to the particular 
problem. 

2. In Chapter 9 we shall see that the second-order differential equations of interest in 
physics may be solved by power series. The same power series may be used in the complex 
plane to replace x by the complex variable z. The dependence of the solution f(z) at a 
given zo on the behavior of f(z) elsewhere gives us greater insight into the behavior of our 
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solution and a powerful tool (analytic continuation) for extending the region in which the 
solution is valid. 

3. The change of a parameter k from real to imaginary, k —»■ ik, transforms the Helmholtz 
equation into the diffusion equation. The same change transforms the Helmholtz equa¬ 
tion solutions (Bessel and spherical Bessel functions) into the diffusion equation solutions 
(modified Bessel and modified spherical Bessel functions). 

4. Integrals in the complex plane have a wide variety of useful applications: 

• Evaluating definite integrals; 

• Inverting power series; 

• Forming infinite products; 

• Obtaining solutions of differential equations for large values of the variable (asymptotic 
solutions); 

• Investigating the stability of potentially oscillatory systems; 

• Inverting integral transforms. 

5. Many physical quantities that were originally real become complex as a simple phys¬ 
ical theory is made more general. The real index of refraction of light becomes a complex 
quantity when absorption is included. The real energy associated with an energy level be¬ 
comes complex when the finite lifetime of the level is considered. 


6.1 Complex Algebra 


A complex number is nothing more than an ordered pair of two real numbers, (a, b). Sim¬ 
ilarly, a complex variable is an ordered pair of two real variables, 1 

z = (x, y). (6.1) 

The ordering is significant. In general (a, b) is not equal to (b, a) and (x, y) is not equal 
to ( y,x). As usual, we continue writing a real number (x, 0) simply as x, and we call 
i = (0, 1) the imaginary unit. 

All our complex variable analysis can be developed in terms of ordered pairs of numbers 
(a, b ), variables ( x , y), and functions ( u{x , y), v(x, y)). 

We now define addition of complex numbers in terms of their Cartesian components 
as 


Zi + Z2 = (XI, yt) + (m, yi) = (m + m, yi + y 2 ), 


(6.2a) 


that is, two-dimensional vector addition. In Chapter 1 the points in the xy-plane are 
identified with the two-dimensional displacement vector r = xx + yy. As a result, two- 
dimensional vector analogs can be developed for much of our complex analysis. Exer¬ 
cise 6.1.2 is one simple example; Cauchy’s theorem. Section 6.3, is another. 

Multiplication of complex numbers is defined as 


zizi = Cm, yt) • Cm, yi) = (mm - ym, mm + mm). 


(6.2b) 


1 This is precisely how a computer does complex arithmetic. 
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Using Eq. (6.2b) we verify that i 2 = (0, 1) • (0, 1) = (—1,0) = —1, so we can also identify 
i — V— 1, as usual and further rewrite Eq. (6.1) as 


z — (x, y) = (x, 0) + (0, y) =x + (0,1) • (y, 0) = x + iy. 


(6.2c) 


Clearly, the i is not necessary here but it is convenient. It serves to keep pairs in order — 
somewhat like the unit vectors of Chapter 1 ? 


Permanence of Algebraic Form 

All our elementary functions, e z , sin z, and so on, can be extended into the complex plane 
(compare Exercise 6.1.9). For instance, they can be defined by power-series expansions, 
such as 



for the exponential. Such definitions agree with the real variable definitions along the real 
x-axis and extend the corresponding real functions into the complex plane. This result is 
often called permanence of the algebraic form. 

It is convenient to employ a graphical representation of the complex variable. By plotting 
x — the real part of z — as the abscissa and y — the imaginary part of z — as the ordinate, 
we have the complex plane, or Argand plane, shown in Fig. 6.1. If we assign specific 
values to x and y, then z corresponds to a point (x, y) in the plane. In terms of the ordering 
mentioned before, it is obvious that the point (x, y) does not coincide with the point (y, x) 
except for the special case of x = y. Further, from Fig. 6.1 we may write 

x = rcos@, y = r sin 0 (6.4a) 


y 



Figure 6.1 Complex 
plane — Argand diagram. 


-The algebra of complex numbers, (a, b), is isomorphic with that of matrices of the form 



(compare Exercise 3.2.4). 
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and 


2 = r(cos0 + i sin(9). 


(6.4b) 


Using a result that is suggested (but not rigorously proved) 3 by Section 5.6 and Exer¬ 
cise 5.6.1, we have the useful polar representation 


z — r(cos 9 + i sin@) = re' e . 


(6.4c) 


In order to prove this identity, we use r 3 = —i, i 4 — 1,... in the Taylor expansion of the 
exponential and trigonometric functions and separate even and odd powers in 


E 


n=0 


(i0) n 

n\ 


E 


i ’=0 


(i0) 2v 

(2v)! 


+E 


u=0 


(i0) lv+{ 

(2v+l)! 


E<-i> 


v=0 


0 2v 

(2v)! 


OO 

+'E^- 1) 


v=0 


e 2v+l 

(2u + l)! 


= cos@ + i sin0. 


For the special values 9 — n /2 and 9 — n, we obtain 


e 


in/2 _ 


71 


71 


cos —V i sin — — i. 

2 2 


e ,7T — cos(7t) = —1, 


intriguing connections between e, i, and n. Moreover, the exponential function e' 6 is peri¬ 
odic with period 2n, just like sind and cos 9. 

In this representation r is called the modulus or magnitude of z (r = |z| = (x 2 + y 2 ) 1/2 ) 
and the angle 9 (= taiC '(y/.r)) is labeled the argument or phase of z. (Note that the arctan 
function tan ~ 1 (y/x) has infinitely many branches.) 

The choice of polar representation, Eq. (6.4c), or Cartesian representation, Eqs. (6.1) and 
(6.2c), is a matter of convenience. Addition and subtraction of complex variables are easier 
in the Cartesian representation, Eq. (6.2a). Multiplication, division, powers, and roots are 
easier to handle in polar form, Eq. (6.4c). 

Analytically or graphically, using the vector analogy, we may show that the modulus of 
the sum of two complex numbers is no greater than the sum of the moduli and no less than 
the difference. Exercise 6.1.3, 


kll - \Z2 1 < \zi +Z2\ < \zi\ + |Z21 • (6.5) 

Because of the vector analogy, these are called the triangle inequalities. 

Using the polar form, Eq. (6.4c), we find that the magnitude of a product is the product 
of the magnitudes: 

\zi -Z 2 \ = kll • \Z 2 \- (6.6) 


Also, 


arg(zi • Z 2 ) = argzi + argz 2 - 


(6.7) 


3 Strictly speaking. Chapter 5 was limited to real variables. The development of power-series expansions for complex functions 
is taken up in Section 6.5 (Laurent expansion). 




6.1 Complex Algebra 


407 


y 


V 


z-plane 


w-plane 



x 


u 


Figure 6.2 The function w(z) = u(x, y) + iv(x, y) maps points in the jcy-plane 
into points in the Mi>-plane. 


From our complex variable z complex functions f (z) or w(z) may be constructed. These 
complex functions may then be resolved into real and imaginary parts, 

w(z) — u(x, y ) + iv(x, y), (6.8) 

in which the separate functions u (x , y) and v(x, y) are pure real. For example, if f (z.) = z 2 , 
we have 


f(z) = (x + iy) 2 = (x 2 - y 2 ) + i2xy. 

The real part of a function f(z) will be labeled il{/(z), whereas the imaginary part will 
be labeled zsf(z). In Eq. (6.8) 

lHu>(z) = Re(w) = u(x, y), 3w(z) — Im(w) = v(x, y). 

The relationship between the independent variable z and the dependent variable w is 
perhaps best pictured as a mapping operation. A given z — x + iy means a given point in 
the z-plane. The complex value of w(z) is then a point in the w-plane. Points in the z-plane 
map into points in the w-plane and curves in the z-plane map into curves in the w-plane, 
as indicated in Fig. 6.2. 


Complex Conjugation 


In all these steps, complex number, variable, and function, the operation of replacing i by 
-i is called “taking the complex conjugate.” The complex conjugate of z is denoted by z*, 
where 4 


z*=x-iy. 


(6.9) 


4 The complex conjugate is often denoted by z in the mathematical literature. 
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The complex variable z and its complex conjugate z* are mirror images of each other 
reflected in the jt-axis, that is, inversion of the v-axis (compare Fig. 6.3). The product zz* 
leads to 


zz* = (x + iy)(x — iy) — x 2 + y 2 = r 2 . 


Hence 


( 6 . 10 ) 


(zz*) 1/2 = |z|, 


the magnitude of z. 


Functions of a Complex Variable 

All the elementary functions of real variables may be extended into the complex plane — 
replacing the real variable x by the complex variable z. This is an example of the analytic 
continuation mentioned in Section 6.5. The extremely important relation of Eq. (6.4c) is 
an illustration. Moving into the complex plane opens up new opportunities for analysis. 


Example 6. 1.1 de moivre’s formula 

If Eq. (6.4c) (setting r = 1) is raised to the nth power, we have 

e ine = (cos#+ /sin#)". (6.11) 

Expanding the exponential now with argument n9, we obtain 

cos ii6 + i sinn# = (cos# + i sin#)". (6.12) 

De Moivre’s formula is generated if the right-hand side of Eq. (6.12) is expanded by the bi¬ 
nomial theorem; we obtain cos n0 as a series of powers of cos# and sin#. Exercise 6.1.6. ■ 

Numerous other examples of relations among the exponential, hyperbolic, and trigono¬ 
metric functions in the complex plane appear in the exercises. 

Occasionally there are complications. The logarithm of a complex variable may be ex¬ 
panded using the polar representation 


In" = In re' 6 = lnr + i6. 


(6.13a) 
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This is not complete. To the phase angle, 9. we may add any integral multiple of 2it without 
changing z. Hence Eq. (6.13a) should read 

lnz = \nre lW+2nn) = lnr + i(9 + 2mz). (6.13b) 

The parameter n may be any integer. This means that In z is a multivalued function having 
an infinite number of values for a single pair of real values r and 0. To avoid ambiguity, 
the simplest choice is n — 0 and limitation of the phase to an interval of length 2it, such 
as (—71, 7t). 5 The line in the z-plane that is not crossed, the negative real axis in this case, 
is labeled a cut line or branch cut. The value of In z with n = 0 is called the principal 
value of lnz. Further discussion of these functions, including the logarithm, appears in 
Section 6.7. 


Exercises 

6.1.1 (a) Find the reciprocal of x + iy, working entirely in the Cartesian representation. 

(b) Repeat part (a), working in polar form but expressing the final result in Cartesian 

form. 

6.1.2 The complex quantities a — u + iv and b = x + iy may also be represented as two- 
dimensional vectors a = xu + yv, b = xx + yy. Show that 

a*b = a • b + (z • a x b. 

6.1.3 Prove algebraically that for complex numbers, 

kll - \Z2\ < \Z1 +Z2\ < kll + |Z21• 

Interpret this result in terms of two-dimensional vectors. Prove that 

|z — 11 < \ y/z 2 — lj < |z+ 1|, for JH(z)>0. 

6.1.4 We may define a complex conjugation operator K such that Kz = z*• Show that K is 
not a linear operator. 

6.1.5 Show that complex numbers have square roots and that the square roots are contained 

in the complex plane. What are the square roots of i ? 

6.1.6 Show that 

(a) cos n0 = cos" 9 — (") cos" -2 9 sin 2 9 + (cos" -4 9 sin 4 9 — ■■■. 

(b) sin n9 = (") cos" -1 9 sin0 — (") cos" -3 9 sin 3 9 -\ -. 

Note. The quantities ("J are binomial coefficients: ( f ^) = n\/[(n — m)!m!]. 

6.1.7 Prove that 

J sin(iV.r/2) jc 

(a) > cos nx — - cos{N — 1) —, 

L —' sin x / 2 2 

n=0 ' 

There is no standard choice of phase; the appropriate phase depends on each problem. 
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JV-1 


E siniNx / 2) x 

sin nx — —t -—— sin(2V — 1) —. 


22 =0 


sin x / 2 


These series occur in the analysis of the multiple-slit diffraction pattern. Another appli¬ 
cation is the analysis of the Gibbs phenomenon. Section 14.5. 

Hint. Parts (a) and (b) may be combined to form a geometric series (compare Sec¬ 
tion 5.1). 

6.1.8 For — 1 < p < 1 prove that 


(a) 

(b) 


OO 

y p n cos nx — 
12=0 


1 — p COS X 

1 —2 p cos x + p z ’ 


CXD 

y p n sin nx = 
12=0 


p sin* 

1 — 2 p cos x + p 2 ' 


These series occur in the theory of the Fabry-Perot interferometer. 

6.1.9 Assume that the trigonometric functions and the hyperbolic functions are defined for 
complex argument by the appropriate power series 


sin z = y (-i) (,, - 1) / 2 £- = yy-i) 

Z—/ y> \ L / 


7 2s+\ 


5=0 


12 = 1 , odd 

OO 

CO sz= y ( -i r/ 2Z -=y(-iy 

L —' n\ z —' 


( 2 ^+ 1 )!’ 


OO 


12 = 0 , even 


5=0 


,25 


(2s)!’ 


°° ~7 n °° -25+1 

Z \—\ Z 


sinhz = E ;r=E 


n\ ' (2s + 1)! ’ 
n=l,odd *=0 


°° —12 °° -25 

O X—' Z 


c ° shz= £ — = ~y ■ 


n! ^ (2s)! 

12=0, even 5=0 


(a) Show that 

i sin z = sinh iz, sin iz = i sinh z, 
cosz = coshiz, cos/z = coshz. 

(b) Verify that familiar functional relations such as 

cosh z =£ifL, 

sin(zi + Z 2 ) — sinzi cosz 2 + sinz 2 coszi, 


still hold in the complex plane. 
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6.1.10 Using the identities 

e iz + e~ iz e iz - e~ iz 

cos z =-, sin z — -, 

2 2 i 

established from comparison of power series, show that 

(a) sin(x + iy) = sin x cosh y + i cos x sinh y, 
cos(x + iy) = cos x cosh y — i sinx sinhy, 

(b) | sinz| 2 = sin 2 x + sinh 2 y, | cos z\ 2 — cos 2 x + sinh 2 y. 

This demonstrates that we may have | sin z\ , | cos z| > 1 in the complex plane. 

6.1.11 From the identities in Exercises 6.1.9 and 6.1.10 show that 


(a) sinh(x + iy ) — sinh x cos y + i cosh x sin y, 
cosh(x + iy) = coshx cos y + i sinhx sin y, 

(b) | sinhz| 2 = sinh 2 x + sin 2 y, | cosh z\ 2 — cosh 2 x + sin 2 y. 


6.1.12 

6.1.13 

6.1.14 

6.1.15 

6.1.16 

6.1.17 


Prove that 

(a) | sinz| > |sinx| (b) |cosz| > |cosx|. 

Show that the exponential function e z is periodic with a pure imaginary period of 2ni. 
Show that 

z sinh x + i sin y z. sinh x — i sin y 

(a) tanh - =-—, (b) coth - =-—. 

2 coshx + cosy 2 coshx —cosy 

Find all the zeros of 

(a) sinz, (b)cosz, (c)sinhz, fd)cosh~. 

Show that 

(a) sin -1 z = —i In (iz ± \/l — z 2 ), (d) sinh -1 z = ln(z + Vz 2 + l), 

(b) cos -1 z = — i ln(z ± \/z 2 — 1), (e) cosh -1 z = ln(z + \/z 2 — 1), 

(c) tan -1 z = - ff)tanh -1 z= ^ In j. 

Hint. 1. Express the trigonometric and hyperbolic functions in terms of exponentials. 
2. Solve for the exponential and then for the exponent. 

In the quantum theory of the photoionization we encounter the identity 

f ia — \ \ ib . . 

I - ) =exp(— 2Z?cot a), 

\ia+lj ’ 

in which a and b are real. Verify this identity. 
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6.1.18 A plane wave of light of angular frequency co is represented by 

e i(o{t—nx/c) 


In a certain substance the simple real index of refraction n is replaced by the complex 
quantity n — ik. What is the effect of k on the wave? What does k correspond to phys¬ 
ically? The generalization of a quantity from real to complex form occurs frequently 
in physics. Examples range from the complex Young’s modulus of viscoelastic materi¬ 
als to the complex (optical) potential of the “cloudy crystal ball” model of the atomic 
nucleus. 


6.1.19 We see that for the angular momentum components defined in Exercise 2.5.14, 

L x iLy ^ (L x + iLy ) . 


Explain why this occurs. 

6.1.20 Show that the phase of /(z) = u + iv is equal to the imaginary part of the logarithm of 
/(z). Exercise 8.2.13 depends on this result. 

6.1.21 (a) Show that e lnz always equals z. 

(b) Show that lne z does not always equal z. 

6.1.22 The infinite product representations of Section 5.11 hold when the real variable x is 
replaced by the complex variable z. From this, develop infinite product representations 
for 

(a)sinhz, (b)coshz. 

6.1.23 The equation of motion of a mass m relative to a rotating coordinate system is 

d 2 r ( dr\ (dco 

m —- = F — mco x (w x r) — 2m w x — — ml — x r 

dt 2 V dt ) \ dt 

Consider the case F = 0, r = xx + yy, and a> — &>z, with co constant. Show that the 
replacement of r = xx + yy by z = x + iy leads to 

d Z 9 

— T + i2co- - co z = 0. 

dt 2 dt 

Note. This ODE may be solved by the substitution z = fe~ ,(ot . 


6.1.24 Using the complex arithmetic available in FORTRAN, write a program that will cal¬ 
culate the complex exponential e z from its series expansion (definition). Calculate e z 
for z — e" !7r / 6 , n — 0, 1,2,..., 12. Tabulate the phase angle (6 — htt/6), JHz, Sz, fH(e z ), 
2s(e z ), \e z \, and the phase of e z . 

Check value. n = 5,6 = 2.61799, St(z) = -0.86602, 

3z = 0.50000, lH(e z ) = 0.36913, S(e J ) = 0.20166, 
\e z \ = 0.42062, phased) = 0.50000. 

6.1.25 Using the complex arithmetic available in FORTRAN, calculate and tabulate IH(sinhz), 
S(sinhz), | sinhz|, and phase (sinhz) for x — 0.0(0.1)1.0 and y — 0.0(0.1)1.0. 
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Hint. Beware of dividing by zero when calculating an angle as an arc tangent. 

Check value. z = 0.2 + 0.1/, JH(sinhz) = 0.20033, 

S(sinhz) = 0.10184, | sinhz| = 0.22473, 
phase(sinhz) = 0.47030. 

6 . 1.26 Repeat Exercise 6.1.25 for coshz. 


6.2 Cauchy-Riemann Conditions 


Having established complex functions of a complex variable, we now proceed to differen¬ 
tiate them. The derivative of f(z), like that of a real function, is defined by 


lim 

Sz^O 


f(z + Sz)-f(z) 
z + Sz — z 


lim 


Sf(z) 

Sz 


d JL 

dz 


f\z). 


(6.14) 


provided that the limit is independent of the particular approach to the point z. For real 
variables we require that the right-hand limit (x —» xo from above) and the left-hand limit 
(x —> xo from below) be equal for the derivative df (x)jdx to exist at x = xq. Now, with z 
(or zo) some point in a plane, our requirement that the limit be independent of the direction 
of approach is very restrictive. 

Consider increments Sx and Sy of the variables x and y, respectively. Then 


Also, 

so that 


Sz = Sx + iSy. 

Sf — Su + iSv, 

8f Su + iSv 
Sz 8x + i8y 


(6.15) 

(6.16) 

(6.17) 


Let us take the limit indicated by Eq. (6.14) by two different approaches, as shown in 
Fig. 6.4. First, with Sy — 0, we let Sx —>• 0. Equation (6.14) yields 


lim 

Sz^O 


Sf 

Sz 


lim 

<5;t—>0 


Su Sv\ 

-1 -i — 

Sx Sx) 


dit . dv 
— “I - i —, 
dx dx 


(6.18) 


V 


8x —> 0 
8y = 0 


8x = 0 
8 v —»0 


x 


Figure 6.4 Alternate 
approaches to zo- 
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assuming the partial derivatives exist. For a second approach, we set 8x — 0 and then let 
<5v -> 0. This leads to 


8f 

lim — = lim 

$ z-*0 8z & y-*0 



8 v\ .3 u dv 

— I — — i — + —. 
8y J 3 y 3 y 


(6.19) 


If we are to have a derivative df/dz, Eqs. (6.18) and (6.19) must be identical. Equating 
real parts to real parts and imaginary parts to imaginary parts (like components of vectors), 
we obtain 


du dv du dv 

dx 3 y ’ 3 y dx 


( 6 . 20 ) 


These are the famous Cauchy-Riemann conditions. They were discovered by Cauchy and 
used extensively by Riemann in his theory of analytic functions. These Cauchy-Riemann 
conditions are necessary for the existence of a derivative of /(z); that is, if df/dz exists, 
the Cauchy-Riemann conditions must hold. 

Conversely, if the Cauchy-Riemann conditions are satisfied and the partial derivatives 
of u(x, y) and v(x, y) are continuous, the derivative df/dz exists. This may be shown by 
writing 


&f = 


/du . 3i>\ 
\ dx dx ) 


8x + 


/du . 3iA 
V 9y +l dy) 


8y. 


( 6 . 21 ) 


The justification for this expression depends on the continuity of the partial derivatives of 
u and v. Dividing by 8z, we have 


8f (du/dx + i (dv/dx))8x + (du/dy + i (dv/d y))8y 

8z 8x + i8y 

(du/dx + i (dv/dx)) + ( du/dy + i (dv/d y))8y/Sx 

— - : - : - : -. ( 6 . 22 ) 

1 +i(8y/8x) 

If Sf/8z is to have a unique value, the dependence on Sy/8x must be eliminated. Apply¬ 
ing the Cauchy-Riemann conditions to the y derivatives, we obtain 


du dv dv du 

— + i — ~-+ i —. 

3y dy dx dx 


(6.23) 


Substituting Eq. (6.23) into Eq. (6.22), we may cancel out the 8y/8x dependence and 


8f du .dv 
8z dx dx' 


(6.24) 


which shows that lim 8f/8z is independent of the direction of approach in the complex 
plane as long as the partial derivatives are continuous. Thus, ^4 exists and / is analytic 
at z. 

It is worthwhile noting that the Cauchy-Riemann conditions guarantee that the curves 
u — ci will be orthogonal to the curves v — C 2 (compare Section 2.1). This is fundamental 
in application to potential problems in a variety of areas of physics. If u — ci is a line of 
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electric force, then v = C 2 is an equipotential line (surface), and vice versa. To see this, let 
us write the Cauchy-Riemann conditions as a product of ratios of partial derivatives. 


w* Vx_ 

Uy Vy 


(6.25) 


with the abbreviations 



du 



3 ” 




y m 


Now recall the geometric meaning of —u x /u y as the slope of the tangent of each curve 
u (x, y) = const, and similarly for v(x, y ) = const. This means that the u — const, and 
v — const, curves are mutually orthogonal at each intersection. Alternatively, 


u x dx + Uy dy = 0 = v y dx — v x dy 


says that, if (dx, dy) is tangent to the w-curve, then the orthogonal (—dy, dx) is tangent to 
the i>-curve at the intersection point, z = (x, y). Or equivalently, u x v x + u y v y = 0 implies 
that the gradient vectors (u x , u y ) and (v x , v y ) are perpendicular. A further implication 
for potential theory is developed in Exercise 6.2.1. 


Analytic Functions 

Finally, if f(z) is differentiable at z = Zo and in some small region around zo, we say that 
f(z) is analytic 6 at z = zo- If f(z) is analytic everywhere in the (finite) complex plane, we 
call it an entire function. Our theory of complex variables here is one of analytic functions 
of a complex variable, which points up the crucial importance of the Cauchy-Riemann 
conditions. The concept of analyticity carried on in advanced theories of modern physics 
plays a crucial role in dispersion theory (of elementary particles). If f'(z) does not exist 
at z = Z o, then zo is labeled a singular point and consideration of it is postponed until 
Section 6.6. 

To illustrate the Cauchy-Riemann conditions, consider two very simple examples. 

Example 6.2.1 z 2 is analytic 

Let f(z ) = z 2 . Then the real part u(x, y) = x 2 — y 2 and the imaginary part v(x, y) — 2xy. 
Following Eq. (6.20), 

du ^ d v du ^ dv 
dx dy’ dy ^ dx 

We see that f(z) = z 2 satisfies the Cauchy-Riemann conditions throughout the complex 
plane. Since the partial derivatives are clearly continuous, we conclude that f(z) = z 2 is 
analytic. ■ 


'■'Nome writers use the term holomorphic or regular. 
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Example 6.2.2 z* is not analytic 

Let f(z) = z* ■ Now it — x and v = —y. Applying the Cauchy-Riemann conditions, we 
obtain 


du dv 

dx ^ dy 




The Cauchy-Riemann conditions are not satisfied and f (z.) = z* is not an analytic function 
of z. It is interesting to note that f(z.) = z* is continuous, thus providing an example of a 
function that is everywhere continuous but nowhere differentiable in the complex plane. 

The derivative of a real function of a real variable is essentially a local characteristic, in 
that it provides information about the function only in a local neighborhood — for instance, 
as a truncated Taylor expansion. The existence of a derivative of a function of a complex 
variable has much more far-reaching implications. The real and imaginary parts of our an¬ 
alytic function must separately satisfy Laplace’s equation. This is Exercise 6.2.1. Further, 
our analytic function is guaranteed derivatives of all orders. Section 6.4. In this sense the 
derivative not only governs the local behavior of the complex function, but controls the 
distant behavior as well. ■ 


Exercises 

6 . 2.1 The functions u(x, y ) and v(x , y) are the real and imaginary parts, respectively, of an 
analytic function w(z). 

(a) Assuming that the required derivatives exist, show that 

V 2 m = V 2 u = 0. 

Solutions of Laplace’s equation such as u(x, y) and v(x , y) are called harmonic 
functions. 

(b) Show that 

du du dv dv 

-h-= 0, 

dx dy dx dy 

and give a geometric interpretation. 

Hint. The technique of Section 1.6 allows you to construct vectors normal to the curves 
u{x, y) — Cj and i>(x, y) = Cj. 

6 . 2.2 Show whether or not the function f(z) — SH(z) = x is analytic. 

6 . 2.3 Having shown that the real part u(x, y) and the imaginary part v(x. y) of an analytic 
function w(z) each satisfy Laplace’s equation, show that u(x, y) and v(x. y) cannot 
both have either a maximum or a minimum in the interior of any region in which 
w(z) is analytic. (They can have saddle points only.) 
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6.2.4 Let A — d 2 w/dx 2 , B = d 2 w/dxdy, C = d 2 w/dy 2 . From the calculus of functions of 
two variables, w (x. y), we have a saddle point if 

B 2 - AC > 0. 


6.2.5 

6.2.6 

6.2.7 

6.2.8 


6.2.9 

6.2.10 


With f(z) — u(x , y) + iv(x, y), apply the Cauchy-Riemann conditions and show that 
neither it (x , y j nor v(x, y ) has a maximum or a minimum in a finite region of the 
complex plane. (See also Section 7.3.) 

Find the analytic function 


w(z) = u(x, y) + iv(x, y) 
if (a) u(x, y) — x 2 — 3 xy 2 , (b) v(x, y) = e~ y sin.r. 

If there is some common region in which w\ — u(x, y) + iv(x, y) and u >2 — w* — 
u(x , y) — iv(x, y) are both analytic, prove that u(x, y) and v(x, y) are constants. 


The function f(z) — u(x, y) + iv(x, y) is analytic. Show that f*(z*) is also analytic. 

Using f(re ‘ e ) = R(r, 9)e'^^ r ' d \ in which R(r,6) and <J>(r, 9) are differentiable real 
functions of r and 6, show that the Cauchy-Riemann conditions in polar coordinates 
become 


dR _ Rd@ 

(a) _ 7 ~de’ 


1 dR 9© 

(b)- = -R —. 

r dd dr 


Hint. Set up the derivative first with 8z radial and then with 8z tangential. 


As an extension of Exercise 6.2.8 show that @(r, 9) satisfies Laplace’s equation in polar 
coordinates. Equation (2.35) (without the final term and set to zero) is the Laplacian in 
polar coordinates. 

Two-dimensional irrotational fluid flow is conveniently described by a complex poten¬ 
tial f(z) — u(x, v) + iv(x, y). We label the real part, u(x, y), the velocity potential 
and the imaginary part, v(x, y), the stream function. The fluid velocity V is given by 
V = Vm. If f(z) is analytic. 


(a) Show that df/dz = V x — iV Y ; 

(b) Show that V • V = 0 (no sources or sinks); 

(c) Show that V xY = 0 (irrotational, nonturbulent flow). 


6.2.11 A proof of the Schwarz inequality (Section 10.4) involves minimizing an expression, 

/ = i'aa + hl/tab + k *4 r ab + ^ *’ l l r bb > 0. 

The i fr are integrals of products of functions; \j/ aa and i fob are real, i jr a i, is complex and 
X is a complex parameter. 

(a) Differentiate the preceding expression with respect to 7*, treating X as an indepen¬ 
dent parameter, independent of 7*. Show that setting the derivative df/dX* equal 
to zero yields 

itbb ' 
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(b) Show that df/dX — 0 leads to the same result. 

(c) Let X = .t + iy, X* — x — iy. Set the x and y derivatives equal to zero and show 
that again 

x = _tk. 

'frbb' 

This independence of X and X* appears again in Section 17.7. 

6.2.12 The function f(z) is analytic. Show that the derivative of f(z) with respect to z* does 
not exist unless f(z) is a constant. 

Hint. Use the chain rule and take x — (z + z*)/2, y — (z — z*)/2i. 

Note. This result emphasizes that our analytic function f(z) is not just a complex func¬ 
tion of two real variables x and y. It is a function of the complex variable x + iy. 

6.3 Cauchy’s Integral Theorem 

Contour Integrals 

With differentiation under control, we turn to integration. The integral of a complex vari¬ 
able over a contour in the complex plane may be defined in close analogy to the (Riemann) 
integral of a real function integrated along the real .r-axis. 

We divide the contour from z o to z/ () into n intervals by picking n — 1 intermediate points 
Zi, Z 2 , ■ ■ ■ on the contour (Fig. 6.5). Consider the sum 

n 

S n =Y J fttj)<<Zj-Zj- 1)> (6.26) 

7 = 1 



Figure 6.5 Integration path. 
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where £j is a point on the curve between z j and Zj- 1 • Now let n —» oo with 


\Zj~Zj-l\ 


for all j. If the lim^oo S n exists and is independent of the details of choosing the points 
Zj and ,then 


n „ z ' 

lim y2f«j)(zj - zj-]) = / f(z)dz 
n ^ 00 ~{ Jzo 


(6.27) 


The right-hand side of Eq. (6.27) is called the contour integral of f(z) (along the specified 
contour C from z = z 0 to z = z' 0 ). 

The preceding development of the contour integral is closely analogous to the Riemann 
integral of a real function of a real variable. As an alternative, the contour integral may be 
defined by 

rz2 rx 2,y2 

/ f(z)dz— / [m(x, y) + iv{x, y)\[dx + idy] 

Jz\ Jx\,y\ 

rx2,y 2 rx2,n 

— / [u(x, y) dx — v(x , y) dy\ + i / [i>(x, y) dx + u(x, y) dy ] 

Jx i,yi Jx i.yi 

with the path joining (x\, yi) and (xi, yi) specified. This reduces the complex integral to 
the complex sum of real integrals. It is somewhat analogous to the replacement of a vector 
integral by the vector sum of scalar integrals. Section 1.10. 

An important example is the contour integral f c z n dz, where C is a circle of radius 
r > 0 around the origin z = 0 in the positive mathematical sense (counterclockwise). In 
polar coordinates of Eq. (6.4c) we parameterize the circle as z — re‘ e and dz. — ire ld d6. 
For n ^ — 1, n an integer, we then obtain 


1 C r n+l f 2lz 

-— / z n dz=— — / exp[i(« + \)0]d6 
2tci Jc 2jt Jo 

= [2 ni{n + l)] _1 r B+1 [e , ' (n+1)e ]|^ r = 0 (6.27a) 

because 2n is a period of e‘ (n+ 1 , while for n — — 1 


i r dz 

2 iti Jc z 



dd= 1, 


(6.27b) 


again independent of r. 

Alternatively, we can integrate around a rectangle with the corners zi, Z 2 , Z 3 , Z 4 to 
obtain for n / — 1 


/ 


z" dz = 


„n +1 


n + 1 


Z2 


,«+1 


+ 


n + 1 


Z3 


_«+ 1 


+ 


Z2 


n + I 


Z 4 


„«+1 


+ 


Z3 


n + 1 


= 0, 


Z4 


because each corner point appears once as an upper and a lower limit that cancel. For 
n = — 1 the corresponding real parts of the logarithms cancel similarly, but their imaginary 
parts involve the increasing arguments of the points from z\ to Z 4 and, when we come back 
to the first corner z 1 , its argument has increased by 2jt due to the multivaluedness of the 
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logarithm, so 2 ni is left over as the value of the integral. Thus, the value of the integral 
involving a multivalued function must be that which is reached in a continuous fash¬ 
ion on the path being taken. These integrals are examples of Cauchy’s integral theorem, 
which we consider in the next section. 


Stokes’ Theorem Proof 


Cauchy’s integral theorem is the first of two basic theorems in the theory of the behavior of 
functions of a complex variable. First, we offer a proof under relatively restrictive condi¬ 
tions — conditions that are intolerable to the mathematician developing a beautiful abstract 
theory but that are usually satisfied in physical problems. 

If a function f(z.) is analytic, that is, if its partial derivatives are continuous throughout 
some simply connected region R , 7 for every closed path C (Fig. 6.6) in R , and if it is 
single-valued (assumed for simplicity here), the line integral of f(z.) around C is zero, or 

j f(.z)dz = j> f(z)dz = 0. (6.27c) 


Recall that in Section 1.13 such a function f (z), identified as a force, was labeled conser¬ 
vative. The symbol <p is used to emphasize that the path is closed. Note that the interior 
of the simply connected region bounded by a contour is that region lying to the left when 
moving in the direction implied by the contour; as a rule, a simply connected region is 
bounded by a single closed curve. 

In this form the Cauchy integral theorem may be proved by direct application of Stokes’ 
theorem (Section 1.12). With f(z.) = u(x, y) + iv(x, y ) and dz = dx + idy , 

<j> f(z) dz — <j> (u + i v)(dx + idy) 


= (b (u dx — v dy) + i (b (v dx + u dy). 


(6.28) 


These two line integrals may be converted to surface integrals by Stokes’ theorem, a proce¬ 
dure that is justified if the partial derivatives are continuous within C. In applying Stokes’ 
theorem, note that the final two integrals of Eq. (6.28) are real. Using 


V = xV x +yV y , 


Stokes’ theorem says that 


c 


-/( 


dVy 3V X 


(V x dx + V y dy) = / ( -— ) dx dy. 


dx dy 

For the first integral in the last part of Eq. (6.28) let u — V x and v — — Vy- 8 Then 


(6.29) 


7 Any closed simple curve (one that does not intersect itself) inside a simply connected region or domain may be contracted to a 
single point that still belongs to the region. If a region is not simply connected, it is called multiply connected. As an example of 
a multiply connected region, consider the --plane with the interior of the unit circle excluded. 

s In the proof of Stokes’ theorem. Section 1.12, V x and V x are any two functions (with continuous partial derivatives). 
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Figure 6.6 A closed contour C 
within a simply connected region R. 


(u dx — v dy) — ® (V x dx + V y dy ) 


= [(Wy_Wx 
J \ dx dy 


dx dy 


-J 


dv du\ 

-— + — jdxdy. (6.30) 


, dx dy 

For the second integral on the right side of Eq. (6.28) we let u — V y and v = V x . Using 
Stokes’ theorem again, we obtain 

' (vdx + udy) — 


f ( du 3l>\ 

J 


dx dy. 


(6.31) 


On application of the Cauchy-Riemann conditions, which must hold, since f(z) is as¬ 
sumed analytic, each integrand vanishes and 

f (dv du\ C (du dv\ 

f(z) dz = - J ( — + — J dx dy + i J l — - — j dx dy = 0. (6.32) 


Cauchy-Goursat Proof 


This completes the proof of Cauchy’s integral theorem. However, the proof is marred from 
a theoretical point of view by the need for continuity of the first partial derivatives. Actually, 
as shown by Goursat, this condition is not necessary. An outline of the Goursat proof is as 
follows. We subdivide the region inside the contour C into a network of small squares, as 
indicated in Fig. 6.7. Then 

<f f(z)dz = J2 ( f (6-33) 

Jc j JCj 


all integrals along interior lines canceling out. To estimate the j c f(z)dz, we construct 
the function 


Sj(z,Zj) = 


f(z)-f(zj ) df(z) 


Z — Zj 


dz 


(6.34) 


with zj an interior point of the jth subregion. Note that [/(z) — f(zj)]/(z — Zj) is an 
approximation to the derivative at z = Zj. Equivalently, we may note that if /(z) had 
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x 


Figure 6.7 Cauchy-Goursat contours. 


a Taylor expansion (which we have not yet proved), then Sj (z, Zj ) would be of order z — Zj, 
approaching zero as the network was made finer. But since f'(zj ) exists, that is, is finite, 
we may make 

\Sj(z,Zj)\<s, (6.35) 

where s is an arbitrarily chosen small positive quantity. Solving Eq. (6.34) for f(z) and 
integrating around Cj , we obtain 


f{z)dz=(k (z-Zj)8j(z,Zj)dz, 


(6.36) 


the integrals of the other terms vanishing. 9 When Eqs. (6.35) and (6.36) are combined, one 
shows that 



f(z)dz 


< As, 


(6.37) 


where A is a term of the order of the area of the enclosed region. Since s is arbitrary, we 
let e 0 and conclude that if a function f(z) is analytic on and within a closed path C, 


f(z)dz = 0. 


(6.38) 


Details of the proof of this significantly more general and more powerful form can be found 
in Churchill in the Additional Readings. Actually we can still prove the theorem for f(z) 
analytic within the interior of C and only continuous on C. 

The consequence of the Cauchy integral theorem is that for analytic functions the line 
integral is a function only of its endpoints, independent of the path of integration. 


f Z2 

Jzi 


f(z)dz = F(zi)- F(zi) = 


-f 


f(z)dz, 


(6.39) 


again exactly like the case of a conservative force, Section 1.13. 


dz and f zdz = 0 by Eq. (6.27a). 
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Multiply Connected Regions 

The original statement of Cauchy’s integral theorem demanded a simply connected region. 
This restriction may be relaxed by the creation of a barrier, a contour line. The purpose of 
the following contour-line construction is to permit, within a multiply connected region, 
the identification of curves that can be shrunk to a point within the region, that is, the 
construction of a subregion that is simply connected. 

Consider the multiply connected region of Fig. 6.8, in which f(z) is not defined for the 
interior, R'. Cauchy’s integral theorem is not valid for the contour C, as shown, but we 
can construct a contour C' for which the theorem holds. We draw a line from the interior 
forbidden region, R', to the forbidden region exterior to R and then run a new contour, C\ 
as shown in Fig. 6.9. 

The new contour, C\ through ABDEFGA never crosses the contour line that literally 
converts R into a simply connected region. The three-dimensional analog of this technique 
was used in Section 1.14 to prove Gauss’ law. By Eq. (6.39), 

[ A f(z)dz = - [° f(z)dz, (6.40) 

Jg Je 


y 



Figure 6.8 A closed contour C in a 
multiply connected region. 


v 



Figure 6.9 Conversion of a multiply 
connected region into a simply connected 
region. 
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with /(z) having been continuous across the contour line and line segments DE and GA 
arbitrarily close together. Then 

<f f(z)dz= f f(z)dz+ f f(z)dz = 0 (6.41) 

Jc Jabd Jefg 

by Cauchy’s integral theorem, with region R now simply connected. Applying Eq. (6.39) 
once again with ABD —> C\ and EFG —> —C), we obtain 

<f'f(z)dz=<f'f(z)dz, (6.42) 

J Cy J C*2 

in which Cj and C) are both traversed in the same (counterclockwise, that is, positive) 
direction. 

Let us emphasize that the contour line here is a matter of mathematical convenience, to 
permit the application of Cauchy’s integral theorem. Since f(z) is analytic in the annular 
region, it is necessarily single-valued and continuous across any such contour line. 


Exercises 


6.3.1 

6.3.2 


Show that /(z) dz = - f£ f(z) dz. 
Prove that 



f(z) dz 


— I f I max * L i 


where |/| max is the maximum value of |/(z)| along the contour C and L is the length 
of the contour. 


6.3.3 


6.3.4 


Verify that 



Z* dz 


depends on the path by evaluating the integral for the two paths shown in Fig. 6.10. 
Recall that f(z) = z* is not an analytic function of z and that Cauchy’s integral theorem 
therefore does not apply. 

Show that 


dz 

c z 2 + z 


= 0 , 


in which the contour C is a circle defined by |z| = R > 1. 

Hint. Direct use of the Cauchy integral theorem is illegal. Why? The integral may be 
evaluated by transforming to polar coordinates and using tables. This yields 0 for R > 1 
and 2n i for R < 1. 
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Figure 6.10 Contour. 


6.4 Cauchy’s Integral Formula 


As in the preceding section, we consider a function f(z) that is analytic on a closed contour 
C and within the interior region bounded by C. We seek to prove that 

(6.43) 

in which zo is any point in the interior region bounded by C. This is the second of the 
two basic theorems mentioned in Section 6.3. Note that since z is on the contour C while 
zo is in the interior, z — zo ^ 0 and the integral Eq. (6.43) is well defined. Although /(z) 
is assumed analytic, the integrand is /(z)/(z — z o) and is not analytic at z = Zo unless 
f(zo ) = 0. If the contour is deformed as shown in Fig. 6.11 (or Fig. 6.9, Section 6.3), 
Cauchy’s integral theorem applies. By Eq. (6.42), 



-dz = 0, 


where C is the original outer contour and Ci is the circle surrounding the point zo traversed 
in a counterclockwise direction. Fet z = Zo + re' 6 , using the polar representation because 
of the circular shape of the path around zo- Here r is small and will eventually be made to 
approach zero. We have (with dz = ire" 6 dO from Eq. (6.27a)) 

if I^dz=i f(Z0+ f\ie i6 d0. 

Jc 2 Z - ZO Jc 2 re 

Taking the limit as r -> 0, we obtain 


f ML 

JC 2 ^ ^0 


dz = if(zo) 



dd — 2nif(zo), 


(6.45) 
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y 



Figure 6.11 Exclusion of a 
singular point. 


since f(z) is analytic and therefore continuous at z = Zo- This proves the Cauchy integral 
formula. 

Here is a remarkable result. The value of an analytic function f(z.) is given at an interior 
point z — zo once the values on the boundary C are specified. This is closely analogous to 
a two-dimensional form of Gauss’ law (Section 1.14) in which the magnitude of an interior 
line charge would be given in terms of the cylindrical surface integral of the electric field E. 

A further analogy is the determination of a function in real space by an integral of the 
function and the corresponding Green’s function (and their derivatives) over the bounding 
surface. Kirchhoff diffraction theory is an example of this. 

It has been emphasized that zo is an interior point. What happens if zo is exterior to C? 
In this case the entire integrand is analytic on and within C. Cauchy’s integral theorem. 
Section 6.3, applies and the integral vanishes. We have 

1 / f(z)dz _ I /(zo), zo interior 

2iti J c z — zo 10, Zo exterior. 


Derivatives 


Cauchy’s integral formula may be used to obtain an expression for the derivative of /(z). 
From Eq. (6.43), with /(z) analytic, 

/(zo-Hazo)-/^) = _J_ / / f(z) dz _ f /<z> (l \ 

Szo 2ni8zo\J z-zo~8zo J z-zo / 

Then, by definition of derivative (Eq. (6.14)), 


/'(zo) 


1 

lim - 

<5z 0 ^o 2jti8zo 


Szof(z) 

(z - zo - <5z 0 )(z - zo) 


dz 


1 

2ni 


/(z) 

(z - zo) 2 


dz. 


(6.46) 


This result could have been obtained by differentiating Eq. (6.43) under the integral sign 
with respect to zo- This formal, or turning-the-crank, approach is valid, but the justification 
for it is contained in the preceding analysis. 
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This technique for constructing derivatives may be repeated. We write f'(zo + <5zo) 
and f'(z o), using Eq. (6.46). Subtracting, dividing by 5zo, and finally taking the limit as 
<5zo —*■ 0, we have 


/ ( 2 ) (zo) 


2 

2jti 


f(z)dz 
(z - zo) 3 ' 


Note that f i2) (zo ) is independent of the direction of <5zo, as it must be. Continuing, we 
get 10 


f W (z 0 ) 


n\ 

Ini 


f(z)dz 
(z - zo)" +1 ’ 


(6.47) 


that is, the requirement that f(z) be analytic guarantees not only a first derivative but 
derivatives of all orders as well! The derivatives of f(z) are automatically analytic. Notice 
that this statement assumes the Goursat version of the Cauchy integral theorem. This is also 
why Goursat’s contribution is so significant in the development of the theory of complex 
variables. 


Morera’s Theorem 


A further application of Cauchy’s integral formula is in the proof of Morera’s theorem, 
which is the converse of Cauchy’s integral theorem. The theorem states the following: 


If a function f(z) is continuous in a simply connected region R and 

fc f(z) dz, — 0 for every closed contour C within R, then /(z) is analytic 

throughout R. 


Let us integrate f(z) from zi to Z2- Since every closed-path integral of /(z) vanishes, 
the integral is independent of path and depends only on its endpoints. We label the result 
of the integration F(z), with 

F(z 2 )-F(zi)= r f(z)dz. (6.48) 

Jzi 


As an identity. 


F{zf)-F{zi) f(zi)]dt 

- J(z i ) =- 

Z2~Zl Z2~Zl 


(6.49) 


using t as another complex variable. Now we take the limit as Z2 —>■ zi: 


lim 

Z2^Zl 


Z2 ~ Z 1 


(6.50) 


10 This expression is the starting point for defining derivatives of fractional order. See A. Erdelyi (ed.), Tables of Integral 
Transforms, Vol. 2. New York: McGraw-Hill (1954). For recent applications to mathematical analysis, see T. J. Osier, An integral 
analogue of Taylor’s series and its use in computing Fourier transforms. Math. Comput. 26: 449 (1972), and references therein. 
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since /(f) is continuous. 11 Therefore 

lim -= F (z)__ 7l = /(zt) (6.51) 

Z2-S-Z1 Z2 — Zl Z ~ Z1 

by definition of derivative (Eq. (6.14)). We have proved that F'{z) at z = zt exists and 
equals /(zi). Since z\ is any point in R, we see that F(z) is analytic. Then by Cauchy’s 
integral formula (compare Eq. (6.47)), F'{z ) = f(z) is also analytic, proving Morera’s 
theorem. 

Drawing once more on our electrostatic analog, we might use f (z.) to represent the 
electrostatic field E. If the net charge within every closed region in R is zero (Gauss’ 
law), the charge density is everywhere zero in R. Alternatively, in terms of the analysis of 
Section 1.13, f(z) represents a conservative force (by definition of conservative), and then 
we find that it is always possible to express it as the derivative of a potential function F(z). 

An important application of Cauchy’s integral formula is the following Cauchy inequal¬ 
ity. If /'(-) = a n z n is analytic and bounded, \f(z)\ < M on a circle of radius r about 
the origin, then 


\a n \r n < M (Cauchy’s inequality) 


(6.52) 


gives upper bounds for the coefficients of its Taylor expansion. To prove Eq. (6.52) let us 
define M(r ) = max| : | =r |/(z)| and use the Cauchy integral for a n : 


1 

2jt 


l 


f(z) 


Izl =r Z‘ 


n+1 


dz 


< M(r) 


2nr 

2jtr" +l 


An immediate consequence of the inequality (6.52) is Liouville’s theorem: If f(z.) is 
analytic and bounded in the entire complex plane it is a constant. In fact, if | /(z) | < M for 
all z, then Cauchy’s inequality (6.52) gives \a n \ < Mr~ n —> 0 as r —> oo for n > 0. Hence 
/(z) = ao- 

Conversely, the slightest deviation of an analytic function from a constant value implies 
that there must be at least one singularity somewhere in the infinite complex plane. Apart 
from the trivial constant functions, then, singularities are a fact of life, and we must learn 
to live with them. But we shall do more than that. We shall next expand a function in a 
Laurent series at a singularity, and we shall use singularities to develop the powerful and 
useful calculus of residues in Chapter 7. 

A famous application of Liouville’s theorem yields the fundamental theorem of alge¬ 
bra (due to C. F. Gauss), which says that any polynomial P(z) = Yl"=o a vZ v with n > 0 
and a n / 0 has n roots. To prove this, suppose P(z ) has no zero. Then I /P(z) is analytic 
and bounded as |z| —»• oo. Hence P(z) is a constant by Liouville’s theorem, q.e.a. Thus, 
P(z) has at least one root that we can divide out. Then we repeat the process for the re¬ 
sulting polynomial of degree n — 1. This leads to the conclusion that P(z) has exactly n 
roots. 


11 We quote the mean value theorem of calculus here. 
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Exercises 

6.4.1 


6.4.2 

6.4.3 

6.4.4 

6.4.5 

6.4.6 


6.4.7 


Show that 


(z - zo) n dz = 



n = — 1, 
n/-l, 


where the contour C encircles the point z = Zo in a positive (counterclockwise) sense. 
The exponent n is an integer. See also Eq. (6.27a). The calculus of residues. Chapter 7, 
is based on this result. 


Show that 


1 

2 ni 


z m - n ~ l dz, 


m and n integers 


(with the contour encircling the origin once counterclockwise) is a representation of the 
Kronecker S mn . 


Solve Exercise 6.3.4 by separating the integrand into partial fractions and then applying 
Cauchy’s integral theorem for multiply connected regions. 

Note. Partial fractions are explained in Section 15.8 in connection with Laplace trans¬ 
forms. 


Evaluate 


where C is the circle |z| =2. 


dz 

z 2 - r 


Assuming that f(z) is analytic on and within a closed contour C and that the point zo 
is within C, show that 


,f(z) 

C Z — Zo 


dz = 


m 

C (z- zo) 2 


dz. 


You know that f(z.) is analytic on and within a closed contour C. You suspect that the 
nth derivative /("’(zo) is given by 


/ (n) (zo) = 


m 


rdz. 


2jri Tc (z - zo )" +1 
Using mathematical induction, prove that this expression is correct. 


(a) A function f{z) is analytic within a closed contour C (and continuous on C). If 
f(z)^ 0 within C and | f(z)\ < M on C, show that 

| /(z) | <M 

for all points within C. 

Hint. Consider w(z) — l//(z). 

(b) If f(z) =0 within the contour C, show that the foregoing result does not hold 
and that it is possible to have |/(z)| = 0 at one or more points in the interior with 
|/(z)| >0 over the entire bounding contour. Cite a specific example of an analytic 
function that behaves this way. 
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6.4.8 Using the Cauchy integral formula for the nth derivative, convert the following Ro¬ 
drigues formulas into the corresponding so-called Schlaefli integrals. 


(a) Legendre: 


Pn (x) = 


— — ft 2 
2 "n\ dx n 


!)"■ 


ANS. 


(-D” 

2 " 


1 

2 7i i 


(i -z 2 r . 

(z-.r )" +1 Z ' 


(b) Hermite: 


2 d" 2 

H„(x) = (-\) n e x —e~ x . 


(c) Laguerre: 


L n (.r) 


e x d n 
n\ dx n 




Note. From the Schlaefli integral representations one can develop generating functions 
for these special functions. Compare Sections 12.4, 13.1, and 13.2. 


6.5 Laurent Expansion 


Taylor Expansion 


The Cauchy integral formula of the preceding section opens up the way for another deriva¬ 
tion of Taylor’s series (Section 5.6), but this time for functions of a complex variable. 
Suppose we are trying to expand f(z) about z — Z o and we have z = zi as the nearest point 
on the Argand diagram for which f (z.) is not analytic. We construct a circle C centered at 
z = zo with radius less than \zi — zoI (Fig- 6.12). Since z\ was assumed to be the nearest 
point at which f(z) was not analytic, f(z) is necessarily analytic on and within C. 

From Eq. (6.43), the Cauchy integral formula. 


/(z) = 


_L I 

2 Tti Jc z! — z 


1 I f(z')dz' 

2ni J c (z' - zo) -(z- zo) 


1 

2 ni 

Here z! is a point on the contour C and z is any point interior to C. It is not legal yet to 
expand the denominator of the integrand in Eq. (6.53) by the binomial theorem, for we have 
not yet proved the binomial theorem for complex variables. Instead, we note the identity 


Hz')dz' 


c (z r - zo)[l - (z - zo)/(z' - zo)] 


(6.53) 


— l + t + t 2 + f +- 


n =0 


(6.54) 
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3z 



Figure 6.12 Circular domain for Taylor 
expansion. 


which may easily be verified by multiplying both sides by 1 — t. The infinite series, fol¬ 
lowing the methods of Section 5.2, is convergent for \t\ < 1. 

Now, for a point z interior to C, |z — zo| < \z' — zol, and, using Eq. (6.54), Eq. (6.53) 
becomes 


m = 


1 I V (z - zof/feVz' 

2iri Jc , (z' -zo)" +1 

n=() 


(6.55) 


Interchanging the order of integration and summation (valid because Eq. (6.54) is uni¬ 
formly convergent for \t\ < 1), we obtain 


n =0 


f(z')dz' 


■ zo) 


n +1 


Referring to Eq. (6.47), we get 


f(z) = X> - zoY 


f (n Hz o) 


n =0 


(6.56) 


(6.57) 


which is our desired Taylor expansion. Note that it is based only on the assumption that 
/(z) is analytic for |z — zol < |zi — zol- J ust as for real variable power series (Section 5.7), 
this expansion is unique for a given zo- 

From the Taylor expansion for /(z) a binomial theorem may be derived (Exercise 6.5.2). 


Schwarz Reflection Principle 

From the binomial expansion of g(z) — (z — xq)" for integral n it is easy to see that the 
complex conjugate of the function g is the function of the complex conjugate for real xo- 

8*(z) = [(z - xo)"]* = (z* - xo)" = g(z*). 


(6.58) 



432 Chapter 6 Functions of a Complex Variable I 



This leads us to the Schwarz reflection principle: 

If a function f (z) is (1) analytic over some region including the real axis and 
(2) real when z is real, then 

f*(z) = f(z*f. (6.59) 

(See Fig. 6.13.) 

Expanding /'(") about some (nonsingular) point .to on the real axis, 

°° f( n )( rn 'i 

f(z) = Yfz-xofl —-— (6.60) 

z —' n\ 

n= 0 

by Eq. (6.56). Since f(z) is analytic at z = .to, this Taylor expansion exists. Since f(z) is 
real when z is real, /'"’(.to) must be real for all n. Then when we use Eq. (6.58), Eq. (6.59), 
the Schwarz reflection principle, follows immediately. Exercise 6.5.6 is another form of this 
principle. This completes the proof within a circle of convergence. Analytic continuation 
then permits extending this result to the entire region of analyticity. 

Analytic Continuation 

It is natural to think of the values /(z) of an analytic function / as a single entity, which is 
usually defined in some restricted region Si of the complex plane, for example, by a Taylor 
series (see Fig. 6.14). Then / is analytic inside the circle of convergence C i, whose radius 
is given by the distance r i from the center of C\ to the nearest singularity of / at zi (in 
Fig. 6.14). A singularity is any point where / is not analytic. If we choose a point inside C\ 
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Figure 6.14 Analytic continuation. 


that is farther than n from the singularity zi and make a Taylor expansion of / about it (zi 
in Fig. 6.14), then the circle of convergence, C 2 will usually extend beyond the first circle, 
Ci. In the overlap region of both circles, C 1 , C 2 , the function / is uniquely defined. In 
the region of the circle C 2 that extends beyond C 1 , f(z) is uniquely defined by the Taylor 
series about the center of C 2 and is analytic there, although the Taylor series about the 
center of Ci is no longer convergent there. After Weierstrass this process is called analytic 
continuation. It defines the analytic functions in terms of its original definition (in C 1 , 
say) and all its continuations. 

A specific example is the function 

(6.61) 

1 +z 

which has a (simple) pole at z = — 1 and is analytic elsewhere. The geometric series ex¬ 
pansion 

1 OO 

--= l-j+. 2 + --- = y(-z)" (6.62) 

1 +z „ 

n =0 

converges for |z| < 1, that is, inside the circle C 1 in Fig. 6.14. 

Suppose we expand f(z) about z — i, so 


f(z) = 


1+z 1 + * + (z —/) (1 + 0(1 + (z — 0/(1 + 0) 


= 'i_izi 

1 + i 


iz - i f 

(1 + 0 2 


converges for \z — i\ < |1 + i\ = \/2. Our circle of convergence is C 2 in Fig. 6.14. Now 
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Figure 6.15 \z' - zolci > I z — zol; I z' - zolc 2 < \z — zol- 


f(z) is defined by the expansion (6.63) in 53, which overlaps S i and extends further out 
in the complex plane. 12 This extension is an analytic continuation, and when we have 
only isolated singular points to contend with, the function can be extended indefinitely. 
Equations (6.61), (6.62), and (6.63) are three different representations of the same function. 
Each representation has its own domain of convergence. Equation (6.62) is a Maclaurin 
series. Equation (6.63) is a Taylor expansion about z — i and from the following paragraphs 
Eq. (6.61) is seen to be a one-term Laurent series. 

Analytic continuation may take many forms, and the series expansion just considered 
is not necessarily the most convenient technique. As an alternate technique we shall use a 
functional relation in Section 8.1 to extend the factorial function around the isolated sin¬ 
gular points z = —n, n = 1,2, 3,_As another example, the hypergeometric equation is 

satisfied by the hypergeometric function defined by the series, Eq. (13.115), for kl < i. 
The integral representation given in Exercise 13.4.7 permits a continuation into the com¬ 
plex plane. 


12 One of the most powerful and beautiful results of the more abstract theory of functions of a complex variable is that if two 
analytic functions coincide in any region, such as the overlap of Si and S 2 , or coincide on any line segment, they are the same 
function, in the sense that they will coincide everywhere as long as they are both well defined. In this case the agreement of the 
expansions (Eqs. (6.62) and (6.63)) over the region common to Si and S 2 would establish the identity of the functions these 
expansions represent. Then Eq. (6.63) would represent an analytic continuation or extension of f{z) into regions not covered 
by Eq. (6.62). We could equally well say that f(z) = 1/(1 + z) is itself an analytic continuation of either of the series given by 
Eqs. (6.62) and (6.63). 
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Laurent Series 


We frequently encounter functions that are analytic and single-valued in an annular region, 
say, of inner radius r and outer radius R, as shown in Fig. 6.15. Drawing an imaginary 
contour line to convert our region into a simply connected region, we apply Cauchy’s 
integral formula, and for two circles C 2 and C 1 centered at z = so and with radii >'2 and r \, 
respectively, where r < < r\ < R, we have 13 


f(z) = 



f(z')dz' 
z! - z 


_L 1 /aw 

2 ni Jc 2 z' -z 


(6.64) 


Note that in Eq. (6.64) an explicit minus sign has been introduced so that the contour 
C 2 (like Ci) is to be traversed in the positive (counterclockwise) sense. The treatment of 
Eq. (6.64) now proceeds exactly like that of Eq. (6.53) in the development of the Taylor 
series. Each denominator is written as (z' — zo) — (z — zo) and expanded by the binomial 
theorem, which now follows from the Taylor series (Eq. (6.57)). 

Noting that for Ci, | z' — zol > |z — zo I while for C 2 , | z' — zo I < |z — zol- we find 


^ J Ci (z 7 - zo)" 


+T 


/i=i 




C 2 


(6.65) 


The minus sign of Eq. (6.64) has been absorbed by the binomial expansion. Labeling the 
first series Si and the second S 2 we have 


Si 




n=0 


f(z')dz' 

Cl (z' - ^o)" +1 ’ 


( 6 . 66 ) 


which is the regular Taylor expansion, convergent for |z — zo| < \z! — zo = ri, that is, for 
all z interior to the larger circle, Ci. For the second series in Eq. (6.65) we have 

1 00 r 

S 2 = — Y(Z - z 0 r n <b (z! - z 0 ) n - l f(z')dz’, (6.67) 

27 u *—! Jc , 


convergent for |z — zol > z! — zo I = r2, that is, for all z exterior to the smaller circle, Ci. 
Remember, C 2 now goes counterclockwise. 

These two series are combined into one series 14 (a Laurent series) by 


OO 

f(z) = Y a n(z-Z0)", 

n =—00 


( 6 . 68 ) 


13 We may take r 2 arbitrarily close to r and r\ arbitrarily close to R, maximizing the area enclosed between C\ and C 2 - 
14 Replace n by —n in S 2 and add. 
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where 


_ J_ / f(z')dz' 

2ni fc (z! - zo)" +1 


(6.69) 


Since, in Eq. (6.69), convergence of a binomial expansion is no longer a problem, C may 
be any contour within the annular region r < \z — zol < R encircling zo once in a counter¬ 
clockwise sense. If we assume that such an annular region of convergence does exist, then 
Eq. (6.68) is the Laurent series, or Laurent expansion, of /(z). 

The use of the contour line (Fig. 6.15) is convenient in converting the annular region 
into a simply connected region. Since our function is analytic in this annular region (and 
single-valued), the contour line is not essential and, indeed, does not appear in the final 
result, Eq. (6.69). 

Laurent series coefficients need not come from evaluation of contour integrals (which 
may be very intractable). Other techniques, such as ordinary series expansions, may pro¬ 
vide the coefficients. 

Numerous examples of Laurent series appear in Chapter 7. We limit ourselves here to 
one simple example to illustrate the application of Eq. (6.68). 


Example 6.5.1 Laurent Expansion 


Let /(z) = [z(z — 1)] 1 . If we choose zo = 0, then r — 0 and R = 1, /(z) diverging at 
Z = 1. A partial fraction expansion yields the Laurent series 


1 _ 1 i 

z(z — 1) 1 — z z 



OO 

(6-70) 

n=— 1 


From Eqs. (6.70), (6.68), and (6.69) we then have 

1 / dz' j — 1 for«>— 1, 

" 2ni J (z'')" _l_2 (z / — 1) |0 fornc— 1. 


(6.71) 


The integrals in Eq. (6.71) can also be directly evaluated by substituting the geometric- 
series expansion of (1 — z') _1 used already in Eq. (6.70) for (1 — z) _1 : 


a n — 



X>'> 

m =0 


dz r 

(z’) n+2 ’ 


(6.72) 


Upon interchanging the order of summation and integration (uniformly convergent series), 
we have 


n 


i 

2ni 



dz! 


(^/)n+2—m ' 


a } 


(6.73) 
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If we employ the polar form, as in Eq. (6.47) (or compare Exercise 6.4.1), 





rie w dO 

yti-\-2—m gi (n+2—m)Q 


j uu 

= -z—r • 27 ri Y' S n+ 2 - m ,i, (6.74) 

2tti ' 

m =0 

which agrees with Eq. (6.71). ■ 

The Laurent series differs from the Taylor series by the obvious feature of negative 
powers of (z. — zo). For this reason the Laurent series will always diverge at least at z = Zo 
and perhaps as far out as some distance r (Fig. 6.15). 


Exercises 


6.5.1 

6.5.2 

6.5.3 

6.5.4 

6.5.5 

6.5.6 


Develop the Taylor expansion of ln(l + z). 


ANS. V(-l)" -1 —. 

^' n 


n —1 


Derive the binomial expansion 


m(m — 1) 2 


(1 + z) m = 1 + mz + ~" v 1 " z z 1 H- = Y 


1-2 


n =0 


for m any real number. The expansion is convergent for |z| < 1. Why? 


A function f(z) is analytic on and within the unit circle. Also, |/(z)| < 1 for |z| < 1 
and /(0) = 0. Show that |/(z)| < |z| for |z| < 1. 

Hint. One approach is to show that /(z)/z is analytic and then to express [/(zo)/^o]" 
by the Cauchy integral formula. Finally, consider absolute magnitudes and take the nth 
root. This exercise is sometimes called Schwarz’s theorem. 


If /(z) is a real function of the complex variable z = x + iy , that is, if f(pc) — f*(x), 
and the Laurent expansion about the origin, /(z) = «„ z", has a„ = 0 for n < — N, 

show that all of the coefficients a n are real. 

Hint. Show that z N /(z) is analytic (via Morera’s theorem. Section 6.4). 

A function /(z) = u(x, y) + iv(x, y) satisfies the conditions for the Schwarz reflection 
principle. Show that 

(a) u is an even function of y. (b) v is an odd function of y. 

A function /(z) can be expanded in a Laurent series about the origin with the coeffi¬ 
cients a n real. Show that the complex conjugate of this function of z is the same function 
of the complex conjugate of z; that is, 

r (z) = nz*). 

Verify this explicitly for 

(a) /(z) = z", n an integer, (b) /(z) = sinz. 

If f(z) — iz (a i = i), show that the foregoing statement does not hold. 



438 Chapter 6 Functions of a Complex Variable I 


6.5.7 The function f(z) is analytic in a domain that includes the real axis. When z is real 
(z — x ), f(x) is pure imaginary. 

(a) Show that 

nz*) = -[m]*. 

(b) For the specific case f(z) = iz, develop the Cartesian forms of f(z), /(z*), and 
/*(z). Do not quote the general result of part (a). 

6.5.8 Develop the first three nonzero terms of the Laurent expansion of 

/(z) = (e z - l) -1 

about the origin. Notice the resemblance to the Bernoulli number-generating function, 
Eq. (5.144) of Section 5.9. 

6.5.9 Prove that the Laurent expansion of a given function about a given point is unique; that 
is, if 

oo oo 

/(z) = a n(z-Zo) n = ^2 Mz-zo)”, 

n=—N n=—N 

show that a n — b n for all n. 

Hint. Use the Cauchy integral formula. 

6.5.10 (a) Develop a Laurent expansion of f(z) = [z(z — 1)] —1 about the point z = 1 valid 

for small values of \z — 1|. Specify the exact range over which your expansion 
holds. This is an analytic continuation of Eq. (6.70). 

(b) Determine the Laurent expansion of /(z) about z = 1 but for |z — 11 large. 

Hint. Partial fraction this function and use the geometric series. 

6.5.11 (a) Given/i(z) = / 0 °° e~ zt dt (with t real), show that the domain in which /i(z) exists 

(and is analytic) is JH(z) > 0. 

(b) Show that / 2 (z) = 1/z equals f\ (z) over SH(z) >0 and is therefore an analytic 
continuation of f\ (z) over the entire z-plane except for z = 0. 

(c) Expand 1/z about the point z — i. You will have //(z) = 12^Lo a n(z — i) n . What 
is the domain of //(z)? 

j OO 

ANS. - = -iTi"(z-i)", |z — i| < 1. 

z z —' 

n= 0 


6.6 Singularities 

The Laurent expansion represents a generalization of the Taylor series in the presence of 
singularities. We define the point zo as an isolated singular point of the function /(z) if 
/(z) is not analytic at z = zo but is analytic at all neighboring points. 
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Poles 


In the Laurent expansion of f(z.) about so, 

OO 

f(z) = J2 a m{z-zo) m , (6.75) 

777=—OO 


if a m — 0 for m < —n < 0 and ^ 0, we say that z o is a pole of order n. For instance, if 
n — 1, that is, if a_i/(s — so) is the first nonvanishing term in the Laurent series, we have 
a pole of order 1, often called a simple pole. 

If, on the other hand, the summation continues to m = — oo, then z o is a pole of infi¬ 
nite order and is called an essential singularity. These essential singularities have many 
pathological features. For instance, we can show that in any small neighborhood of an 
essential singularity of f(z) the function f(z) comes arbitrarily close to any (and there¬ 
fore every) preselected complex quantity wq- 15 Here, the entire w -plane is mapped by 
/ into the neighborhood of the point so- One point of fundamental difference between a 
pole of finite order n and an essential singularity is that by multiplying f (z.) by (z. — so)", 
f (s)(s — so)" is no longer singular at so- This obviously cannot be done for an essential 
singularity. 

The behavior of /(s) as s —*■ oo is defined in terms of the behavior of /(1/f) as t -* 0. 
Consider the function 


OO 

sins = ^ 

n =0 


(— l) n Z 2n+1 
(2n + 1)! 


As z oo, we replace the z by l/t to obtain 


sin 


oo 


E 

77=0 


(-D" 

(2 n + l)!t 2 " +1 ' 


(6.76) 


(6.77) 


From the definition, sins has an essential singularity at infinity. This result could be antic¬ 
ipated from Exercise 6.1.9 since 


sin s = sin iy — i sinh y, when x — 0, 

which approaches infinity exponentially as y —> oo. Thus, although the absolute value of 
sin.v for real x is equal to or less than unity, the absolute value of sins is not bounded. 

A function that is analytic throughout the finite complex plane except for isolated poles 
is called meromorphic, such as ratios of two polynomials or tans, cots. Examples are 
also entire functions that have no singularities in the finite complex plane, such as exp(s), 
sins, coss (see Sections 5.9, 5.11). 


1 ^ Til is theorem is due to Picard. A proof is given by E. C. Titchmarsh, The Theory of Functions, 2nd ed. New York: Oxford 
University Press (1939). 
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Branch Points 

There is another sort of singularity that will be important in Chapter 7. Consider 

f(z) = z a , 

in which a is not an integer. 16 As z moves around the unit circle from e° to e 2jTl , 

f(z) —»■ e 2nai ^ e 0 a = 1, 

for nonintegral a. We have a branch point at the origin and another at infinity. If we set 
z—l/t, a similar analysis of f(z) for t —* 0 shows that t = 0; that is, z = oo is also a 
branch point. The points e 0 ' and e 2nl in the z-plane coincide, but these coincident points 
lead to different values of f{z)\ that is, f(z) is a multivalued function. The problem 
is resolved by constructing a cut line joining both branch points so that f(z) will be 
uniquely specified for a given point in the z-plane. For z a , the cut line can go out at any 
angle. Note that the point at infinity must be included here; that is, the cut line may join 
finite branch points via the point at infinity. The next example is a case in point. If a — p/q 
is a rational number, then q is called the order of the branch point, because one needs to go 
around the branch point q times before coming back to the starting point. If a is irrational, 
then the order of the branch point is infinite, just as for the logarithm. 

Note that a function with a branch point and a required cut line will not be continuous 
across the cut line. Often there will be a phase difference on opposite sides of this cut line. 
Hence line integrals on opposite sides of this branch point cut line will not generally cancel 
each other. Numerous examples of this case appear in the exercises. 

The contour line used to convert a multiply connected region into a simply connected 
region (Section 6.3) is completely different. Our function is continuous across that contour 
line, and no phase difference exists. 


Example 6.6.1 Branch Points of Order 2 
Consider the function 

Hz) = {z 2 - 1) 1/2 = (z + l) 1/2 (z - 1) 1/2 . (6.78) 

The first factor on the right-hand side, (z + 1) 1 / 2 , has a branch point at z = — 1 • The second 
factor has a branch point at z — +1- At infinity /(z) has a simple pole. This is best seen 
by substituting z = 1/f and making a binomial expansion at 1 = 0: 

C - T ' 2 =jo - < 2 , 1/2 =} E (‘f ) ( -»"> 2 " = ■ 

n =0 V 7 

The cut line has to connect both branch points, so it is not possible to encircle either branch 
point completely. To check on the possibility of taking the line segment joining z = +1 and 


16 z = 0 is a singular point, for z a has only a finite number of derivatives, whereas an analytic function is guaranteed an infinite 
number of derivatives (Section 6.4). The problem is that f(z ) is not single-valued as we encircle the origin. The Cauchy integral 
formula may not be applied. 
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Figure 6.16 Branch cut and phases of Table 6.1. 


Table 6.1 Phase Angle 


Point 

e 

V 

e+(p 

2 

1 

0 

0 

0 

2 

0 

7T 

JT 

2 

3 

0 

JT 

JT 

2 

4 

7r 

71 

71 

5 

2n 

71 

3jt 

2 

6 

2tt 

71 

3 JT 

2 

7 

2 71 

2 71 

2tt 


z = — 1 as a cut line, let us follow the phases of these two factors as we move along the 
contour shown in Fig. 6.16. 

For convenience in following the changes of phase let z + 1 = re' e and z — 1 = pe lip . 
Then the phase of /(z) is ( 6 + q>) /2. We start at point 1, where both z+ 1 and z— 1 have a 
phase of zero. Moving from point 1 to point 2, <p, the phase of z — 1 = pe ,(p , increases by tt . 
(z — 1 becomes negative.) cp then stays constant until the circle is completed, moving from 
6 to 7. 0, the phase of z + 1 = re ,e , shows a similar behavior, increasing by lit as we move 
from 3 to 5. The phase of the function /(z) = (z + I )’/ 2 (z — l) 1 / 2 = r 1 / 2 p l / 2 e PS+(p )/2 j s 
(6 + <p)/2. This is tabulated in the final column of Table 6.1. 

Two features emerge: 

1. The phase at points 5 and 6 is not the same as the phase at points 2 and 3. This 
behavior can be expected at a branch cut. 

2. The phase at point 7 exceeds that at point 1 by 27r, and the function f(z) — (z 2 — l) 1 / 2 
is therefore single-valued for the contour shown, encircling both branch points. 

If we take the x-axis, — 1 < x < 1, as a cut line, /(z) is uniquely specified. Alternatively, 
the positive v-axis for x > I and the negative x-axis for x < — 1 may be taken as cut lines. 
The branch points cannot be encircled, and the function remains single-valued. These two 
cut lines are, in fact, one branch cut from —1 to +1 via the point at infinity. ■ 

Generalizing from this example, we have that the phase of a function 

/(Z) = /1(Z)-/2(Z)-/3(Z)-" 
is the algebraic sum of the phase of its individual factors: 

arg / (z) = arg /i (z) + arg f 2 (z) + arg / 3 (z) H-. 
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The phase of an individual factor may be taken as the arctangent of the ratio of its imaginary 
part to its real part (choosing the appropriate branch of the arctan function tan -1 y/x, which 
has infinitely many branches). 


arg/i(z) = tan 



For the case of a factor of the form 


fi(.z) = (z-zo), 

the phase corresponds to the phase angle of a two-dimensional vector from +zo to z, the 
phase increasing by 2n as the point +zo is encircled. Conversely, the traversal of any 
closed loop not encircling z o does not change the phase of z — zq. 


Exercises 


6.6.1 


6.6.2 


6.6.3 


6.6.4 


The function f(z) expanded in a Laurent series exhibits a pole of order m at z = zo. 
Show that the coefficient of (z — zo) -1 , fl-i, is given by 


with 


1 


<7-1 = 


(m — 1)! dz 


d m ~ l 

rr[(z-zo) m /(z)] z= 


ZO 


fl-l = [(z-zo)/(z)] z=ZQ , 

when the pole is a simple pole (m = 1). These equations for a_i are extremely useful 
in determining the residue to be used in the residue theorem of Section 7.1. 

Hint. The technique that was so successful in proving the uniqueness of power series, 
Section 5.7, will work here also. 


A function /'(") can be represented by 


/(z) = 


fl (z) 
flizy 


in which f\ (z) and fz(z) are analytic. The denominator, f 2 (z), vanishes at z = Zo, 
showing that f(z) has a pole at z = zo- However, /i(zo) Y 0- /t(zo) Y 0. Show that 
a- 1 , the coefficient of (z. — zo) -1 in a Laurent expansion of f(z) at z = Zo, is given by 


fl_i = 


/i (zo) 

flizoY 


(This result leads to the Heaviside expansion theorem. Exercise 15.12.11.) 


In analogy with Example 6.6.1, consider in detail the phase of each factor and the resul¬ 
tant overall phase of f(z ) = (z 2 + I) 1/2 following a contour similar to that of Fig. 6.16 
but encircling the new branch points. 


The Legendre function of the second kind, Q v (z), has branch points at z = ±1. The 
branch points are joined by a cut line along the real ( x ) axis. 
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(a) Show that Qq(z ) = ^ ln((z + l)/(z — 1)) is single-valued (with the real axis —1 < 
x < 1 taken as a cut line). 

(b) For real argument x and \x\ < 1 it is convenient to take 


Qo(x ) = In 


1 +x 

1 — X 


Show that 

Qo(x ) = \ [Qq(x + ;0) + Q 0 (x - t'O)]. 

Here x + i0 indicates that z approaches the real axis from above, and x — i 0 indi¬ 
cates an approach from below. 


6.6.5 As an example of an essential singularity, consider e l ' z as z approaches zero. For any 
complex number zo, Zo ^ 0, show that 

e 1/z = zo 

has an infinite number of solutions. 


6.7 Mapping 

In the preceding sections we have defined analytic functions and developed some of their 
main features. Here we introduce some of the more geometric aspects of functions of com¬ 
plex variables, aspects that will be useful in visualizing the integral operations in Chapter 7 
and that are valuable in their own right in solving Laplace’s equation in two-dimensional 
systems. 

In ordinary analytic geometry we may take y = f (x) and then plot y versus x. Our 
problem here is more complicated, for z is a function of two variables, x and y. We use the 
notation 


w — /(z) = u(x, y) + iv(x, y). (6.79) 

Then for a point in the z-plane (specific values for x and y) there may correspond specific 
values for u(x, y) and v(x , y) that then yield a point in the m>- plane. As points in the 
Z-plane transform, or are mapped into points in the 10 -plane, lines or areas in the z-plane 
will be mapped into lines or areas in the w;-plane. Our immediate purpose is to see how 
lines and areas map from the z-plane to the w;-plane for a number of simple functions. 


Translation 


w — z + zo- (6.80) 

The function w is equal to the variable z plus a constant, zo — x o + z'vo- By Eqs. (6.1) and 
(6.79), 

u — x + xq, v = y + >’o, (6.81) 


representing a pure translation of the coordinate axes, as shown in Fig. 6.17. 
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Figure 6.17 Translation. 


Rotation 

w = zzo ■ (6.82) 

Here it is convenient to return to the polar representation, using 

w — pe' v , z = re ,e , and zo — f'oe l6 °, (6.83) 

then 

pe ilf, = rroe i((>+0o> , (6.84) 

or 

p — rr 0 , (p = 9 + 9 q. (6.85) 

Two things have occurred. First, the modulus r has been modified, either expanded or 
contracted, by the factor vq. Second, the argument 9 has been increased by the additive 
constant 9q (Fig. 6.18). This represents a rotation of the complex variable through an angle 
9q. For the special case of zo = i, we have a pure rotation through jt/ 2 radians. 



Figure 6.18 Rotation. 
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Inversion 


Again, using the polar form, we have 


pe 


i<f 





which shows that 

1 

P=~, <p = -6. 
r 


( 6 . 86 ) 


(6.87) 

( 6 . 88 ) 


The first part of Eq. (6.87) shows that inversion clearly. The interior of the unit circle 
is mapped onto the exterior and vice versa (Fig. 6.19). In addition, the second part of 
Eq. (6.87) shows that the polar angle is reversed in sign. Equation (6.88) therefore also 
involves a reflection of the y-axis, exactly like the complex conjugate equation. 

To see how curves in the /-plane transform into the w-plane, we return to the Cartesian 
form: 

1 

u+i v— -. (6.89) 

x + iy 


Rationalizing the right-hand side by multiplying numerator and denominator by z* and 
then equating the real parts and the imaginary parts, we have 


v — 


x- + y 1 

y 


x- + y- 


u 2 + v 2 ’ 
v 


y = - 


u z + v- 


(6.90) 


v 




Figure 6.19 


Inversion. 






Figure 6.20 Inversion, line o- circle. 
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Branch Points and Multivalent Functions 


The three transformations just discussed have all involved one-to-one correspondence of 
points in the 7-plane to points in the w-plane. Now to illustrate the variety of transfor¬ 
mations that are possible and the problems that can arise, we introduce first a two-to-one 
correspondence and then a many-to-one correspondence. Finally, we take up the inverses 
of these two transformations. 

Consider first the transformation 

w = z 2 , (6.96) 

which leads to 

p = ,- 2 , cp — 20. (6.97) 

Clearly, our transformation is nonlinear, for the modulus is squared, but the significant 
feature of Eq. (6.96) is that the phase angle or argument is doubled. This means that the 


• first quadrant of z, 0 < 0 < — , —> upper half-plane of w, 0 < (p < Jt, 

• upper half-plane of z, 0 < 0 < it, —> whole plane of w, 0 < (p < 2n. 


The lower half-plane of z maps into the already covered entire plane of w, thus covering 
the I/’-plane a second time. This is our two-to-one correspondence, that is, two distinct 
points in the 7-plane, z o and zoe l7T — —zo, corresponding to the single point w = zjj. 

In Cartesian representation, 

u + iv = (x + iy) 2 —x 2 — y 2 + i2xy, (6.98) 

leading to 

u—x 2 - y 2 , v — 2xy. (6.99) 

Hence the lines u = ci, v = ci in the «;-plane correspond to x 2 — y 2 = ci, 2 xy = C 2 , rec¬ 
tangular (and orthogonal) hyperbolas in the z-plane (Fig. 6.21). To every point on the 
hyperbola x 2 — y 2 — c i in the right half-plane, x > 0, one point on the line u = c\ corre¬ 
sponds, and vice versa. However, every point on the line u — c\ also corresponds to a point 
on the hyperbola x 2 — y 2 — c i in the left half-plane, v < 0, as already explained. 

It will be shown in Section 6.8 that if lines in the ut-plane are orthogonal, the corre¬ 
sponding lines in the z-plane are also orthogonal, as long as the transformation is analytic. 
Since u — ci and v = cy are constructed perpendicular to each other, the corresponding 
hyperbolas in the z-plane are orthogonal. We have constructed a new orthogonal system of 
hyperbolic lines (or surfaces if we add an axis perpendicular to x and v). Exercise 2.1.3 
was an analysis of this system. It might be noted that if the hyperbolic lines are electric 
or magnetic lines of force, then we have a quadrupole lens useful in focusing beams of 
high-energy particles. 

The inverse of the fourth transformation (Eq. (6.96)) is 

1/2 


W — z 


( 6 . 100 ) 
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Figure 6.21 Mapping — hyperbolic coordinates. 


From the relation 


and 

2 <p = 6, (6.102) 

we now have two points in the w-plane (arguments <p and <p + it) corresponding to one 
point in the "-plane (except for the point z = 0). Or, to put it another way, 6 and 0 + 2n 
correspond to (p and (p + n, two distinct points in the w-plane. This is the complex variable 
analog of the simple real variable equation y 2 = x, in which two values of y, plus and 
minus, correspond to each value of x. 

The important point here is that we can make the function w of Eq. (6.100) a single¬ 
valued function instead of a double-valued function if we agree to restrict 6 to a range such 
as 0 <9 <2tc . This may be done by agreeing never to cross the line 9 — 0 in the z-plane 
(Fig. 6.22). Such a line of demarcation is called a cut line or branch cut. Note that branch 
points occur in pairs. 

The cut line joins the two branch point singularities, here at 0 and oo (for the latter, 
transform z = 1/f for t — >• 0). Any line from z — 0 to infinity would serve equally well. 
The purpose of the cut line is to restrict the argument of z. The points z and z exp(27r/) 
coincide in the z-plane but yield different points w and — w = wexp(jti) in the w-plane. 
Hence in the absence of a cut line, the function w — z 1 ,/2 is ambiguous. Alternatively, since 
the function w = z 1 / 2 is double-valued, we can also glue two sheets of the complex z- 
plane together along the branch cut so that arg(z) increases beyond 2tz along the branch 
cut and continues from 4?r on the second sheet to reach the same function values for z 
as for ze~ 47r ', that is, the start on the first sheet again. This construction is called the 
Riemann surface of w = z l,/2 . We shall encounter branch points and cut lines (branch 
cuts) frequently in Chapter 7. 

The transformation 

w = e z (6.103) 

leads to 


pe i<P = r l ' 2 e w/2 


( 6 . 101 ) 


(6.104) 
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V 

\ 


0 


Cut line 


x 


Figure 6.22 A cut line. 

or 

p = e x , <p = y. (6.105) 

If y ranges from 0 < y < 2 jt (or — n < y < tv), then (p covers the same range. But this is 
the whole w-plane. In other words, a horizontal strip in the z-plane of width 2n maps into 
the entire in-plane. Further, any point x + i(y + Inn), in which n is any integer, maps into 
the same point (by Eq. (6.104)) in the te-plane. We have a many-(infinitely many)-to-one 
correspondence. 

Finally, as the inverse of the fifth transformation (Eq. (6.103)), we have 

w — \nz- (6.106) 

By expanding it, we obtain 

u + iv = lnre ie =\nr + id. (6.107) 

For a given point zq in the z-plane the argument 0 is unspecified within an integral multiple 
of 2n. This means that 


v = 6 + 2mt, (6.108) 

and, as in the exponential transformation, we have an infinitely many-to-one correspon¬ 
dence. 

Equation (6.108) has a nice physical representation. If we go around the unit circle in 
the z-plane, r — 1, and by Eq. (6.107), u — Inr = 0; but v — 9, and 9 is steadily increasing 
and continues to increase as 9 continues past 2n. 

The cut line joins the branch point at the origin with infinity. As 9 increases past 2n 
we glue a new sheet of the complex z-plane along the cut line, etc. Going around the unit 
circle in the z-plane is like the advance of a screw as it is rotated or the ascent of a person 
walking up a spiral staircase (Fig. 6.23), which is the Riemann surface of w — In z. 

As in the preceding example, we can also make the correspondence unique (and 
Eq. (6.106) unambiguous) by restricting 9 to a range such as 0 < 9 < 2tv by taking the 
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Figure 6.23 This is the Riemann 
surface for In;, a multivalued 
function. 


line 0 = 0 (positive real axis) as a cut line. This is equivalent to taking one and only one 
complete turn of the spiral staircase. 

The concept of mapping is a very broad and useful one in mathematics. Our mapping 
from a complex "-plane to a complex w-plane is a simple generalization of one definition 
of function: a mapping of x (from one set) into y in a second set. A more sophisticated 
form of mapping appears in Section 1.15 where we use the Dirac delta function S(x — a) 
to map a function fix) into its value at the point a. Then in Chapter 15 integral transforms 
are used to map one function fix) in x-space into a second (related) function Fit) in 
f-space. 


Exercises 

6.7.1 How do circles centered on the origin in the ."-plane transform for 

(a) u>i(z) =z + (b) W 2 (z) = z — for ; ^ 0? 

z z 

What happens when |;| -> 1? 

6.7.2 What part of the "-plane corresponds to the interior of the unit circle in the u;-plane if 

(a) w = ——(b) w — ——4? 
z+i z+l 

6.7.3 Discuss the transformations 

(a) w(z) = sin;, (c) w(z) = sinh;, 

(b) w(z) — cos;, (d) w(z) — cosh;. 

Show how the lines x — c\, y — C 2 map into the w-plane. Note that the last three trans¬ 
formations can be obtained from the first one by appropriate translation and/or rotation. 
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6.7.4 Show that the function 

w(z) = (z 2 - 1) 1/2 

is single-valued if we take —1 <x< 1, y = 0 as a cut line. 

6.7.5 Show that negative numbers have logarithms in the complex plane. In particular, find 

ln(—1). 

ANS. In(—1) = in. 

6.7.6 An integral representation of the Bessel function follows the contour in the f-plane 
shown in Fig. 6.24. Map this contour into the 0-plane with t = e e . Many additional 
examples of mapping are given in Chapters 11, 12, and 13. 

6.7.7 For noninteger m, show that the binomial expansion of Exercise 6.5.2 holds only for a 
suitably defined branch of the function (1 + z ) m . Show how the z-plane is cut. Explain 
why |z| < 1 may be taken as the circle of convergence for the expansion of this branch, 
in light of the cut you have chosen. 

6.7.8 The Taylor expansion of Exercises 6.5.2 and 6.7.7 is not suitable for branches other 
than the one suitably defined branch of the function (1 + z)' n for noninteger m. [Note 
that other branches cannot have the same Taylor expansion since they must be distin¬ 
guishable.] Using the same branch cut of the earlier exercises for all other branches, 
find the corresponding Taylor expansions, detailing the phase assignments and Taylor 
coefficients. 

6.8 Conformal Mapping 

In Section 6.7 hyperbolas were mapped into straight lines and straight lines were mapped 
into circles. Yet in all these transformations one feature stayed constant. This constancy 
was a result of the fact that all the transformations of Section 6.7 were analytic. 

As long as w — f(z) is an analytic function, we have 

df dw A w 

dz dz A:—>o Az 


(6.109) 
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Figure 6.25 Conformal mapping — preservation of angles. 


Assuming that this equation is in polar form, we may equate modulus to modulus and 
argument to argument. For the latter (assuming that df/dz ^ 0), 

Aw Aw 

arg lim -= lim arg- 

Az^O A Z Az-»0 Az 


— lim arg Aw— lim arg Az = arg — = a, (6.110) 

Az—>-0 Az—*-0 dz 

where a , the argument of the derivative, may depend on z but is a constant for a fixed z, in¬ 
dependent of the direction of approach. To see the significance of this, consider two curves 
C~ in the ’-plane and the corresponding curve C w in the u;-plane (Fig. 6.25). The incre¬ 
ment Az is shown at an angle of 0 relative to the real ( x ) axis, whereas the corresponding 
increment Aw forms an angle of <p with the real (u) axis. From Eq. (6.110), 

<p = (9 + a, (6.111) 

or any line in the ’-plane is rotated through an angle a in the w-plane as long as w is an 
analytic transformation and the derivative is not zero. 17 

Since this result holds for any line through zo, it will hold for a pair of lines. Then for 
the angle between these two lines, 

<P 2 ~ <pl = (#2 + a) — (d\ + a) = 62 — di, (6.112) 

which shows that the included angle is preserved under an analytic transformation. Such 
angle-preserving transformations are called conformal. The rotation angle a will, in gen¬ 
eral, depend on z. In addition \f'(z)\ will usually be a function of z. 

Historically, these conformal transformations have been of great importance to scientists 
and engineers in solving Laplace’s equation for problems of electrostatics, hydrodynam¬ 
ics, heat flow, and so on. Unfortunately, the conformal transformation approach, however 
elegant, is limited to problems that can be reduced to two dimensions. The method is often 
beautiful if there is a high degree of symmetry present but often impossible if the sym¬ 
metry is broken or absent. Because of these limitations and primarily because electronic 
computers offer a useful alternative (iterative solution of the partial differential equation), 
the details and applications of conformal mappings are omitted. 

17 If df/dz = 0, its argument or phase is undefined and the (analytic) transformation will not necessarily preserve angles. 
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Exercises 


6.8.1 


Expand w(x) in a Taylor series about the point z — zo, where f'(z o) = 0. (Angles are 
not preserved.) Show that if the first n — 1 derivatives vanish but / (,!) (zo) / 0, then 
angles in the “-plane with vertices at z = Zo appear in the w-plane multiplied by n. 

6.8.2 Develop the transformations that create each of the four cylindrical coordinate systems: 


6.8.3 


(a) Circular cylindrical: 

(b) Elliptic cylindrical: 

(c) Parabolic cylindrical: 

(d) Bipolar: 


X — p cos <p, 
y = p sirup, 
x — a cosh u cos v, 
y = a sinhn sin v. 
* = £»?> 

y=\{^-H 2 ). 

a sinh p 


y- 


cosh i] — cos |' 
a sin § 


cosh j] — cos | 

Note. These transformations are not necessarily analytic. 


In the transformation 


a — w 


w 


how do the coordinate lines in the z-plane transform? What coordinate system have you 
constructed? 


Additional Readings 


Ahlfors, L. V., Complex Analysis, 3rd ed. New York: McGraw-Hill (1979). This text is detailed, thorough, rigor¬ 
ous, and extensive. 

Churchill, R. V., J. W. Brown, and R. F. Verkey, Complex Variables and Applications, 5th ed. New York: McGraw- 
Hill (1989). This is an excellent text for both the beginning and advanced student. It is readable and quite 
complete. A detailed proof of the Cauchy-Goursat theorem is given in Chapter 5. 

Greenleaf, F. R, Introduction to Complex Variables. Philadelphia: Saunders (1972). This very readable book has 
detailed, careful explanations. 

Kurala, A., Applied Functions of a Complex Variable. New York: Wiley (Interscience) (1972). An intermediate- 
level text designed for scientists and engineers. Includes many physical applications. 

Levinson, N., and R. M. Redheffer, Complex Variables. San Francisco: Holden-Day (1970). This text is written 
for scientists and engineers who are interested in applications. 

Morse, P. M., and H. Feshbach, Methods of Theoretical Physics. New York: McGraw-Hill (1953). Chapter 4 is 
a presentation of portions of the theory of functions of a complex variable of interest to theoretical physicists. 

Remmert, R., Theory of Complex Functions. New York: Springer (1991). 

Sokolnikoff, I. S., and R. M. Redheffer, Mathematics of Physics and Modern Engineering, 2nd ed. New York: 
McGraw-Hill (1966). Chapter 7 covers complex variables. 

Spiegel, M. R., Complex Variables. New York: McGraw-Hill (1985). An excellent summary of the theory of 
complex variables for scientists. 

Titchmarsh, E. C., The Theory of Functions, 2nd ed. New York: Oxford University Press (1958). A classic. 
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Watson, G. N., Complex Integration and Cauchy’s Theorem. New York: Hafner (orig. 1917, reprinted 1960). 
A short work containing a rigorous development of the Cauchy integral theorem and integral formula. Appli¬ 
cations to the calculus of residues are included. Cambridge Tracts in Mathematics, and Mathematical Physics, 
No. 15. 

Other references are given at the end of Chapter 15. 



Chapter 7 


Functions of a Complex 
Variable II 


In this chapter we return to the analysis that started with the Cauchy-Riemann conditions 
in Chapter 6 and develop the residue theorem, with major applications to the evaluation 
of definite and principal part integrals of interest to scientists and asymptotic expansion 
of integrals by the method of steepest descent. We also develop further specific analytic 
functions, such as pole expansions of meromorphic functions and product expansions of 
entire functions. Dispersion relations are included because they represent an important 
application of complex variable methods for physicists. 


7.1 Calculus of Residues 


Residue Theorem 


If the Laurent expansion of a function f(z) — Y^nL-oo a ^ z ~ z o)" is integrated term by 
term by using a closed contour that encircles one isolated singular point so once in a coun¬ 
terclockwise sense, we obtain (Exercise 6.4.1) 


(z-zo)" dz = a„ 


(z - zo )' ,+1 


n + 1 


= 0 , 


n /-1 . 


(7.1) 


However, if n = — 1, 


a- 1 ® (z — so) 1 dz = a- 1 


ire w d0 


= 2nia-\. 


(7.2) 


Summarizing Eqs. (7.1) and (7.2), we have 


1 

2iti 


/(s) dz = a- 1 . 


(7.3) 
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Jsx = y 



Figure 7.1 Excluding isolated 
singularities. 

The constant «_ |. the coefficient of (z — Zo) _1 in the Laurent expansion, is called the 
residue of f(z) at z = zo- 

A set of isolated singularities can be handled by deforming our contour as shown in 
Fig. 7.1. Cauchy’s integral theorem (Section 6.3) leads to 


f(z)dz+<b f(z)dz+<b f(z)dz+<b f(z)dz + -- = 0. (7.4) 

C J C 0 JCi Jc 2 

The circular integral around any given singular point is given by Eq. (7.3), 

f (z) dz — —2jtici- \ Zj , (7.5) 

Q 

assuming a Laurent expansion about the singular point z = Z;. The negative sign comes 
from the clockwise integration, as shown in Fig. 7.1. Combining Eqs. (7.4) and (7.5), we 
have 


f(z)dz = 2ni(ci-i ZQ +a _\ u +a_ i Z2 H-) 


— 2:ri x (sum of enclosed residues). 


(7.6) 


This is the residue theorem. The problem of evaluating one or more contour integrals is 
replaced by the algebraic problem of computing residues at the enclosed singular points. 

We first use this residue theorem to develop the concept of the Cauchy principal value. 
Then in the remainder of this section we apply the residue theorem to a wide variety of 
definite integrals of mathematical and physical interest. 

Using the transformation z = I /w for w approaching 0, we can find the nature of a sin¬ 
gularity at z going to oo and the residue of a function f(z) with just isolated singularities 
and no branch points. In such cases we know that 


{residues in the finite s-plane} + {residue at z ■ 


oo} = 0. 




Cauchy Principal Value 
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Occasionally an isolated pole will be directly on the contour of integration, causing the 
integral to diverge. Let us illustrate a physical case. 


Example 7. 7.7 Forced Classical Oscillator 


The inhomogeneous differential equation for a classical, undamped, driven harmonic os¬ 
cillator, 

i(0 + fflg*(0 = /(f), (7.7) 

may be solved by representing the driving force fit) = j 8(t' — t) f{t')dt' as a superpo¬ 
sition of impulses by analogy with an extended charge distribution in electrostatics. 1 If we 
solve first the simpler differential equation 

G + colG = 8{t - f) (7.8) 


for G(t, f'), which is independent of the driving term / (model dependent), then x(t) — 
f G(t, t')f(t')dt' solves the original problem. First, we verify this by substituting the in¬ 
tegrals for x(t) and its time derivatives into the differential equation for x(t) using the dif¬ 
ferential equation for G. Then we look for G{t,t') — J G(a>)e la>t in terms of an integral 
weighted by G, which is suggested by a similar integral form for 8(t — t') = f e lco ^~0 
(see Eq. (1.193c) in Section 1.15). 

Upon substituting G and G into the differential equation for G, we obtain 

J [{wl- a?)G - e- im, ']e i01t dco = 0. (7.9) 

Because this integral is zero for all t. the expression in brackets must vanish for all o>. 
This relation is no longer a differential equation but an algebraic relation that we can solve 
for G: 


G(<w) = 


2 ? 
coi — 0D Z 


u Q — lu 2&>o (&> + &>o) 2a>o(cn — a>o) 
Substituting G into the integral for G yields 

1 


G(t, t ) = 


i r°°' 

47TCO0 J-o o . 


oo y e i(o{t—t r ) 


e 


ico{t—t') 


AjTCOQ J-oq \_ co + COQ CO — CO() 


du>. 


(7.10) 


(7.11) 


Here, the dependence of G on t — t' in the exponential is consistent with the same depen¬ 
dence of <5 (7 — t'), its driving term. Now, the problem is that this integral diverges because 
the integrand blows up at a> = ±a>o, since the integration goes right through the first-order 
poles. To explain why this happens, we note that the 5-function driving term for G in¬ 
cludes all frequencies with the same amplitude. Next, we see that the equation for G at 
t' — 0 has its driving term equal to unity for all frequencies co, including the resonant ojq . 


1 Adapted from A. Yu. Grosberg. priv. comm. 
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We know from physics that forcing an oscillator at resonance leads to an indefinitely grow¬ 
ing amplitude when there is no friction. With friction, the amplitude remains finite, even 
at resonance. This suggests including a small friction term in the differential equations for 
x(t) and G. 

With a small friction term r/G, i] > 0, in the differential equation for Git, t') (and i]-i for 
x(t)), we can still solve the algebraic equation 


(a>o — co 2 + i rjco) G — e ,0Jt 


for G with friction. The solution is 

p -imt' 

G = 


o)q — ft) 2 + i iiho \co — co- w — co+ / 


irj 


co± = ± £2 + —, £2 = coo J 1 


{^lY 


\2cooJ 


(7.12) 


(7.13) 

(7.14) 


For small friction, 0 < i] coq, C is nearly equal to coq and real, whereas co± each pick up 
a small imaginary part. This means that the integration of the integral for G, 


G(t,t') = 


1 

POO 

- e i co (t-t') 

e im(l-t') - 

AnQ. „ 

' — oo 

_ CO — CO- 

co — CO+ _ 


dco. 


no longer encounters a pole and remains finite. 


(7.15) 


This treatment of an integral with a pole moves the pole off the contour and then con¬ 
siders the limiting behavior as it is brought back, as in Example 7.1.1 for r/ -> 0. This 
example also suggests treating co as a complex variable in case the singularity is a first- 
order pole, deforming the integration path to avoid the singularity, which is equivalent to 
adding a small imaginary part to the pole position, and evaluating the integral by means of 
the residue theorem. 

Therefore, if the integration path of an integral f for real xq goes right through the 
pole A'o, we may deform the contour to include or exclude the residue, as desired, by includ¬ 
ing a semicircular detour of infinitesimal radius. This is shown in Fig. 7.2. The integration 
over the semicircle then gives, with z — .t'o = &e l>p , dz — i Se l<p dip (see Eq. (6.27a)), 


/ 

/ 




L 

l 


2n 

dtp — in, i.e., nia-\ 
o 

dtp — —in, i.e., —nici-i 


if counterclockwise, 

if clockwise. 


This contribution, + or —, appears on the left-hand side of Eq. (7.6). If our detour were 
clockwise, the residue would not be enclosed and there would be no corresponding term 
on the right-hand side of Eq. (7.6). 

However, if our detour were counterclockwise, this residue would be enclosed by the 
contour C and a term 2nici-\ would appear on the right-hand side of Eq. (7.6). 

The net result for either clockwise or counterclockwise detour is that a simple pole on 
the contour is counted as one-half of what it would be if it were within the contour. This 
corresponds to taking the Cauchy principal value. 



7.1 Calculus of Residues 


459 



Figure 7.2 Bypassing singular points. 



Figure 7.3 Closing the contour 
with an infinite-radius semicircle. 


For instance, let us suppose that f(z) with a simple pole at z = xo is integrated over the 
entire real axis. The contour is closed with an infinite semicircle in the upper half-plane 
(Fig. 7.3). Then 


/ xo—S r 

f(x)dx+ / f(z)dz 
-oo J C XQ 


+ 


r f(x)dx+ [ i 
Jx 0 +S Jc 


f(x)dx+ / infinite semicircle 


'xo +5 

= 2 Tti enclosed residues. 


(7.16) 


If the small semicircle C X(j , includes xo (by going below the x-axis, counterclockwise), xo 

is enclosed, and its contribution appears twice — as nici-\ in and as i in the 

J c *o 

term 2 Tti ^ enclosed residues — for a net contribution of icia-\ . If the upper small semi¬ 
circle is selected, xo is excluded. The only contribution is from the clockwise integration 
over C xg , which yields —nia-i. Moving this to the extreme right of Eq. (7.16), we have 
+7tia- 1, as before. 

The integrals along the x-axis may be combined and the semicircle radius permitted to 
approach zero. We therefore define 


lim 

5^0 



f(x)dx + 



f (x) dx 



f(x)dx. 


(7.17) 


P indicates the Cauchy principal value and represents the preceding limiting process. 
Note that the Cauchy principal value is a balancing (or canceling) process. In the vicinity 
of our singularity at z = xq. 


.fix) 


Cl-\ 


x — X'o 


(7.18) 
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Figure 7.4 Cancellation at a simple pole. 


This is odd, relative to xq. The symmetric or even interval (relative to xq) provides cancel¬ 
lation of the shaded areas. Fig. 7.4. The contribution of the singularity is in the integration 
about the semicircle. 

In general, if a function f(x) has a singularity .to somewhere inside the interval a < 
xq < b and is integrable over every portion of this interval that does not contain the point 
xq, then we define 

rb r-v o-Si rb 

/ f(x)dx— lim / f(x)dx+ lim / f(x)dx, 

Ja s l^°Ja ^Oj xo+S2 


when the limit exists as 8 j —» 0 independently, else the integral is said to diverge. If this 
limit does not exist but the limit <5i = 82 — 8 -> 0 exists, it is defined to be the principal 
value of the integral. 

This same limiting technique is applicable to the integration limits ± 00 . We define 



/(;r) dx 


1 im 

< 3 — 00,&—>00 



f(x) dx , 


(7.19a) 


if the integral exists with a, b approaching their limits independently, else the integral di¬ 
verges. In case the integral diverges but 


r 

lim / f(x)dx = 
a^ooJ_ a 



f(x) dx 


(7.19b) 


exist, it is defined as its principal value. 
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Pole Expansion of Meromorphic Functions 

Analytic functions f(z.) that have only isolated poles as singularities are called meromor¬ 
phic. Examples are cotz [from j^lnsinz in Eq. (5.210)] and ratios of polynomials. For 
simplicity we assume that these poles at finite z = a n with 0 < |ai| < \az\ < • • • are all 
simple with residues b n . Then an expansion of f(z) in terms of b n (z — a n )~ l depends in 
a systematic way on all singularities of f(z), in contrast to the Taylor expansion about 
an arbitrarily chosen analytic point zo of /(z) or the Laurent expansion about one of the 
singular points of /(z). 

Let us consider a series of concentric circles C„ about the origin so that C„ includes 
a\, a. 2 ,..., a„ but no other poles, its radius R„ —> oo as n —>■ oo. To guarantee convergence 
we assume that |/(z)| < sR n for any small positive constant e and all z on C„. Then the 
series 


OO 

/ (z> = /(o)+X! bn {( z - + a «" 1 } 

n =1 


(7.20) 


converges to /(z). To prove this theorem (due to Mittag-Leffler) we use the residue theo¬ 
rem to evaluate the contour integral for z inside C n : 


2 ni J c 

n 

= £ 


/(w) 

C „ w ( w - z )' 


-dw 


m =1 


dm iP'm Z) 


+ 


Hz) - /( 0 ) 


(7.21) 


On C„ we have, for n —> oo, 


„ max wonC „ |/(«0I sR„ 
141 < 4tt R„ — —n m-— < 


2itR n (R„ - \z\) R„ - |z| 

for R„ y>> |z|. Using /„ —>■ 0 in Eq. (7.21) proves Eq. (7.20). 

If \f(z)\ < sRn +l , then we evaluate similarly the integral 


4 = 


1 


i/ 


f(w) 


2ni J u>P +l (u> — z) 
and obtain the analogous pole expansion 


dw -» 0 as n —>• oo 


/ (z) = / (0) + zf'(0) H-h 


p f ( p \ 0) , ^ bnZ P + i / a r+ l 


■E 

/i=i 


z — a n 


(7.22) 


Note that the convergence of the series in Eqs. (7.20) and (7.22) is implied by the bound of 
l/(z)l for |z| -> oo. 
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Product Expansion of Entire Functions 


A function f(z) that is analytic for all finite z is called an entire function. The logarithmic 
derivative f'/f is a meromorphic function with a pole expansion. 

If f(z ) has a simple zero at z = a n , then f(z) = (z — a n )g(z) with analytic g(z) and 
g(a n ) f 0. Hence the logarithmic derivative 


f(z) 

m 


C z-a n ) l + 


g'iz) 

g(z) 


(7.23) 


has a simple pole at z — a n with residue 1, and g'/g is analytic there. If f'/f satisfies the 
conditions that lead to the pole expansion in Eq. (7.20), then 


f'(z) _ f'( 0) y>r 1 1 ' 

f(z) /(0) z ~ an - 


(7.24) 


holds. Integrating Eq. (7.24) yields 


f z f(z) 
f o f(z) 


dz = In / (z) — In / (0) 


zf\ 0) 
/( 0 ) 



ln(z — a n ) — ln(—a„) + 



and exponentiating we obtain the product expansion 

(7.25) 


Examples are the product expansions (see Chapter 5) for 


(7.26) 


Another example is the product expansion of the gamma function, which will be discussed 
in Chapter 8. 

As a consequence of Eq. (7.23) the contour integral of the logarithmic derivative may be 
used to count the number N / of zeros (including their multiplicities) of the function f(z.) 
inside the contour C: 




1 f f'(z ) 
2 7V i Sc f(z) 


dz = N f. 


(7.27) 
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Moreover, using 


J ^j^dz = ln/(z) = ln|/(z)| + i arg/(z), (7.28) 

we see that the real part in Eq. (7.28) does not change as z moves once around the contour, 
while the corresponding change in arg / must be 

Ac ar g(/) =2nN f . (7.29) 

This leads to Rouche’s theorem: If f(z) and g(z) are analytic inside and on a closed 
contour C and |g(z)| < |/(z)| on C then f(z) and f (z) + g(z) have the same number of 
zeros inside C. 

To show this we use 


2jtN f+g = A c arg(/ + g) = A c arg(/) + A c arg^l + j 

Since |g| < |/| on C, the point w — 1 + g(z)/f(z) is always an interior point of the circle 
in the w-plane with center at 1 and radius 1. Hence arg(l + g/f) must return to its original 
value when z moves around C (it does not circle the origin); it cannot decrease or increase 
by a multiple of 2: r so that A c arg(l + g/f) — 0. 

Rouche’s theorem may be used for an alternative proof of the fundamental theorem of 
algebra: A polynomial Y?m =o a >» z ' n with 7^ 0 has n zeros. We define /(z) = a n z n . Then 
/ has an n-fold zero at the origin and no other zeros. Let g(z) = ^ a mZ m ■ We apply 
Rouche’s theorem to a circle C with center at the origin and radius R > 1. On C, |/(z)| = 
\a n \R n and 


|g(z)| < l«ol + \a\\R 4- \-\a„-i\R n l < 



Hence |g(z)| < |/(z)| for z on C, provided R > (^^Iq \a m \)/\a n \. For all sufficiently 
large circles C therefore, / + g = Y^»i=o a mZ m has n zeros inside C according to Rouche’s 
theorem. 


Evaluation of Definite Integrals 

Definite integrals appear repeatedly in problems of mathematical physics as well as in pure 
mathematics. Three moderately general techniques are useful in evaluating definite inte¬ 
grals: (1) contour integration, (2) conversion to gamma or beta functions (Chapter 8), and 
(3) numerical quadrature. Other approaches include series expansion with term-by-term 
integration and integral transforms. As will be seen subsequently, the method of contour 
integration is perhaps the most versatile of these methods, since it is applicable to a wide 
variety of integrals. 
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Definite Integrals: / 0 2jr /(sin 0, cos 0)d0 

The calculus of residues is useful in evaluating a wide variety of definite integrals in both 
physical and purely mathematical problems. We consider, first, integrals of the form 

/* 2jt 

1 = / /(sinff, cosd)dd, (7.30) 

J o 

where / is finite for all values of 9. We also require / to be a rational function of sin 0 and 
cos 6 so that it will be single-valued. Let 


Z — e 


dz — ie ,e dO. 


From this. 


, Q -dz 
d9 — —i —, 

z 


siny = 


z — z 


-l 


2 i 


COSU = 


z + z 


-1 


Our integral becomes 


I = -i<p f 


z - z 1 z + z 1 \ dz 


2 i 2 / z 

with the path of integration the unit circle. By the residue theorem, Eq. (7.16), 
I — (—i)2jri residues within the unit circle. 


(7.31) 


(7.32) 


(7.33) 


Note that we are after the residues of f/z. Illustrations of integrals of this type are provided 
by Exercises 7.1.7-7.1.10. 


Example 7.1.2 


Integral of cos in Denominator 


Our problem is to evaluate the definite integral 

^ de 


i = 

By Eq. (7.32) this becomes 

I = —i 


f 


1 + e cos 6 


lei < 1. 


dz 


unit circle z\\ + (e/2)(z + Z ')] 
dz 


.2 

1 S J z 2 + (2 /s)z + 1 ’ 

The denominator has roots 
1 1 

e e 

where z+ is within the unit circle and z~ is outside. Then by Eq. (7.33) and Exercise 6.6.1, 


Z— =-Vl - £ 2 


and 


. = + Vl - e 2 , 

e e 


2 1 

/ = —;-• 2jri - 

e 2z + 2/s 


z=-l/s+Cl/e)V l -£ 2 
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We obtain 

r 27T d6 2 jt 

J 0 1 + e cos 6 Vl - s 2 ’ 


Evaluation of Definite Integrals: / f(x) dx 

Suppose that our definite integral has the form 



and satisfies the two conditions: 


(7.34) 


• f(z) is analytic in the upper half-plane except for a finite number of poles. (It will be 
assumed that there are no poles on the real axis. If poles are present on the real axis, 
they may be included or excluded as discussed earlier in this section.) 

• /(z) vanishes as strongly 2 as 1/z 2 for |z| -> oo, 0 < argz < jx. 


With these conditions, we may take as a contour of integration the real axis and a semi¬ 
circle in the upper half-plane, as shown in Fig. 7.5. We let the radius R of the semicircle 
become infinitely large. Then 


/ R r7t 

fix) dx + lim / f(Re‘ e )iRe l6 dO 
-R R^ooJq 

= 2ni residues (upper half-plane). 


(7.35) 


From the second condition the second integral (over the semicircle) vanishes and 



f(x) dx — 2ni residues (upper half-plane). 


(7.36) 



Figure 7.5 Half-circle 
contour. 


2 We could use f (z) vanishes faster than 1/z, and we wish to have /(z) single-valued. 
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Example 7.1.3 Integral of Meromorphic Function 


Evaluate 


From Eq. (7.36), 


1-00 1 + x “ 


— 2 jti residues (upper half-plane). 


Here and in every other similar problem we have the question: Where are the poles? Rewrit¬ 
ing the integrand as 

1 1 1 

= —•-t, (7.38) 

Z z + 1 Z + l z — l 

we see that there are simple poles (order I) at z = i and z = —i. 

A simple pole at z = Zo indicates (and is indicated by) a Laurent expansion of the form 

OO 

f(z)=^^+a 0 + Ta n (z-zo)". (7.39) 

z - zo , 

The residue ci-\ is easily isolated as (Exercise 6.6.1) 

a-i = (z-zo)/(z)l*=«- (7-40) 

Using Eq. (7.40), we find that the residue at z = i is 1 /2 i, whereas that at z = —i is —1/2 i. 
Then 


/ OO 

-ooT 


= 2ni ■ — = 7T. 


Here we have used «_ i = 1/2/ for the residue of the one included pole at z — i- Note that 
it is possible to use the lower semicircle and that this choice will lead to the same result, 
I — Jt. A somewhat more delicate problem is provided by the next example. ■ 

Evaluation of Definite Integrals: f(x )e iax dx 

Consider the definite integral 

poo 

1= / f(x)e iax dx, (7.42) 


with a real and positive. (This is a Fourier transform. Chapter 15.) We assume the two 
conditions: 


f(z) is analytic in the upper half-plane except for a finite number of poles. 
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• lim f(z) = 0, 0<argz<7r. 
Ji|->oo 


(7.43) 


Note that this is a less restrictive condition than the second condition imposed on f(z ) for 
integrating f(x)dx previously. 

We employ the contour shown in Fig. 7.5. The application of the calculus of residues 
is the same as the one just considered, but here we have to work harder to show that the 
integral over the (infinite) semicircle goes to zero. This integral becomes 

I R = [" f(Re w ) e iaRcose - aRsine i R e ie dO. (7.44) 

J o 

Let R be so large that |/(z)| = \f(Re' e )\ < s. Then 


\Ir\<sR f e~ aRsine dd = 2eR [ 
J o Jo 


7T/2 


aRsinO ja 

e dO. 


In the range [0, n/2], 


Therefore (Fig. 7.6) 


—9 < sin0. 

7r 


rn/l 

\I r \<2sR e~ 2aRe/7l de. 

Jo 


Now, integrating by inspection, we obtain 


\Ir\<2sR 


1 — e 


—ciR 


Finally, 


2aR/n 


Tt 


lim \Ir\< —s. 
R—^-oo a 


From Eq. (7.43), s —> 0 as R —»• oo and 


(7.45) 


(7.46) 


(7.47) 


lim \I R \ =0. 

R—>oo 


(7.48) 


y 



Figure 7.6 (a) y = ( 2/n)9, (b) y = sind. 
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This useful result is sometimes called Jordan’s lemma. With it, we are prepared to tackle 
Fourier integrals of the form shown in Eq. (7.42). 

Using the contour shown in Fig. 7.5, we have 


/: 


f (x)e ,ax dx + lim Ir — 2ni residues (upper half-plane). 


Since the integral over the upper semicircle Ir vanishes as R -> oo (Jordan’s lemma), 

/ OO 

f(x)e ,ax dx — 2ni residues (upper half-plane) (a > 0). (7.49) 

-OO 


Example 7.1.4 Simple Pole on Contour of Integration 
The problem is to evaluate 


I = 


f 


sinx 


This may be taken as the imaginary part 3 of 


h = p L 


-dx. 


e n dz 


(7.50) 


(7.51) 


Now the only pole is a simple pole at z — 0 and the residue there by Eq. (7.40) is a_ i = 1. 
We choose the contour shown in Fig. 7.7 (1) to avoid the pole, (2) to include the real axis, 
and (3) to yield a vanishingly small integrand for z — iy, y -> oo. Note that in this case a 
large (infinite) semicircle in the lower half-plane would be disastrous. We have 




e' z dz f r ix dx 
Z J-R X 



e lz dz f R e' x dx 

-h /-h 

Z Jr X 



(7.52) 



3 One can use f [(e‘ z — e !z )/2 iz\ dz, but then two different contours will be needed for the two exponentials (compare Exam¬ 
ple 7.1.5). 
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the final zero coming from the residue theorem (Eq. (7.6)). By Jordan’s lemma 



(7.53) 


and 



e iz dz p [°°e ix dx_ Q 

Z J oo X 


(7.54) 


The integral over the small semicircle yields (—)ni times the residue of 1, and minus, as a 
result of going clockwise. Taking the imaginary part, 4 we have 


or 



sinx 

- dx = re 

X 


sin x 

X 



(7.55) 


(7.56) 


The contour of Fig. 7.7, although convenient, is not at all unique. Another choice of 
contour for evaluating Eq. (7.50) is presented as Exercise 7.1.15. ■ 


Example 7.1.5 Quantum Mechanical Scattering 


The quantum mechanical analysis of scattering leads to the function 

"°° xsin xdx 


/(a) = 


■/. 


-oo r - a- 


(7.57) 


where a is real and positive. This integral is divergent and therefore ambiguous. From the 
physical conditions of the problem there is a further requirement: I (a ) is to have the form 
e ,cr so that it will represent an outgoing scattered wave. 

Using 


1 1 - 1 _• 

sinz = - sinh/z =—e - e , 

i 2i 2 i 

we write Eq. (7.57) in the complex plane as 

I{o) = h+h, 

with 


(7.58) 

(7.59) 


U 2i /_ 


hi 


h = ~w: 


~hl 


oo Z 
oo 


ze 


o 

—iz 


jdz, 


-,dz. 


-oo - cr- 


1 Alte'rnalivcly. we may combine the integrals of Eq. (7.52) as 

f-r . rK 

J-R 


f ' j* — + f R e i* — = f R ( e ix - e ~ ix )— = 2 i f* 

J-R X J r X J r X J r 


-dx. 


(7.60) 
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y 



a 



b 


Figure 7.8 Contours. 

Integral I[ is similar to Example 7.1.4 and, as in that case, we may complete the contour by 
an infinite semicircle in the upper half-plane, as shown in Fig. 7.8a. For I 2 the exponential 
is negative and we complete the contour by an infinite semicircle in the lower half-plane, 
as shown in Fig. 7.8b. As in Example 7.1.4, neither semicircle contributes anything to the 
integral — Jordan’s lemma. 

There is still the problem of locating the poles and evaluating the residues. We find poles 
at z = +cr and z — —er on the contour of integration. The residues are (Exercises 6.6.1 
and 7.1.1) 



Z — O 

II 

l 

4 

h 

e ia 

e~‘ a 

~Y 

e -ia 

2 

e ia 


h 

2 

~2~ 


Detouring around the poles, as shown in Fig. 7.8 (it matters little whether we go above or 
below), we find that the residue theorem leads to 


Ph -jti 1 — 


1 \ e 


l\e“ 


2 i 




1 \ e' 1 


2 i 


(7.61) 


for we have enclosed the singularity at z = er but excluded the one at z = —o. In similar 
fashion, but noting that the contour for I 2 is clockwise. 


, !V ,cr /-I 

Ph-7Ti\ — ) — +m[ — 


2 i 


Adding Eqs. (7.61) and (7.62), we have 

IT 


2 i 


= —2tii | — 1) f— 
2 i 


PI(o) — PI\ -\- PI 2 — — (e la + e la ) =jt coshia = tt coscr. 


(7.62) 


(7.63) 


This is a perfectly good evaluation of Eq. (7.57), but unfortunately the cosine dependence 
is appropriate for a standing wave and not for the outgoing scattered wave as specified. 
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To obtain the desired form, we try a different technique (compare Example 7.1.1). In¬ 
stead of dodging around the singular points, let us move them off the real axis. Specifically, 
let a —* a T i y, —er —»■ — a — iy , where y is positive but small and will eventually be made 
to approach zero; that is, for 7i we include one pole and for I 2 the other one, 

/ + (er) = lim I (a + iy). (7.64) 

y^Q 

With this simple substitution, the first integral 7i becomes 

/ 1 \ gi(<r+i» 

Ilia + iy) = 2nii — \—-- (7.65) 

by direct application of the residue theorem. Also, 

/_1 \ e i(a+iy) 

h(o + iy) = — J ---• (7.66) 

Adding Eqs. (7.65) and (7.66) and then letting y —> 0, we obtain 
/+(< 7 ) — lim[/i((t + iy) + h(a + iy)] 

= \imjte i{a+iv) =Tte ia , (7.67) 

a result that does fit the boundary conditions of our scattering problem. 

It is interesting to note that the substitution a -> a — iy would have led to 


7_(er) = 7te~ ia , (7.68) 

which could represent an incoming wave. Our earlier result (Eq. (7.63)) is seen to be the 
arithmetic average of Eqs. (7.67) and (7.68). This average is the Cauchy principal value of 
the integral. Note that we have these possibilities (Eqs. (7.63), (7.67), and (7.68)) because 
our integral is not uniquely defined until we specify the particular limiting process (or 
average) to be used. ■ 


Evaluation of Definite Integrals: Exponential Forms 

With exponential or hyperbolic functions present in the integrand, life gets somewhat more 
complicated than before. Instead of a general overall prescription, the contour must be cho¬ 
sen to fit the specific integral. These cases are also opportunities to illustrate the versatility 
and power of contour integration. 

As an example, we consider an integral that will be quite useful in developing a relation 
between T(1 + z) and T(1 — z). Notice how the periodicity along the imaginary axis is 
exploited. 
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Figure 7.9 Rectangular contour. 


Example 7.1.6 


Factorial Function 


We wish to evaluate 


,o° ( 

i-oo 1- 


0 < a < 1. 


The limits on a are sufficient (but not necessary) to prevent the integral from diverging as 
x —> ±oo. This integral (Eq. (7.69)) may be handled by replacing the real variable .r by 
the complex variable - and integrating around the contour shown in Fig. 7.9. If we take 
the limit as R oo, the real axis, of course, leads to the integral we want. The return path 
along y = 2n is chosen to leave the denominator of the integral invariant, at the same time 
introducing a constant factor e l2jla in the numerator. We have, in the complex plane. 


-dz — lim 


■» R gdx 


R-+oc \J —1 + e x 


(l-e i2na ) f 


/ K 

- 
-R 1 


R gCLX 


In addition there are two vertical sections (0 < y < 2tt), which vanish (exponentially) as 
R — > oo. 

Now where are the poles and what are the residues? We have a pole when 

e z = e x e iy = -l. (7.71) 

Equation (7.71) is satisfied at z — 0 + ire. By a Laurent expansion 5 in powers of (z — in) 
the pole is seen to be a simple pole with a residue of —e l7Ta . Then, applying the residue 
theorem, 

p oo p ax 

(l — e i27Ta ) I - - -dx = 2ni(-e ina ). (7.72) 


This quickly reduces to 


/ OO 

-ooT 


- dx — -. 

± e x sin<77r 


0 < a < 1 . 


’ 1 + e z = 1 + e z ~ ,n e ,7T = 1 - e z 


= —(z - in)( 1 + 


z-in , (z-inY 
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Using the beta function (Section 8.4), we can show the integral to be equal to the product 
r(a)r(l — a). This results in the interesting and useful factorial function relation 

T{a + 1 )T (1 — a)= ( 7 . 74 ) 

sin Tta 

Although Eq. (7.73) holds for real a, 0 < a < 1, Eq. (7.74) may be extended by analytic 
continuation to all values of a, real and complex, excluding only real integral values. ■ 

As a final example of contour integrals of exponential functions, we consider Bernoulli 
numbers again. 


Example 7.1.7 Bernoulli Numbers 


In Section 5.9 the Bernoulli numbers were defined by the expansion 


x 


e x - 1 



n =0 


(7.75) 


Replacing x with z (analytic continuation), we have a Taylor series (compare Eq. (6.47)) 
with 


B 


n 


n\ f z dz 
2 ni Jc 0 e z — 1 z " +1 ’ 


(7.76) 


where the contour Co is around the origin counterclockwise with |z| < 2jt to avoid the 
poles at 2k in. 

For n — 0 we have a simple pole at z = 0 with a residue of +1. Hence by Eq. (7.25), 

0 ! 

Bq = -— • 2jxi(\) — 1. (7.77) 

2k i 

For n — 1 the singularity at z = 0 becomes a second-order pole. The residue may be shown 
to be — 4 by series expansion of the exponential, followed by a binomial expansion. This 
results in 


1 ! 

B\ = -• 2k i 

2k i 




(7.78) 


For n > 2 this procedure becomes rather tedious, and we resort to a different means of 
evaluating Eq. (7.76). The contour is deformed, as shown in Fig. 7.10. 

The new contour C still encircles the origin, as required, but now it also encircles 
(in a negative direction) an infinite series of singular points along the imaginary axis at 

z = ± p2Ki, p — 1,2,3.The integration back and forth along the x-axis cancels out, 

and for R —> 00 the integration over the infinite circle yields zero. Remember that n > 2. 
Therefore 



OO 

—2ni residues 
P =\ 


(z = ±p2Ki). 


(7.79) 
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Figure 7.10 Contour of 
integration for Bernoulli numbers. 


At z = p2ni we have a simple pole with a residue {p2ni )~ n . When n is odd, the residue 
from z — p2ui exactly cancels that from z = —p2ni and B n — 0, n = 3, 5,7, and so on. 
For n even the residues add, giving 

n! ^ 1 

Bn = — (- 2 jri )2 — 

2jc i L —' 


“ p n (27ti) n 
p= l 


(—1)"/ 2 2«! y, 

\n Z-^/ 


(2 nr 


„ (-l )"/ 2 2 n\ 

P~ n = ~ m (n even), (7.80) 


p= i 


(2 7T) n 


where (n) is the Riemann zeta function introduced in Section 5.9. Equation (7.80) corre¬ 
sponds to Eq. (5.152) of Section 5.9. ■ 


Exercises 

7.1.1 Determine the nature of the singularities of each of the following functions and evaluate 
the residues (a > 0 ). 


(a) 

(c) 

(e) 

(g) 


1 


z 2 + a 2 


(z 2 + a 2 ) 2 ' 


ze 


+IZ 


Z 2 + Cl 2 


C+IZ 


Z 2 — a 2 


(b) 

(d) 

(f) 

(h) 


1 


(z 2 + a 2 ) 2 ' 
sin 1 /z 
Z 2 + a 2 ' 


ze 


+IZ 


z 2 — a 2 


,-k 


Z + 1 


0<k< 1 . 


Hint. For the point at infinity, use the transformation w — l/z for |z| -> 0. For the 
residue, transform f(z) dz into g(w)dw and look at the behavior of g(w). 
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7.1.2 Locate the singularities and evaluate the residues of each of the following functions. 


7.1.3 


7.1.4 


7.1.5 


(a) z~ n (e z 

(b) 


1 ) 


-l 


z# 0, 


z 2 e z 


1 + e 2z 

(c) Find a closed-form expression (that is, not a sum) for the sum of the finite-plane 
singularities. 

(d) Using the result in part (c), what is the residue at |z| -> oo? 

Hint. See Section 5.9 for expressions involving Bernoulli numbers. Note that Eq. (5.144) 
cannot be used to investigate the singularity at z -* oo, since this series is only valid for 
|z| < 2jt. 

The statement that the integral halfway around a singular point is equal to one-half the 
integral all the way around was limited to simple poles. Show, by a specific example, 
that 

f f(.z)dz = \£> f(z)dz 

./Semicircle ^ ./Circle 

does not necessarily hold if the integral encircles a pole of higher order. 

Hint. Try f(z) = z~ 2 . 

A function f(z) is analytic along the real axis except for a third-order pole at z = xo. 
The Laurent expansion about z = xo has the form 


f(z) = 


a-3 


+ 


a_l 


(z - Xq) 3 z - X 0 


■g(z). 


with g(z) analytic at z = xo- Show that the Cauchy principal value technique is applica¬ 
ble, in the sense that 


(a) lim 


L 


xq—8 n oo 

f(x)dx+ / f{x)dx } is finite. 
Jx 0+6 


(b) / f(z)dz = ±ijra-\, 

Jc XQ 

where C xo denotes a small semicircle about z = x o- 

The unit step function is defined as (compare Exercise 1.15.13) 

f 0, s < a 


u(s — a) = 


1 , 


s > a. 


Show that u(s) has the integral representations 


1 

(a) u(s)= lim — 


d 


£^- 0 + 2 ni J_ OQ x — is 


—dx. 
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(b) u(s) = 


-l ,r 

i J _oo 


£ ixs 

- dx. 

X 


Note. The parameter .v is real. 

7.1.6 Most of the special functions of mathematical physics may be generated (defined) by 
a generating function of the form 

g(t,x) = ^2f n (x)t n . 

n 

Given the following integral representations, derive the corresponding generating func¬ 
tion: 
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All 


7.1.9 


7.1.10 


7.1.11 


7.1.12 


7.1.13 


7.1.14 


7.1.15 


Show that 


/»27T 

Jo 


de 


2n 

1 — 2fcos0 + f 2 1 — t 2 ' 
What happens if 11 \ > 1 ? What happens if 11 \ — 1 ? 
With the calculus of residues show that 


for Itl < 1. 


/' 


lna , a (2«)! (2n — 1)!! 

cos" 6 d6 — jt - = 7t - 


70 2 2 n (n\) 2 " (2/7)!! 

(The double factorial notation is defined in Section 8.1.) 
Hint. cos6 = \{e ie + e~ ie )= ^(z + z~ l ), \z\ = 1. 

Evaluate 

cos bx — cos ax 


n =0,1,2,. 


/ 


-d.r, 


a > b > 0. 


ANS. 7t(a-b). 


Prove that 


/ 


00 sin 2 jc 


dx=- 
2 2 ' 


Hint. sin 2 .r = i(l — cos2x). 


A quantum mechanical calculation of a transition probability leads to the function 
f(t,oo) = 2(1 — cos cot)/co 2 . Show that 


£ 


f(t, ao)du> = 2 tt t. 


Show that (a > 0) 


(a) 


(b) 


/ 


cos x 7 r 

- - -dx — —e . 

-no x- + a- a 


How is the right side modified if cosx is replaced by coskxl 

r»00 


l 


x sinx 


r dx — ne 


—on X 


■ a* 


How is the right side modified if sin v is replaced by sin kxl 


These integrals may also be interpreted as Fourier cosine and sine transforms — 
Chapter 15. 

Use the contour shown (Fig. 7.11) with R —*■ oo to prove that 


£ 


sinx 


- dx — 71. 
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Figure 7.11 Large square 
contour. 


7.1.16 


7.1.17 


In the quantum theory of atomic collisions we encounter the integral 


in which p is real. Show that 


What happens if p = ± 1 ? 
Evaluate 



—e&dt, 

t 


1 = 0, \P\> 1 

/ = 7T, \p\ < 1. 



(ln.r) 

1 + x 2 


(a) by appropriate series expansion of the integrand to obtain 

OO 

4£(-l)"(2«+l)- 3 , 

n =0 

(b) and by contour integration to obtain 



Hint, x -* z = e'. Try the contour shown in Fig. 7.12, letting R —> oo. 


7.1.18 Show that 



(x + l) 2 


clx = 


jta 

sin^a 


.v 


-R + in ^ 

\ R + in 


_ c 

i_ 


-R 1 

! ’ R 


Figure 7.12 Small square 
contour. 
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y 



Figure 7.13 Contour avoiding 
branch point and pole. 


where — 1 < a < 1. Here is still another way of deriving Eq. (7.74). 

Hint. Use the contour shown in Fig. 7.13, noting that z — 0 is a branch point and the 
positive x-axis is a cut line. Note also the comments on phases following Example 6.6.1. 

7.1.19 Show that 


x a ir 

- fl Y — - 

x + 1 sinfl7r’ 

where 0 < a < 1. This opens up another way of deriving the factorial function relation 
given by Eq. (7.74). 

Hint. You have a branch point and you will need a cut line. Recall that z~ a = w in polar 
form is 

[r e i( - e+2nn) ]~ a = pe iv , 

which leads to —ad — 2amt — q>. You must restrict n to zero (or any other single integer) 
in order that tp may be uniquely specified. Try the contour shown in Fig. 7.14. 




Figure 7.14 Alternative contour 
avoiding branch point. 
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y 



Figure 7.15 Angle contour. 


7.1.20 


7.1.21 


7.1.22 


Show that 


Evaluate 


Show that 



dx 

(x 2 + a 2 ) 2 


7X 

4a 2 ’ 


a > 0. 



ANS. tt/V2. 


/* OO /» oo 

/ cos (t 2 ) dt = / sin(r 2 )nh 

Jo Jo 


■J-rr 

2 V 2 ' 


Try the contour shown in Fig. 7.15. 

Note. These are the Fresnel integrals for the special case of infinity as the upper limit. 
For the general case of a varying upper limit, asymptotic expansions of the Fresnel 
integrals are the topic of Exercise 5.10.2. Spherical Bessel expansions are the subject of 
Exercise 11.7.13. 


7.1.23 Several of the Bromwich integrals. Section 15.12, involve a portion that may be approx¬ 
imated by 

ra+iy e zt 

i w= . 7tj2 dz - 

Here a and t are positive and finite. Show that 


lim /(v) = 0. 

y —>00 
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y 



Figure 7.16 Sector contour. 


7.1.24 


7.1.25 


7.1.26 


7.1.27 


Show that 


f 


1 


1 +x n 

Hint. Try the contour shown in Fig. 7.16. 
(a) Show that 


-dx — 


n/n 


sin (jt/n) 


f(z ) = z 4 — 2cos20z 2 + 1 


has zeros at e , e , — e, and — e Ib 
(b) Show that 

,>00 dx 


£ 


7r 


7r 


c 4 — 2cos20x 2 + 1 2sin0 2 1 / 2 (1 — COS20) 1 / 2 


Exercise 7.1.24 (n — 4) is a special case of this result. 

Show that 

f ’°° X 2 dx 7r 7T 

/_oo x 4 — 2cos20x 2 + 1 2sin@ 2 1 / 2 (1 — COS20) 1 / 2 


£ 


Exercise 7.1.21 is a special case of this result. 

Apply the techniques of Example 7.1.5 to the evaluation of the improper integral 

dx 


I = 


/. 


x 2 -cr 2 ' 
oo A u 


(a) Let a -* er + iy. 

(b) Let cr —> a — ; y. 

(c) Take the Cauchy principal value. 
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7.1.28 


The integral in Exercise 7.1.17 may be transformed into 



y 


1 + e~ 2 y 


dy 


■ 


3 


16' 


Evaluate this integral by the Gauss-Laguerre quadrature and compare your result with 
7r 3 /16. 


ANS. Integral = 1.93775 (10 points). 


7.2 Dispersion Relations 


The concept of dispersion relations entered physics with the work of Kronig and Kramers 
in optics. The name dispersion comes from optical dispersion, a result of the dependence 
of the index of refraction on wavelength, or angular frequency. The index of refraction 
n may have a real part determined by the phase velocity and a (negative) imaginary part 
determined by the absorption — see Eq. (7.94). Kronig and Kramers showed in 1926- 
1927 that the real part of (n 2 — 1) could be expressed as an integral of the imaginary part. 
Generalizing this, we shall apply the label dispersion relations to any pair of equations 
giving the real part of a function as an integral of its imaginary part and the imaginary part 
as an integral of its real part — Eqs. (7.86a) and (7.86b), which follow. The existence of 
such integral relations might be suspected as an integral analog of the Cauchy-Riemann 
differential relations. Section 6.2. 

The applications in modern physics are widespread. For instance, the real part of the 
function might describe the forward scattering of a gamma ray in a nuclear Coulomb held 
(a dispersive process). Then the imaginary part would describe the electron-positron pair 
production in that same Coulomb held (the absorptive process). As will be seen later, the 
dispersion relations may be taken as a consequence of causality and therefore are indepen¬ 
dent of the details of the particular interaction. 

We consider a complex function f(z.) that is analytic in the upper half-plane and on the 
real axis. We also require that 

lim |/(z)|=0, 0<argz<7r, (7.81) 

kl-s-oo 


in order that the integral over an inhnite semicircle will vanish. The point of these condi¬ 
tions is that we may express /(z) by the Cauchy integral formula, Eq. (6.43), 


f(zo) = 

2tt i 


f(z ) 
z- zo 


dz. 


(7.82) 


The integral over the upper semicircle 6 vanishes and we have 


i r°° f(x ) 

f(zo)=— dx . (7.83) 

2m J _oo Zo 

The integral over the contour shown in Fig. 7.17 has become an integral along the x-axis. 

Equation (7.83) assumes that zo is in the upper half-plane — interior to the closed con¬ 
tour. If zo were in the lower half-plane, the integral would yield zero by the Cauchy integral 


®The use of a semicircle to close the path of integration is convenient, not mandatory. Other paths are possible. 
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Figure 7.17 Semicircle contour. 


theorem. Section 6.3. Now, either letting zo approach the real axis from above (zo — -to) 
or placing it on the real axis and taking an average of Eq. (7.83) and zero, we find that 
Eq. (7.83) becomes 


1 f°° fix) 

f(x 0 )=—P / -^-dx, (7.84) 

tr i J—oo % -to 

where P indicates the Cauchy principal value. Splitting Eq. (7.84) into real and imaginary 
parts 7 yields 


fix o) = u(x o) + iv(x o) 

7 . 


ft J —OO X Xq 


~'n P i\ 


u{x ) 

—OO X XQ 


d x. 


(7.85) 


Finally, equating real part to real part and imaginary part to imaginary part, we obtain 


1 , 

r°° v(x) 


s 

o 

II 

1 

*0 

- dx 

(7.86a) 

n J 

1 

8 

X 

1 

X 

o 


1 

r°° u (x) 


vix 0 ) = - P 

/ dx. 

(7.86b) 

7T 

1 

8 

x 

1 

X 

o 



These are the dispersion relations. The real part of our complex function is expressed as 
an integral over the imaginary part. The imaginary part is expressed as an integral over 
the real part. The real and imaginary parts are Hilbert transforms of each other. Note that 
these relations are meaningful only when fix) is a complex function of the real variable x. 
Compare Exercise 7.2.1. 

From a physical point of view u{x) and/or v(x ) represent some physical measurements. 
Then /(z) = uiz.) + iv(z) is an analytic continuation over the upper half-plane, with the 
value on the real axis serving as a boundary condition. 


7 The second argument, y = 0, is dropped: u(x o, 0) —> u(x o). 
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Symmetry Relations 


On occasion /(x) will satisfy a symmetry relation and the integral from —oo to +oo 
may be replaced by an integral over positive values only. This is of considerable physical 
importance because the variable x might represent a frequency and only zero and positive 
frequencies are available for physical measurements. Suppose 8 

/(-*) = /*(*). (7.87) 


Then 


u{—x) + iv(—x) = u(x) — iv{x). 


(7.88) 


The real part of f(x) is even and the imaginary part is odd. 9 In quantum mechanical 
scattering problems these relations (Eq. (7.88)) are called crossing conditions. To exploit 
these crossing conditions, we rewrite Eq. (7.86a) as 


u(x o) = — 


-H 


0 v(x) 1 

- dx H- P 


—oo X Xo 


71 


f 


v(x) 

X — XQ 


dx. 


(7.89) 


Letting x —>• — x in the first integral on the right-hand side of Eq. (7.89) and substituting 
v(—x) — —v{x) from Eq. (7.88), we obtain 


u Uo) = — 


= ~P f 
X Jo 

r 

Jo 


2 

= -P 

IT 


1 

v(x) —-- 

■V + xo 

1 xv(x) 


x — Xo 


dx 


2 _ 2 
X Xq 


dx. 


(7.90) 


Similarly, 


u(x 0 ) = 


2 f c 

- P / 

J 0 


Xqm(x) 


dx. 


(7.91) 


The original Kronig-Kramers optical dispersion relations were in this form. The asymp¬ 
totic behavior (xo -* oo) of Eqs. (7.90) and (7.91) lead to quantum mechanical sum rules. 
Exercise 7.2.4. 


Optical Dispersion 

The function exp [i(kx — cot)] describes an electromagnetic wave moving along the x-axis 
in the positive direction with velocity v = co/k; co is the angular frequency, k the wave 
number or propagation vector, and n = ck/co the index of refraction. From Maxwell’s 


^This is not just a happy coincidence. It ensures that the Fourier transform of f(x ) will be real. In turn, Eq. (7.87) is a conse¬ 
quence of obtaining f(x ) as the Fourier transform of a real function. 

^u(x, 0) = u{—x, 0), v(x, 0) = —v(—x, 0). Compare these symmetry conditions with those that follow from the Schwarz reflec¬ 
tion principle, Section 6.5. 
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equations, electric permittivity s, and Ohm’s law with conductivity cr, the propagation 
vector k for a dielectric becomes 10 


k 2 



(7.92) 


(with ii, the magnetic permeability, taken to be unity). The presence of the conductivity 
(which means absorption) gives rise to an imaginary part. The propagation vector k (and 
therefore the index of refraction n) have become complex. 

Conversely, the (positive) imaginary part implies absorption. For poor conductivity 
{Ana/cos <ZC 1) a binomial expansion yields 

i-co 2na 
k — s/e —b i —— 
c c^/e 


and 


e i(kx—tot) _ e iai(xs/e/c—t)^—Inax/c^/e 


an attenuated wave. 

Returning to the general expression for k 2 , Eq. (7.92), we find that the index of refraction 
becomes 


2 c~k 2 4na 

n = —y —s + i -• 

C0 Z CO 


(7.93) 


We take n 2 to be a function of the complex variable co (with e and a depending on co). 
However, n 2 does not vanish as co -* oo but instead approaches unity. So to satisfy the 
condition, Eq. (7.81), one works with /(&>) = n 2 (co) — 1. The original Kronig-Kramers 
optical dispersion relations were in the form of 


JH[« 2 (ft> 0 ) — l] = J 

3[«Vo)-l] = --F f 

Jr i 0 


00 ®S[n 2 (w) - 1] 


dco. 




(7.94) 


CD 0 m[n 2 {co) - 1 ] 


dco. 


m- — co. 


o 


Knowledge of the absorption coefficient at all frequencies specifies the real part of the 
index of refraction, and vice versa. 


The Parseval Relation 


When the functions u(x) and v(x) are Hilbert transforms of each other (given by 
Eqs. (7.86)) and each is square integrable, 11 the two functions are related by 


f°° 2 f°° -> 

/ \u(x)\ dx= / \v(x)\ dx. 

J— oo J —OO 


(7.95) 


10 See J. D. Jackson, Classical Electrodynamics, 3rd ed. New York: Wiley (1999), Sections 7.7 and 7.10. Equation (7.92) is in 
Gaussian units. 

11 This means that \u(x)\ 2 dx and |i>(x )| 2 dx are finite. 



486 Chapter 7 Functions of a Complex Variable II 


This is the Parseval relation. 

To derive Eq. (7.95), we start with 

”00 nOO 


-oo J—oo ■ 

using Eq. (7.86a) twice. Integrating first with respect to x, we have 

"°° v(t)dt f°° dx 


/ oo roo j n c 

\u(x) | 2 dx — I —I 

-oo J —oo ^ J—i 

i) twice. Integrating first with 

/ oo roo rc 

\u(x)\ dx = I v(s)ds / 
-OO J—OO J— C 

itegra 

hi: 


v(s)ds 1 


£ 


v{t)dt 


dx , 


7T 


L 


-oo (s-x)(t-x) 


From Exercise 7.2.8, the x integration yields a delta function: 

dx 

— S(s — t). 


n- J-o o (.v - x)(f - x) 


(7.96) 


We have 


/ OO ^ f* oo /* OO 

|m(x)| / v{t)dt I v(s)8(s — t)ds. 

-oo J —oo J —OO 


(7.97) 


Then the s integration is carried out by inspection, using the defining property of the delta 
function: 



i>(s)S(j — t) ds = i>(f). 


(7.98) 


Substituting Eq. (7.98) into Eq. (7.97), we have Eq. (7.95), the Parseval relation. Again, in 
terms of optics, the presence of refraction over some frequency range (n ^ 1 ) implies the 
existence of absorption, and vice versa. 


Causality 

The real significance of dispersion relations in physics is that they are a direct consequence 
of assuming that the particular physical system obeys causality. Causality is awkward to 
define precisely, but the general meaning is that the effect cannot precede the cause. A scat¬ 
tered wave cannot be emitted by the scattering center before the incident wave has arrived. 
For linear systems the most general relation between an input function G (the cause) and 
an output function H (the effect) may be written as 

/ CXD 

F(t -t')G(t')dt'. (7.99) 

-CXD 

Causality is imposed by requiring that 

F(t — t') — 0 for t — t' < 0. 

Equation (7.99) gives the time dependence. The frequency dependence is obtained by tak¬ 
ing Fourier transforms. By the Fourier convolution theorem. Section 15.5, 

h(co) = f (a>)g(a>), 

where /(&>) is the Fourier transform of /•’(?), and so on. Conversely, F{t) is the Fourier 
transform of / (&>). 
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The connection with the dispersion relations is provided by the Titchmarsh theorem . 12 
This states that if /(&>) is square integrable over the real &>-axis, then any one of the fol¬ 
lowing three statements implies the other two. 

1. The Fourier transform of f(co) is zero for t < 0: Eq. (7.99). 

2. Replacing a> by z, the function f(z) is analytic in the complex z-plane for v > 0 and 
approaches /(x) almost everywhere as y —> 0. Further, 

/ / (x + iy) | dx < K for y > 0; 

J — OO 

that is, the integral is bounded. 

3. The real and imaginary parts of f(z) are Hilbert transforms of each other: Eqs. (7.86a) 
and (7.86b). 

The assumption that the relationship between the input and the output of our linear 
system is causal (Eq. (7.99)) means that the first statement is satisfied. If /(&>) is square 
integrable, then the Titchmarsh theorem has the third statement as a consequence and we 
have dispersion relations. 


Exercises 


7.2.1 

7.2.2 


7.2.3 


7.2.4 


The function f(z) satisfies the conditions for the dispersion relations. In addition, 
f(z) = f*(z*), the Schwarz reflection principle. Section 6.5. Show that f(z ) is identi¬ 
cally zero. 


For f(z) such that we may replace the closed contour of the Cauchy integral formula 
by an integral over the real axis we have 


fix o) = — 
2 m 


/ xo-8 
-oo 


fix ) 


dx + 


—oo % *0 


r -i^ d A + ^f i^L dx 

Jx 0 +s x - x 0 j 2 ni Jc XQ x - x 0 


Here C TQ designates a small semicircle about .xo in the lower half-plane. Show that this 
reduces to 

“°° fix) 


fixo)=—p f 

7TI J_ 


—no X 


-XO 


-dx, 


which is Eq. (7.84). 

(a) For f(z) = e' z , Eq. (7.81) does not hold at the endpoints, arg - = 0, 7 t. Show, with 
the help of Jordan’s lemma. Section 7.1, that Eq. (7.82) still holds. 

(b) For f(z) = e' z verify the dispersion relations, Eq. (7.89) or Eqs. (7.90) and (7.91), 
by direct integration. 


With fix.) — u(x) + iv(x) and f(x) — /*(—x), show that as xq -> oo. 


'-Refer to E. C. Titchmarsh, Introduction to the Theory of Fourier Integrals, 2nd ed. New York: Oxford University Press (1937). 
For a more informal discussion of the Titchmarsh theorem and further details on causality see J. Hilgevoord, Dispersion Relations 
and Causal Description. Amsterdam: North-Holland (1962). 
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2 f°° 

(a) u(x 0 ) ~-~ / xv(x)dx, 

tzx q J o 

2 f 00 

(b) v(a'o) ~- / u(x)dx. 

xxo Jo 


7.2.5 


7.2.6 


7.2.7 


7.2.8 


In quantum mechanics relations of this form are often called sum rules. 


(a) Given the integral equation 


1 

l + x 0 



u(x) 

- dx, 

X — XQ 


use Hilbert transforms to determine u{x o). 

(b) Verify that the integral equation of part (a) is satisfied. 

(c) From /(z)| v =o = u(x) + iv(x), replace x by z and determine f(z). Verify that the 
conditions for the Hilbert transforms are satisfied. 

(d) Are the crossing conditions satisfied? 

ANS. (a) u(x 0 ) = A ° 2 , (c) /(z) = (z + 0 _1 - 

!+*0 

(a) If the real part of the complex index of refraction (squared) is constant (no optical 
dispersion), show that the imaginary part is zero (no absorption). 

(b) Conversely, if there is absorption, show that there must be dispersion. In other 
words, if the imaginary part of n 2 — 1 is not zero, show that the real part of n 2 — 1 
is not constant. 


Given u(x) — x/(x 2 + 1) and v(x) — —l/(x 2 + 1), show by direct evaluation of each 
integral that 


/ \u(x)\ dx= I |t>(x)| dx. 

J—oo J —oo 


/ 9 / 9 71 

ANS. / \u(x)\~dx = I \v(x)\~dx = —. 

J—OO J—OO 2 

Take u (x) = S(x), a delta function, and assume that the Hilbert transform equations 
hold. 


(a) Show that 


8(w) = 


1 f 00 dy 

x 2 J- oo y(y - w )' 


(b) With changes of variables w = s — t and x =s — y, transform the 8 representation 
of part (a) into 


8(s -t) = 



dx 

(x — .S’) (.S' — t) 


Note. The 8 function is discussed in Section 1.15. 
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7.2.9 


Show that 


1 f c 


dt 


l-o o t(t-x) 

is a valid representation of the delta function in the sense that 



f(x)S(x)dx = f( 0). 


Assume that f(x) satisfies the condition for the existence of a Hilbert transform. 
Hint. Apply Eq. (7.84) twice. 


7.3 Method of Steepest Descents 

Analytic Landscape 

In analyzing problems in mathematical physics, one often finds it desirable to know the 
behavior of a function for large values of the variable or some parameter s, that is, the 
asymptotic behavior of the function. Specific examples are furnished by the gamma func¬ 
tion (Chapter 8) and various Bessel functions (Chapter 11). All these analytic functions are 
defined by integrals 

I(s) = J F(z,s)dz, (7.100) 

where F is analytic in z and depends on a real parameter s. We write F(z) whenever 
possible. 

So far we have evaluated such definite integrals of analytic functions along the real axis 
by deforming the path C to C' in the complex plane, so \F\ becomes small for all z on C'. 
This method succeeds as long as only isolated poles occur in the area between C and C'. 
The poles are taken into account by applying the residue theorem of Section 7.1. The 
residues give a measure of the simple poles, where |F| -> oo, which usually dominate and 
determine the value of the integral. 

The behavior of the integral in Eq. (7.100) clearly depends on the absolute value |F| of 
the integrand. Moreover, the contours of | F\ often become more pronounced as ,v becomes 
large. Let us focus on a plot of | F(x + iy)\ 2 — U 2 (x, y) + V 2 (x, y), rather than the real part 
JHF = U and the imaginary part 3 F = V separately. Such a plot of \F\ 2 over the complex 
plane is called the analytic landscape, after Jensen, who, in 1912, proved that it has only 
saddle points and troughs but no peaks. Moreover, the troughs reach down all the way 
to the complex plane. In the absence of (simple) poles, saddle points are next in line to 
dominate the integral in Eq. (7.100). Hence the name saddle point method. At a saddle 
point the real (or imaginary) part U of F has a local maximum, which implies that 

dU _ dU _ 0 
dx 3 y 

and therefore by the use of the Cauchy-Riemann conditions of Section 6.2, 

3 V _ 3 V _ 0 
dx 3 y 
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so V has a minimum, or vice versa, and F'(z) = 0. Jensen’s theorem prevents U and 
V from having either a maximum or a minimum. See Fig. 7.18 for a typical shape (and 
Exercises 6.2.3 and 6.2.4). Our strategy will be to choose the path C so that it runs over 
the saddle point, which gives the dominant contribution, and in the valleys elsewhere. 

If there are several saddle points, we treat each alike, and their contributions will add to 
I(s -> oo). 

To prove that there are no peaks, assume there is one at zo- That is, |E(zo)| 2 > |E(z)| 2 
for all z of a neighborhood |z — zo I < r. If 

OO 

F(z) = ^2 a „(z - zo)" 

n= 0 

is the Taylor expansion at zo, the mean value m(F) on the circle z = Zo + rexp(i<p) be¬ 
comes 

i r 2n 7 

m(F)=—j jE(z 0 + re lip )\“ d(p 


1 

2n 


l 


2 71 °° 


E n* n j(n-m)<P 

u m a n r e 


m,n =0 


d(p 


OO 

= ^|fl„| 2 r 2n >|flo| 2 =|E(zo)| 2 , (7.101) 

n =0 

using orthogonality, ^ f ( 2lT exp i (n — m)<pd(p — S nm . Since m(F ) is the mean value of |E| 2 
on the circle of radius r, there must be a point zi on it so that |E(zi)| 2 >m(F ) > |E(zo)| 2 , 
which contradicts our assumption. Hence there can be no such peak. 

Next, let us assume there is a minimum at zo so that 0< |F(z 0 )| 2 < |E(z)| 2 for all z of 
a neighborhood of zq. In other words, the dip in the valley does not go down to the complex 
plane. Then |E(z)| 2 > 0 and, since 1 /F(z) is analytic there, it has a Taylor expansion and 
Zo would be a peak of l/|E(z)| 2 , which is impossible. This proves Jensen’s theorem. We 
now turn our attention back to the integral in Eq. (7.100). 


Saddle Point Method 

Since each saddle point zo necessarily lies above the complex plane, that is, |E(zo)| 2 > 0, 
we write F in exponential form, e^ z,s \ in its vicinity without loss of generality. Note 
that having no zero in the complex plane is a characteristic property of the exponential 
function. Moreover, any saddle point with F(z) = 0 becomes a trough of F(z)\ 2 because 
|E(z)| 2 > 0. A case in point is the function z 2 at z = 0, where d(z 2 )/dz = 2z = 0. Here 
z 2 = (x + iy ) 2 = x 2 — y 2 + 2ixy, and 2 xy has a saddle point at z = 0, and so has x 2 — y 2 , 
but |z| 4 has a trough there. 

At zo the tangential plane is horizontal; that is, | z= j 0 = 0, or equivalently ^ | z=zo = 0. 

This condition locates the saddle point. Our next goal is to determine the direction of 
steepest descent. At zo, / has a power series 

/(z) = /(zo) + ^/"(zo)(z-zo ) 2 + -- - , 


( 7 . 102 ) 
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!/U y)l 2 



or 

Hz) = Hz o) + ~ (f'Czo) + e)(z - zof, (7.103) 

upon collecting all higher powers in the (small) e. Let us take f"(z o) / 0 for simplicity. 
Then 

/"(zo)(z-zo) 2 = -i 2 , t real, (7.104) 

defines a line through zo (saddle point axis in Fig. 7.18). At zo, t — 0. Along the axis 
S f''(zo)(z — zo) 2 is zero and v = %f(z) ~ 3/(zo) is constant if e in Eq. (7.103) is ne¬ 
glected. Equation (7.104) can also be expressed in terms of angles, 

7T 1 ,, 

arg(z - zo) = - - - arg / (zo) = constant. (7.105) 

Since |-F(z)| 2 = exp(2SH/) varies monotonically with JH/, |E(z)| 2 ~ exp(— I 2 ) falls off 
exponentially from its maximum at / = 0 along this axis. Hence the name steepest descent. 
The line through zo defined by 

f"(zo)(z-zo) 2 = +t 2 (7.106) 

is orthogonal to this axis (dashed in Fig. 7.18), which is evident from its angle, 

1 

arg(z - zo) = - - arg / (zo) = constant, 
when compared with Eq. (7.105). Here T(z)| 2 grows exponentially. 


(7.107) 
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The curves SH/(z) = i)l/(zo) go through zo, so JH[(/"(zo) + e)(z 
(/"(zo) + e)(z — zo) 2 = i t for real r. Expressing this in angles as 

arg(z - zo) = ^ ^ arg(/"(z 0 ) + e), t > 0, 

arg(z - zo) = - * arg(/"(z 0 ) + e), t < 0, 


zo) 2 ] = 0, or 


(7.108a) 

(7.108b) 


and comparing with Eqs. (7.105) and (7.107) we note that these curves (dot-dashed in 
Fig. 7.18) divide the saddle point region into four sectors, two with SH/(z) > 31/(zo) 
(hence |F(z)| > |F(zo)|), shown shaded in Fig. 7.18, and two with SK/(z) < SH/(zo) 
(hence |F(z)| < |F(zo)|)- They are at ±j angles from the axis. Thus, the integration path 
has to avoid the shaded areas, where | F | rises. If a path is chosen to run up the slopes above 
the saddle point, the large imaginary part of /(z) leads to rapid oscillations of F(z) — e^ <z> 
and cancelling contributions to the integral. 

So far, our treatment has been general, except for /"(zo) / 0, which can be relaxed. 
Now we are ready to specialize the integrand F further in order to tie up the path selection 
with the asymptotic behavior as s -» oo. 

We assume that s appears linearly in the exponent, that is, we replace exp f(z,s) -» 
exp(.v/'(z)). This dependence on s ensures that the saddle point contribution at zo grows 
with s —»■ oo providing steep slopes, as is the case in most applications in physics. In order 
to account for the region far away from the saddle point that is not influenced by s, we 
include another analytic function, g(z), which varies slowly near the saddle point and is 
independent of s. 

Altogether, then, our integral has the more appropriate and specific form 


I(s) — J g(z)e sf(z) dz. (7.109) 

The path of steepest descent is the saddle point axis when we neglect the higher-order 
terms, s , in Eq. (7.103). With s, the path of steepest descent is the curve close to the axis 
within the unshaded sectors, where v = 3/(z) is strictly constant, while S/(z) is only 
approximately constant on the axis. We approximate I ( s ) by the integral along the piece 
of the axis inside the patch in Fig. 7.18, where (compare with Eq. (7.104)) 

z = zo+ ■*<?'", a = ^ - ^arg/"(zo), a<x<b. (7.110) 


We find 


Ks) 



+ xe la ) exp[s/(zo +xe'")] dx , 


(7.111a) 


and the omitted part is small and can be estimated because SH(/(z) — /(zo)) has an upper 
negative bound, —R say, that depends on the size of the saddle point patch in Fig. 7.18 
(that is, the values of a, b in Eq. (7.110)) that we choose. In Eq. (7.111) we use the power 
expansions 

/(z 0 + xe ,a ) = /(z 0 ) + ^f"(z 0 )e 2,o, x 2 H-, 

8 (zo + xe' a ) = g(zo) + g(zo)e ia x H-, 


(7.111b) 
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and recall from Eq. (7.110) that 

I/"( Z0)e 2 '“ = -i|/"( Z0 )|<0. 

We find for the leading term for s —> oo: 

/»b . 

I(s) = g(z 0 )e sf(zo)+ia e~2dx. (7.112) 

J a 

Since the integrand in Eq. (7.112) is essentially zero when x departs appreciably from 
the origin, we let b -> oo and a -> —oo. The small error involved is straightforward to 
estimate. Noting that the remaining integral is just a Gauss error integral. 



1 

dx — — 
a 



dx = 


V2n 

a 


we finally obtain 


\/27Tg (Z0k S ^ (Z ° V" 

\sf"(zo)\ l/2 


(7.113) 


where the phase a was introduced in Eqs. (7.110) and (7.105). 

A note of warning: We assumed that the only significant contribution to the integral 
came from the immediate vicinity of the saddle point(s) z = zo . This condition must be 
checked for each new problem (Exercise 7.3.5). 


Example 7.3.1 Asymptotic Form ofthe FIankel Function H ( v ]) (s) 


In Section 11.4 it is shown that the Hankel functions, which satisfy Bessel’s equation, may 
be defined by 

i rooe ,7t j 

H?\s)=± I (7.114) 

n i J d,o z + 

H W ( s)=fiif 0 e fr/2)ft-i/*) * . (7.115) 

Ttl JC2,ooe~ l7T Z 

The contour C\ is the curve in the upper half-plane of Fig. 7.19. The contour CT is in the 
lower half-plane. We apply the method of steepest descents to the first Hankel function, 
Hy^is), which is conveniently in the form specified by Eq. (7.109), with f(z) given by 

f (z) — ^ (z ~) • (7.116) 


By differentiating, we obtain 
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y 



Figure 7.19 Flankel function contours. 


Setting f'(z) = 0, we obtain 


z 


i. —i. 


(7.118) 


Hence there are saddle points at z — +i and z = — i- At z = i, f"(i) = —i, or arg /"(/) = 
—7r/2, so the saddle point direction is given by Eq. (7.110) as a — j + j — ftz. For the 
integral for we must choose the contour through the point z — +i so that it starts at 

the origin, moves out tangentially to the positive real axis, and then moves around through 
the saddle point at z = +i in the direction given by the angle a — 3tt/ 4 and then on out to 
minus infinity, asymptotic with the negative real axis. The path of steepest ascent, which we 
must avoid, has the phase — ^ arg f"(i) — j, according to Eq. (7.107), and is orthogonal 
to the axis, our path of steepest descent. 

Direct substitution into Eq. (7.113) with a — 3 tt/4 now yields 




1 V27r/- y - 1 e (i / 2)(, '“ 1 /'' ) e 37r '/ 4 
Vi |(s/2)(—2/*3)|V2 


= J JL e (in/2)(-v-2) e is e i(?x/4)' 
7 TS 


(7.119) 


By combining terms, we obtain 


H^\s) J~^ e Ks-v(7t/2)-7t/ 4 ) ( 7 . 120 ) 

V ns 

as the leading term of the asymptotic expansion of the Hankel function hV is). Additional 
terms, if desired, may be picked up from the power series of / and g in Eq. (7.11 lb). The 
other Hankel function can be treated similarly using the saddle point at z = —i. H 


Example 7.3.2 Asymptotic Form of the Factorial Function T(1 + ,v) 

In many physical problems, particularly in the field of statistical mechanics, it is desir¬ 
able to have an accurate approximation of the gamma or factorial function of very large 
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numbers. As developed in Section 8.1, the factorial function may be defined by the Euler 
integral 

nOO pOO 

r(l+s)= / p s e~ p dp = s s+l e s(lnz ~ z) dz. (7.121) 

Jo Jo 

Here we have made the substitution p = zs in order to convert the integral to the form 
required by Eq. (7.109). As before, we assume that s is real and positive, from which it fol¬ 
lows that the integrand vanishes at the limits 0 and oo. By differentiating the "-dependence 
appearing in the exponent, we obtain 


df(z) 

dz 


d 

— (lnj-s) = 
dz 




(7.122) 


which shows that the point z = 1 is a saddle point and arg f" (1) = arg(— 1) = it. According 
to Eq. (7.109) we let 

Z-l=xe ia , a=|-larg/"(l)=|-|=0, (7.123) 

with x small, to describe the contour in the vicinity of the saddle point. From this we see 
that the direction of steepest descent is along the real axis, a conclusion that we could have 
reached more or less intuitively. 

Direct substitution into Eq. (7.113) with a — 0 now gives 


\J2trs s+1 e 

k(-i -2 )l 1/2 


Thus the first term in the asymptotic expansion of the factorial function is 


F(1 + s) & s/2nss s e s . 


(7.124) 


(7.125) 


This result is the first term in Stirling’s expansion of the factorial function. The method of 
steepest descent is probably the easiest way of obtaining this first term. If more terms in 
the expansion are desired, then the method of Section 8.3 is preferable. ■ 

In the foregoing example the calculation was carried out by assuming s to be real. This 
assumption is not necessary. We may show (Exercise 7.3.6) that Eq. (7.125) also holds 
when s is replaced by the complex variable w, provided only that the real part of w be 
required to be large and positive. 

Asymptotic limits of integral representations of functions are extremely important in 
many approximations and applications in physics : 


L 


g(z)e s f (z) dz 


~j2ng (zo ) e s ^ (zo) e' a 

VI s /" (zo) I 


f'izo) — 0. 


The saddle point method is one method of choice for deriving them and belongs in the 
toolkit of every physicist and engineer. 
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Exercises 


7.3.1 


7.3.2 


7.3.3 


Using the method of steepest descents, evaluate the second Hankel function, given by 


/U (2) (s)= — 


m J_ 


,(.s/2)(z-l/z) 


— 00 C 2 


dz 

7V+I ’ 


with contour C 2 as shown in Fig. 7.19. 

ANS. Hl 2 \s) » [^e-ds-n/A-vn/T)_ 
V TVS 

Find the steepest path and leading asymptotic expansion for the Fresnel integrals 
/o cosx 2 dx, sinx 2 dx. 

Hint. Use f Q l e ,sz ~ dz. 

(a) In applying the method of steepest descent to the Hankel function show 

that 


9t[/(z)]<SK[/(zo)]=0 


for z on the contour C i but away from the point z = zo = i ■ 
(b) Show that 


and 


^[/(z)]>0 for 0 < r < 1, 


JH[/U)]<0 for r > 1, 


1 - <0 <7T 

2 " tr 

— 7 r <6 < — 
2 


Tt TX 

■- <0 < - 
2 2 


(Fig. 7.20). This is why C\ may not be deformed to pass through the second saddle 
point, z = —i. Compare with and verify the dot-dashed lines in Fig. 7.18 for this case. 



Figure 7.20 
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7 . 3.4 


7 . 3.5 


7 . 3.6 


7 . 3.7 


Determine the asymptotic dependence of the modified Bessel functions I v (x), given 


I v (x) = ^~~ [ 
2m J c 


,(.v/2)(/+l/0 


dt 

fV+\ ' 


tc t' 

The contour starts and ends at t = —oo, encircling the origin in a positive sense. There 
are two saddle points. Only the one at z — +1 contributes significantly to the asymptotic 
form. 


Determine the asymptotic dependence of the modified Bessel function of the second 
kind, K v {x ), by using 

Show that Stirling’s formula, 

T(1 + s) V2nss s e~ s , 


holds for complex values of s (with ;H (.v) large and positive). 

Hint. This involves assigning a phase to s and then demanding that 5[,y/(")] = constant 
in the vicinity of the saddle point. 

Assume to have a negative power-series expansion of the form 


(D/cO- 


Hl'Hs) 





OO 


n= 0 


with the coefficient of the summation obtained by the method of steepest descent. Sub¬ 
stitute into Bessel’s equation and show that you reproduce the asymptotic series for 
Hl l \s) given in Section 11.6. 


Additional Readings 


Nussenzveig, H. M., Causality and Dispersion Relations, Mathematics in Science and Engineering Series, 
Vol. 95. New York: Academic Press (1972). This is an advanced text covering causality and dispersion re¬ 
lations in the first chapter and then moving on to develop the implications in a variety of areas of theoretical 
physics. 

Wyld, H. W., Mathematical Methods for Physics. Reading, MA: Benjamin/Cummings (1976), Perseus Books 
(1999). This is a relatively advanced text that contains an extensive discussion of the dispersion relations. 
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Chapter 8 


The Gamma Function 
(Factorial Function) 


The gamma function appears occasionally in physical problems such as the normalization 
of Coulomb wave functions and the computation of probabilities in statistical mechanics. 
In general, however, it has less direct physical application and interpretation than, say, the 
Legendre and Bessel functions of Chapters 11 and 12. Rather, its importance stems from its 
usefulness in developing other functions that have direct physical application. The gamma 
function, therefore, is included here. 

8.1 Definitions, Simple Properties 

At least three different, convenient definitions of the gamma function are in common use. 
Our first task is to state these definitions, to develop some simple, direct consequences, and 
to show the equivalence of the three forms. 


Infinite Limit (Euler) 


The first definition, named after Euler, is 

1-2-3 ■■■n 

T (z) = lim 


00 z(z + l)(z + 2) • • • (z + n) 


z ^ 0, —1, —2, —3, — 


( 8 - 1 ) 


This definition of T(z) is useful in developing the Weierstrass infinite-product form of 
T(z), Eq. (8.16), and in obtaining the derivative of In T(z) (Section 8.2). Here and else- 


499 



500 Chapter 8 Gamma-Factorial Function 


where in this chapter z may be either real or complex. Replacing z with z + 1, we have 

1-2-3 • • • n 


r (z + 1) = lim 

n —xx 

= lim 


„z+i 


n^oo ( z + l)( z + 2)(z + 3) • • • (z + n + 1) 
nz 1 - 2-3 ■ ■ - n 


n-HX>z + n + 1 z(z+ l)(z + 2)---(z + n) 

= zr(z). 


(8.2) 


This is the basic functional relation for the gamma function. It should be noted that it 
is a difference equation. It has been shown that the gamma function is one of a general 
class of functions that do not satisfy any differential equation with rational coefficients. 
Specifically, the gamma function is one of the very few functions of mathematical physics 
that does not satisfy either the hypergeometric differential equation (Section 13.4) or the 
confluent hypergeometric equation (Section 13.5). 

Also, from the definition, 

1-2-3 ■■■n 

r(i)=iim———T^TT' ? = L (83) 

n-H>o 1 • 2 • 3 • • • n(n + 1) 

Now, application of Eq. (8.2) gives 

r(2) = l, 

T(3) = 2T(2) = 2,... (8.4) 

T(n) = l-2-3---(n- 1) = (n - 1)!. 


Definite Integral (Euler) 

A second definition, also frequently called the Euler integral, is 


/»00 

T(z) = / e~ f t z ~ l dt. 

9t(z) > 0. 

Jo 



(8.5) 


The restriction on z is necessary to avoid divergence of the integral. When the gamma 
function does appear in physical problems, it is often in this form or some variation, such 
as 


r(z) = 2 f 

OO 

e 

~‘ 2 t 2z ~ l dt, 

SH(z) > 0. 

(8.6) 

Jo 






r l 

( 

' 1 \ 1 

z-l 



r (z) = 

!n( 

) 

dt, 

9f(z) > 0. 

(8.7) 

Jo 

L \ 

j) J 





When z = i, Eq. (8.6) is just the Gauss error integral, and we have the interesting result 


r(£) = VSF. 


( 8 . 8 ) 


Generalizations of Eq. (8.6), the Gaussian integrals, are considered in Exercise 8.1.11. This 
definite integral form of F(z), Eq. (8.5), leads to the beta function. Section 8.4. 
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To show the equivalence of these two definitions, Eqs. (8.1) and (8.5), consider the 
function of two variables 


t ' " 
- 1 t 
n 


z-l 


dt, St(z)>0, 


(8.9) 


with n a positive integer. 1 Since 


lim 

n—>oo 



( 8 . 10 ) 


from the definition of the exponential 

/*oo 

lim F(z,n) = F(z, oo) = / e~ f t z ~ l dt = F(z) (8.11) 

«^oo J Q 

by Eq. (8.5). 

Returning to F(z, n), we evaluate it in successive integrations by parts. For convenience 
let u — t/n. Then 


= n z f 1 

Jo 


(l—u) n u z 1 du. 


( 8 . 12 ) 


F(z,n) = 

Integrating by parts, we obtain 

n z Z lo 2 JO 

Repeating this with the integrated part vanishing at both endpoints each time, we finally 
get 


1 rl 

+ - 

n z Jo 


(1 — u) n 1 u z du. 


(8.13) 


F(z, n) — n : 


n(n — 1) • • • 1 




z(z + 1) • • • (z + n 
1 • 2 • 3 • • • n 


Z+n — 1 


du 


z(z+ l)(z + 2) • • ■ (z + n) 

This is identical with the expression on the right side of Eq. (8.1). Hence 


(8.14) 


lim F(z,n) — F(z, oo) = F(z), (8.15) 

n —>■ oo 

by Eq. (8.1), completing the proof. 


Infinite Product (Weierstrass) 

The third definition (Weierstrass’ form) is 



(8.16) 


1 The form of F(z, n ) is suggested by the beta function (compare Eq. (8.60)). 
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where y is the Euler-Mascheroni constant, 

y = 0.5772156619_ 


(8-17) 


This infinite-product form may be used to develop the reflection identity, Eq. (8.23), and 
applied in the exercises, such as Exercise 8.1.17. This form can be derived from the original 
definition (Eq. (8.1)) by rewriting it as 


1-2-3 ■■■n 
>oc z(z + 1) • • • (z + n) 

Inverting Eq. (8.18) and using 


= lim f[ 1 

tt-»00 7 1 1 \ 


m=l 


-1 


n~ z = e ( ~ lnn)z , 


we obtain 


1 

-= z lim e 

T(z) n-*oo 


(-In n)z l - f | 1 . 
m= 1 ' 


Multiplying and dividing by 
exp 


1 1 
1 + — + — 
2 3 


1 

- \z 


n- 

m= 1 


,z/m 


(8.18) 


(8.19) 


( 8 . 20 ) 


( 8 . 21 ) 


we get 


1 


r(z) 


lim exp 


hm n 1 

n—> oo 1 1 \ 
m= 1 x 


i i 

1 + 2 + 3' 


-In n )z 

n 


,-Z'fm 


( 8 . 22 ) 


As shown in Section 5.2, the parenthesis in the exponent approaches a limit, namely y, the 
Euler-Mascheroni constant. Hence Eq. (8.16) follows. 

It was shown in Section 5.11 that the Weierstrass infinite-product definition of F(") led 
directly to an important identity, 

r(z)r(l-z)= -t^—- (8.23) 

SinZ7T 

Alternatively, we can start from the product of Euler integrals, 

nOO nOO 

T(z + 1)T(1 — z) = I s z e~ s ds I t~ z e~'dt 

Jo 


-J. 

-L 


” = d” 


f 


e U udu = 


nz 


Jo (v+l) 2 Jo sin n z 

transforming from the variables s, t to u = s + t, v = s/t, as suggested by combining the 
exponentials and the powers in the integrands. The Jacobian is 

s + t (v + l) 2 


J = 


1 1 

J_ _ S_ 

t t 2 
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where (v + 1 )t — u. The integral f£° e~ u udu — 1, while that over v may be derived by 
contour integration, giving si ^_ . 

This identity may also be derived by contour integration (Example 7.1.6 and Exer¬ 
cises 7.1.18 and 7.1.19) and the beta function. Section 8.4. Setting z — ^ in Eq. (8.23), 
we obtain 


r(i)=Vtr (8.24a) 

(taking the positive square root), in agreement with Eq. (8.8). 

Similarly one can establish Legendre’s duplication formula, 

T(1 + z)r(z + \) = 2~ lz ^Y{2z + 1). (8.24b) 


The Weierstrass definition shows immediately that F(z) has simple poles at z = 
0,-1, —2, —3,... and that [T(z)] _1 has no poles in the finite complex plane, which means 
that T (z) has no zeros. This behavior may also be seen in Eq. (8.23), in which we note that 
jr/(sin Tcz.) is never equal to zero. 

Actually the infinite-product definition of T(z) may be derived from the Weierstrass 
factorization theorem with the specification that [T(z)] _1 have simple zeros at z = 

0, —1, —2, —3,_The Euler-Mascheroni constant is fixed by requiring T(l) = 1. See 

also the products expansions of entire functions in Section 7.1. 

In probability theory the gamma distribution (probability density) is given by 


/(*) = 


P a r(a) 

0 , 


x >0 
x < 0. 


(8.24c) 


The constant [/l a 'r(a)] _1 is chosen so that the total (integrated) probability will be unity. 
For x —> E, kinetic energy, a —> and ft —> kT, Eq. (8.24c) yields the classical Maxwell- 
Boltzmann statistics. 


Factorial Notation 


So far this discussion has been presented in terms of the classical notation. As pointed out 
by Jeffreys and others, the —1 of the z — 1 exponent in our second definition (Eq. (8.5)) is 
a continual nuisance. Accordingly, Eq. (8.5) is sometimes rewritten as 



e~'t z 


dt 


= z\. 


i)i(z) > -1, 


(8.25) 


to define a factorial function z!. Occasionally we may still encounter Gauss’ notation, 
F[(z), for the factorial function: 


n ( z) = z! = r(z+l). (8.26) 

The T notation is due to Legendre. The factorial function of Eq. (8.25) is related to the 
gamma function by 


T(z) = (z — 1)! 


or 


T(z+ l) = z!. 


(8.27) 
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n.v+D 



Figure 8.1 The factorial 
function — extension to negative 
arguments. 


If z — n, a positive integer (Eq. (8.4)) shows that 

z! = n! = 1 • 2 • 3 • • •«, (8.28) 


the familiar factorial. However, it should be noted that since z! is now defined by Eq. (8.25) 
(or equivalently by Eq. (8.27)) the factorial function is no longer limited to positive integral 
values of the argument (Fig. 8.1). The difference relation (Eq. (8.2)) becomes 


z\ 

(z — 1)! = —. 

z 

(8.29) 

This shows immediately that 


0! = 1 

(8.30) 

and 


n ! = ±oo for n , a negative integer. 

(8.31) 

In terms of the factorial, Eq. (8.23) becomes 


z!( z)!= nZ . 

(8.32) 


sinjrz 

By restricting ourselves to the real values of the argument, we find that T(jr + 1) defines 
the curves shown in Figs. 8.1 and 8.2. The minimum of the curve is 


T(jc + 1) = x! = (0.46163 ...)! = 0.88560.... 


(8.33a) 
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6 

5 

4 

3 

2 

1 

0 

- 1.0 

-1.0 0 1.0 2.0 3.0 4.0 

Figure 8.2 The factorial function and the first two derivatives of 
ln(T(.r + 1)). 

Double Factorial Notation 



In many problems of mathematical physics, particularly in connection with Legendre poly¬ 
nomials (Chapter 12), we encounter products of the odd positive integers and products of 
the even positive integers. For convenience these are given special labels as double facto¬ 
rials: 


1 • 3 • 5 • • • (2n + 1) = (2n + 1)!! 
2 • 4 • 6 • • • (2n) = (2«)!!. 


(8.33b) 


Clearly, these are related to the regular factorial functions by 

„ (2« + 1)! 

(2n)!! = 2 n! and (2n+l)!!=--. (8.33c) 

2 n n\ 

We also define (—1)!! = 1, a special case that does not follow from Eq. (8.33c). 


Integral Representation 

An integral representation that is useful in developing asymptotic series for the Bessel 
functions is 

J e~ z z v dz = (e 27Tiv - l)T(v+l), (8.34) 

where C is the contour shown in Fig. 8.3. This contour integral representation is only 
useful when v is not an integer, z = 0 then being a branch point. Equation (8.34) may be 
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v 




■ Cut line 


Figure 8.4 The contour of Fig. 8.3 deformed. 


readily verified for v > —1 by deforming the contour as shown in Fig. 8.4. The integral 
from oo into the origin yields —(v!), placing the phase of z at 0. The integral out to oo (in 
the fourth quadrant) then yields e 2n ' v v\ , the phase of z having increased to lit. Since the 
circle around the origin contributes nothing when v > —1, Eq. (8.34) follows. 

It is often convenient to cast this result into a more symmetrical form: 

J e~ z (—z) v dz — 2/T(v + 1) sin(u7r). (8.35) 

This analysis establishes Eqs. (8.34) and (8.35) for v > —1. It is relatively simple to 
extend the range to include all nonintegral v. First, we note that the integral exists for 
v < — 1 as long as we stay away from the origin. Second, integrating by parts we find 
that Eq. (8.35) yields the familial' difference relation (Eq. (8.29)). If we take the difference 
relation to define the factorial function of v < — 1, then Eqs. (8.34) and (8.35) are verified 
for all v (except negative integers). 


Exercises 

8.1.1 Derive the recurrence relations 


r(z+l) = zr(z) 

from the Euler integral (Eq. (8.5)), 

/* OO 

T(z) = / e~'t z ~ { dt. 

Jo 



8.1 Definitions, Simple Properties 


507 


8.1.2 


8.1.3 


8.1.4 


8.1.5 


8.1.6 


8.1.7 


8.1.8 


8.1.9 

8.1.10 
8.1.11 


In a power-series solution for the Legendre functions of the second kind we encounter 
the expression 

(n + 1 )(n + 2 )(n + 3) • • • (n + 2s — 1)(« + 2s) 

2 • 4 • 6 • 8 • • • (2s — 2) (2 s) ■ (2 n + 3)(2n + 5)(2 n + 7)••• (2 n + 2s + 1) ’ 
in which s is a positive integer. Rewrite this expression in terms of factorials. 


Show that, as s — n —»■ negative integer, 

(s-n)l (-iy l ~ s (2n-2s)\ 

(2s — 2n)\ (n — s)\ 

Here s and n are integers with s < n. This result can be used to avoid negative facto¬ 
rials, such as in the series representations of the spherical Neumann functions and the 
Legendre functions of the second kind. 


Show that T (z) may be written 

r°° 2 

r(z) = 2 e~ r t 2z ~ l dt, $R(z)>0, 
Jo 


r (z) = 


/' 


In I - 


z —1 


dt, St(z) > 0. 


In a Maxwellian distribution the fraction of particles with speed between v and v + dv 
is 


dN 

~N~ 


— 4 7T 


\ 


3/2 


2rckT 




exp 


mv 2 \ 
'2kT ) 


v 2 dv, 


N being the total number of particles. The average or expectation value of v n is debited 
as (■ v n ) — N~ l f v n dN. Show that 

1 ' \ m ) r(3/2) * 

By transforming the integral into a gamma function, show that 

1 




x k ln.r dx = 


(^+ 1 ) 2 ’ 


k > — 1. 


Show that 


Show that 


r 

Jo 


e x dx = TI - I. 


(ax - 1)! 1 

lim —-= -. 

x->o (x — 1)! a 

Locate the poles of T(z). Show that they are simple poles and determine the residues. 


Show that the equation x\ — k,k^4 0, has an inbnite number of real roots. 


Show that 
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8.1.12 


8 . 1.13 


8 . 1.14 


8 . 1.15 


8 . 1.16 


(a) 


(b) 


t “ s+1 exp(— ax 2 ) dx — 


f 

Jo 

poo 

I x 2s exp(— ax 2 ) dx — 

Jo 


s'. 


2a s+l ' 

0 ~ 2 )! (2s — 1 )!! fn 

2a s+1 /2 ~~ W 


These Gaussian integrals are of major importance in statistical mechanics. 

(a) Develop recurrence relations for (2n)!! and for (2 n + 1)!!. 

(b) Use these recurrence relations to calculate (or to define) 0!! and (—1)!!. 


ANS. 0!! = 1, (-!)!!=!. 


For s a nonnegative integer, show that 


(—2s — !)!!=■ 


(-1 y 


(- 1 )^ 2 ^! 


(2s — 1)!! (2v)! 

Express the coefficient of the nth term of the expansion of (1 + x ) 1 / 2 

(a) in terms of factorials of integers, 

(b) in terms of the double factorial (!!) functions. 

Express the coefficient of the nth term of the expansion of (1 + x)~ x ^ 2 

(a) in terms of the factorials of integers, 

(b) in terms of the double factorial (!!) functions. 

„ (2 n)\ ,, (2n — 1 )!! 

ANS. a„ = (-!)" = (—!)"' 


n = 2,3,.. 


2 2n (n\) 2 

The Legendre polynomial may be written as 


( 2 n)!! 


n= 1,2,3,.. 


P„(cos6) = 2 


( 2 n - 1 )!! 
(2n)!! 


1 n 

cos n6 + — • -- 7 cos(n — 2)0 


1 • 3 n(n - 1) 


1 2 n - 1 


cos(;? — A)0 


1 • 2 (2 n - 1)(2 n - 3) 

1-3-5 n(n — l)(n — 2) 

1 -2-3 (2n - l)(2n -3)(2n -5) 


cos(n — 6)0 + ■ ■ 


Let n — 2s + 1 ■ Then 

P„(cosO) — P2s+i(cos0) = a m cos(2 m + 1 )0. 


m =0 


Find a m in terms of factorials and double factorials. 
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8 . 1.17 


8 . 1.18 

8 . 1.19 


8.1.20 


8.1.21 


8.1.22 

8 . 1.23 


(a) Show that 


r G“ n )r{\ + n) = (-!)"*, 


where n is an integer. 

(b) Express T(^ + n) and T( ^ — n) separately in terms of 7T 1 / 2 and a !! function. 


, (2n — 1)!! ,,, 

ANS.r(i + n)= 2>| 7T 1 / 2 , 


From one of the definitions of the factorial or gamma function, show that 


(ix)'.\ 2 = - 


sinh jtx 


Prove that 


OO r- 

|r(« + ii8)| = |r(«)|f[ i + 

«=o*- 


P~ 


(a + n ) 2 


- 1/2 


This equation has been useful in calculations of beta decay theory. 
Show that 

7 Xb 


(n + i b)\ 


= (. 


\ sinh7T b 


n^+o 2 ) 1 ' 2 


5=1 


for n, a positive integer. 

Show that 

|x!| > |(x + fv)!j 

for all a'. The variables x and y are real. 

Show that 


ira+.»r=- 


7r 


cosh ny 

The probability density associated with the normal distribution of statistics is given by 


fix) = 


1 


ct(27t) 1 / 2 

with (—oo, oo) for the range of x. Show that 


exp 


(x - n)~ 

2 a 2 


(a) the mean value of x, (a ) is equal to /x, 

(b) the standard deviation ((.r 2 > — (x) 2 ) 1 ^ 2 is given by a. 


8 . 1.24 


From the gamma distribution 


fix) = 


_v«- 1 p-x/P 

P a r(a) 

0, 


show that 


x > 0, 

A < 0, 


(a) {x) (mean) = afi, (b) a 2 (variance) = {x 2 ) — (a) 2 = afi 2 . 
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8 . 1.25 The wave function of a particle scattered by a Coulomb potential is i (r(r,6). At the 
origin the wave function becomes 

i/f(0) = e _jr,//2 r(l+z», 
where y — Z\Z 2 e 2 /hv. Show that 

2 27 xy 

~ e 2jT y - 1 ' 

8 . 1.26 Derive the contour integral representation of Eq. (8.34), 

2iv\ sin V7T = J e~ z (—z) v dz. 

8 . 1.27 Write a function subprogram FACT ( N ) (fixed-point independent variable) that will cal¬ 
culate N\. Include provision for rejection and appropriate error message if N is nega¬ 
tive. 

Note. For small integer N, direct multiplication is simplest. For large N, Eq. (8.55), 
Stirling’s series would be appropriate. 

8 . 1.28 (a) Write a function subprogram to calculate the double factorial ratio (2 N — 1)!!/ 

(2 A')!!. Include provision for A' = 0 and for rejection and an error message if N is 
negative. Calculate and tabulate this ratio for N = 1(1)100. 

(b) Check your function subprogram calculation of 199! 1/200!! against the value ob¬ 
tained from Stirling’s series (Section 8.3). 

199!! 

ANS. -= 0.056348. 

200 !! 

8 . 1.29 Using either the FORTRAN-supplied GAMMA or a library-supplied subroutine for 
x\ or T(a), determine the value of a for which F(a') is a minimum (1 < x < 2) and 
this minimum value of T(a). Notice that although the minimum value of T(a) may be 
obtained to about six significant figures (single precision), the corresponding value of x 
is much less accurate. Why this relatively low accuracy? 

8 . 1.30 The factorial function expressed in integral form can be evaluated by the Gauss- 
Faguerre quadrature. For a 10-point formula the resultant x\ is theoretically exact for 
x an integer, 0 up through 19. What happens if x is not an integer? Use the Gauss- 
Faguerre quadrature to evaluate x\, x = 0.0(0.1)2.0. Tabulate the absolute error as a 
function of a\ 


Check value. A!exact - -^quadrature = 0.00034 for X — 1.3. 

8.2 Digamma and Polygamma Functions 
Digamma Functions 

As may be noted from the three definitions in Section 8.1, it is inconvenient to deal with 
the derivatives of the gamma or factorial function directly. Instead, it is customary to take 
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the natural logarithm of the factorial function (Eq. (8.1)), convert the product to a sum, and 
then differentiate; that is. 


T(z+ 1) = zT(z) = lim 


and 


n^oo (z + l)(z + 2) • • • (z + n) 

lnT(z + 1) = lim [ln(n!) + zln« — ln(z + 1) 

n —>oo ^ 

- ln(z + 2)-In(z + n)], 


(8.36) 


(8.37) 


in which the logarithm of the limit is equal to the limit of the logarithm. Differentiating 
with respect to z, we obtain 


— In T(z + 1) = xjf (z + 1) = lim In n — 
clz 


1 


1 


1 


z + 1 z + 2 


Z + n 


(8.38) 


which defines i f/(z + 1), the digamma function. From the definition of the Euler- 
Mascheroni constant, 2 Eq. (8.38) may be rewritten as 


f(z+ 1) = —y — E 

n =1 
oo 


1 


1 


Z + n n 

z 


n =1 


n (n + z) 


(8.39) 


One application of Eq. (8.39) is in the derivation of the series form of the Neumann function 
(Section 11.3). Clearly, 

xfr( 1) = -y = -0.577 215 664 901... . 3 (8.40) 

Another, perhaps more useful, expression for i (r(z) is derived in Section 8.3. 


Polygamma Function 


The digamma function may be differentiated repeatedly, giving rise to the polygamma 
function: 


JHI + l 

y (m)( z + i) = ^TT ln(2:!) 


= (-!)' 


m+1 


•*E 

n= 1 


i 


(z + n) m+l 


m = 1,2,3, 


(8.41) 


^Compare Sections 5.2 and 5.9. We add and substract VT 
y has been computed to 1271 places by D. E. Knuth, Math. Comput. 16: 275 (1962), and to 3566 decimal places by 
D. W. Sweeney, ibid. 17: 170 (1963). It may be of interest that the fraction 228/395 gives y accurate to six places. 
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A plot of i jr(x + 1) and f/'(x + 1) is included in Fig. 8.2. Since the series in Eq. (8.41) 
defines the Riemann zeta function 4 (with z = 0), 


oo 

c (/«)=^2 

n =1 



(8.42) 


we have 


l) m+1 m!f(m + l), w= 1,2,3,.... (8.43) 

The values of the polygamma functions of positive integral argument, t/f ( " !) (n + 1), may 
be calculated by using Exercise 8.2.6. 

In terms of the perhaps more common T notation, 

= = (8.44a) 

Maclaurin Expansion, Computation 

It is now possible to write a Maclaurin expansion for In T(z + 1): 

0° „ oo n 

lnr(z + 1) = V = -yz + T (-1)"— ?(n) (8.44b) 

z —' n\ z —' n 

n= 1 n=2 

convergent for Izl < 1 ; for z = x, the range is — 1 < x < 1. Alternate forms of this series 
appear in Exercise 5.9.14. Equation (8.44b) is a possible means of computing T(z + 1) for 
real or complex z, but Stirling’s series (Section 8.3) is usually better, and in addition, an 
excellent table of values of the gamma function for complex arguments based on the use 
of Stirling’s series and the recurrence relation (Eq. (8.29)) is now available. 5 


Series Summation 

The digamma and polygamma functions may also be used in summing series. If the general 
term of the series has the form of a rational fraction (with the highest power of the index in 
the numerator at least two less than the highest power of the index in the denominator), it 
may be transformed by the method of partial fractions (compare Section 15.8). The infinite 
series may then be expressed as a finite sum of digamma and polygamma functions. The 
usefulness of this method depends on the availability of tables of digamma and polygamma 
functions. Such tables and examples of series summation are given in AMS-55, Chapter 6 
(see Additional Readings for the reference). 


TSee Section 5.9. For z / 0 this series may be used to define a generalized zeta function. 

5 Table of the Gamma Function for Complex Arguments, Applied Mathematics Series No. 34. Washington, DC: National Bureau 
of Standards (1954). 
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Example 8.2 .7 Catalan’s Constant 

Catalan’s constant. Exercise 5.2.22, or (2) of Section 5.9 is given by 


K = p(2) = J2 


(2k + l) 2 ' 


(8.44c) 


Grouping the positive and negative terms separately and starting with unit index (to match 
the form of i/r (1) , Eq. (8.41)), we obtain 

OO 1 1 OO 1 

K - 1 + ^ (4m + l) 2 _ 9 _ ^ (An + 3) 2 ' 

n =1 n=l 


Now, quoting Eq. (8.41), we get 


^ = i + ^ (1) (i + i)-^ (1) (i + D- 


(8.44d) 


Using the values of i/r (1) from Table 6.1 of AMS-55 (see Additional Readings for the 
reference), we obtain 

K — 0.91596559_ 

Compare this calculation of Catalan’s constant with the calculations of Chapter 5, either 
direct summation or a modification using Riemann zeta function values. ■ 


Exercises 


8 . 2.1 Verify that the following two forms of the digamma function. 


nx +l ) = y - y 

z —' r 

r= 1 


f(x + 1) = V —^-—- - y, 
, r(r + x) 

r= 1 

are equal to each other (for x a positive integer). 

8.2.2 Show that i fr(z+ 1) has the series expansion 


f( z + l) = - y + J2(-l) n S(n)z n - 1 . 


8.2.3 For a power-series expansion of ln(z!), AMS-55 (see Additional Readings for reference) 
lists 


ln(z!) = — ln(l + z) + z( 1 — y) + y^(-l) 1 


, [4r(«> - l]z” 
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(a) Show that this agrees with Eq. (8.44b) for Izl < I- 

(b) What is the range of convergence of this new expression? 

8.2.4 Show that 



Hint. Try Eq. (8.32). 

8.2.5 Write out a Weierstrass infinite-product definition of I n (-!). Without differentiating, 
show that this leads directly to the Maclaurin expansion of ln(z!), Eq. (8.44b). 

8.2.6 Derive the difference relation for the polygamma function 

ir (m \z + 2) = + 1) + (-1) 1 " m = 0, 1,2. 

(z + l) m+l 

8.2.7 Show that if 

r(x + iy ) — u + i v, 

then 

T(x — iy) — u — i v. 

This is a special case of the Schwarz reflection principle. Section 6.5. 

8.2.8 The Pochhammer symbol ia) n is defined as 

( a) n — ci(a + 1) • • • (a + n — 1), (a)o = 1 

(for integral n). 

(a) Express (a) n in terms of factorials. 

(b) Find ( d/da)(a) n in terms of {a) n and digamma functions. 

ANS. = (a) n [^(a + n) - ir(a)]. 

(c) Show that 

(a)n+k = (■a + n) k ■ (a) n . 

8.2.9 Verify the following special values of the i// form of the di- and polygamma functions: 

*(1 ) = ~Y, ^ (1) ( l) = f(2), tA (2) (D = -2C(3). 

8.2.10 Derive the polygamma function recurrence relation 

V f(m) (1 +z) = V f(m) (z) + (— 1 ) m rn\/z m+ \ m = 0,1,2,.... 

8.2.11 Verify 

pOO 

(a) / e~ r \n rdr = —y. 

Jo 
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/•OO 

I re~' lnr dr — 1 — y. 
Jo 


poo 

/ r " 
Jo 


e~ r Ynr dr = (n — \)\ + n I r n ~ l e~ r \nr dr, n = 1,2,3. 


Hint. These may be verified by integration by parts, three parts, or differentiating the 
integral form of n ! with respect to n. 

8 . 2.12 Dirac relativistic wave functions for hydrogen involve factors such as [2(1 — or Z 2 ) ' , ' 2 ]! 
where a , the fine structure constant, is -jyj and Z is the atomic number. Expand 
[2(1 — orZ 2 ) 1 / 2 ] ! in a series of powers of a 2 Z 2 . 

8 . 2.13 The quantum mechanical description of a particle in a Coulomb field requires a knowl¬ 
edge of the phase of the complex factorial function. Determine the phase of (I + //;)! 
for small b. 

8 . 2.14 The total energy radiated by a blackbody is given by 

8t rk 4 T 4 x 3 

U — - r / - -dx. 

c 3 h 3 Jo e x — 1 

Show that the integral in this expression is equal to 3!£(4). 

[£(4) = 7r 4 /90 = 1.0823 ...] The final result is the Stefan-Boltzmann law. 

8 . 2.15 As a generalization of the result in Exercise 8.2.14, show that 

f°° x s dx 

/ ——=^(5+1), 9t(s)>0. 

Jo e x - 1 

8 . 2.16 The neutrino energy density (Fermi distribution) in the early history of the universe is 
given by 


Pv — ,, 


Show that 


8.2.17 Prove that 


h 3 Jo exp(x/kT) + 1 




e x + 1 


= s!(l -2“ s )c(i + 1), JH(s) > 0. 


Exercises 8.2.15 and 8.2.17 actually constitute Mellin integral transforms (compare Sec¬ 
tion 15.1). 


8.2.18 Prove that 


r°° t n p~ zt 

Jr (n) (z) = {-iy ,+l - - -dt, m(z)>0. 

Jo 1 - e ' 
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8.2.19 Using di- and polygamma functions, sum the series 

OO 1 OO 1 

(a) E n(n + 1) ’ ^ ^ n 1 - 1 ‘ 

n =1 «=2 

Vote. You can use Exercise 8.2.6 to calculate the needed digamma functions. 

8.2.20 Show that 


E 


i 

(n + a)(n + b) 


1 

{b — a) 


{(1 +b) — i/r(l -Fa)}, 


where a ^ b and neither a nor b is a negative integer. It is of some interest to compare 
this summation with the corresponding integral, 

f ( + d \ ( , h) =-r ~| ln(1 + ^) — ln (i + «)}• 

Ji (x + ci)(x + b) b — a 

The relation between ir(x) and In a is made explicit in Eq. (8.51) in the next section. 

8.2.21 Verify the contour integral representation of £(j), 


S(s) = 


(s)\ r (-zy- 1 

2jti Jc e z — 1 


-dz. 


The contour C is the same as that for Eq. (8.35). The points z — ±2 nni, n= 1,2, 3,..., 
are all excluded. 

8 . 2.22 Show that f (s) is analytic in the entire finite complex plane except at s = 1, where it 
has a simple pole with a residue of +1. 

Hint. The contour integral representation will be useful. 

8 . 2.23 Using the complex variable capability of FORTRAN calculate 1H(1 + ib)\, 3 (1 + ib)\, 
|(1 + f£>)!| and phase (1 + ib)\ for b — 0.0(0.1)1.0. Plot the phase of (1 + ib)\ versus b. 
Hint. Exercise 8.2.3 offers a convenient approach. You will need to calculate £(«)■ 


8.3 Stirling’s Series 

For computation of ln(z!) for very large z (statistical mechanics) and for numerical com¬ 
putations at nonintegral values of z, a series expansion of ln(-!) in negative powers of z is 
desirable. Perhaps the most elegant way of deriving such an expansion is by the method of 
steepest descents (Section 7.3). The following method, starting with a numerical integra¬ 
tion formula, does not require knowledge of contour integration and is particularly direct. 
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Derivation from Euler-Maclaurin Integration Formula 

The Euler-Maclaurin formula for evaluating a definite integral 6 is 
f(x)dx = \f{ 0) + /(1) + / (2) + ■ ■ ■ + \f{n) 


r 

Jo 


- b 2 [f'(n) - /'(0)] - b 4 [f'"(n) - /"'(0)] - • • • , (8.45) 

in which the are related to the Bernoulli numbers B 2n (compare Section 5.9) by 


(2ri)\b 2n = B 2n , 

B( > ~ h.’ 

~ ~ 30 ’ 


B 0 = l, 

B2=l 

B 4 ~ ~ 30’ ^ 10 = 66’ 

By applying Eq. (8.45) to the definite integral 

d.x 


and so on. 


r 

Jo 


1 


Jo (Z + x ) 2 z 
(for z not on the negative real axis), we obtain 

2\bi 4\b 4 


1 1 m 

~ = T2 + ^ 1 ( 2 + 1 ) ' 
z 2 z 2 


(8.46) 


(8.47) 


(8.48) 


(8.49) 


This is the reason for using Eq. (8.48). The Euler-Maclaurin evaluation yields i //' 1} (z +1), 
which is d 2 In T (z + 1) /dz 2 . 

Using Eq. (8.46) and solving for ^^(z + 1), we have 


f (l) (z + 1 ) = ^~f(z + 1 )=--—2 + ^ + ^ + - 

dz z 2 z z J 

I 1 ^ Bln 

z 2 z 2 , z 2 " +1 

n= 1 


i 


i 


Bi B 4 


(8.50) 


Since the Bernoulli numbers diverge strongly, this series does not converge. It is a semi- 
convergent, or asymptotic, series, useful if one retains a small enough number of terms 
(compare Section 5.10). 

Integrating once, we get the digamma function 

B±_ 

4 z 4 


1 Bi 

if(z+ 1) = Ci +lnz+ — - 

2 z 2 z z 


= C, 


■lnz+f-E B2 " 

2 z ^ 


n =1 


2 nz 2n 


(8.51) 


Integrating Eq. (8.51) with respect to z from " — 1 to z and then letting z approach infinity, 
C i, the constant of integration, may be shown to vanish. This gives us a second expression 
for the digamma function, often more useful than Eq. (8.38) or (8.44b). 


“This is obtained by repeated integration by parts. Section 5.9. 
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Stirling’s Series 


The indefinite integral of the digamma function (Eq. (8.51)) is 

■nr fe+ l) = C I+ ( z + 1)ln z - , + | + ... + 2a(2n ^-i + .... ,8.52) 

in which C 2 is another constant of integration. To fix C 2 we find it convenient to use the 
doubling, or Legendre duplication, formula derived in Section 8.4, 

T(z + l)T(z + i) = 2- 2z jt l/2 T(2z + 1). (8.53) 

This may be proved directly when z is a positive integer by writing T (2 z + 1) as a product 
of even terms times a product of odd terms and extracting a factor of 2 from each term 
(Exercise 8.3.5). Substituting Eq. (8.52) into the logarithm of the doubling formula, we 
find that C 2 is 

C 2 = j In 2 tt, (8.54) 


giving 


1 

lnT(z + 1) = -ln27r + 



In z-z+ — 
12 z 


1 

360? 


1 

1260? 


(8.55) 


This is Stirling’s series, an asymptotic expansion. The absolute value of the error is less 
than the absolute value of the first term omitted. 

The constants of integration C 1 and C 2 may also be evaluated by comparison with the 
first term of the series expansion obtained by the method of “steepest descent.” This is 
carried out in Section 7.3. 

To help convey a feeling of the remarkable precision of Stirling’s series for F(.v + 1), 
the ratio of the first term of Stirling’s approximation to F(s + 1) is plotted in Fig. 8.5. 
A tabulation gives the ratio of the first term in the expansion to T(i + 1) and the ratio of 
the first two terms in the expansion to F(s + 1) (Table 8.1). The derivation of these forms 
is Exercise 8.3.1. 


Exercises 

8 . 3.1 Rewrite Stirling’s series to give F (z + 1) instead of In F(z + 1). 

ANS. r(z+ 1) = V2nz z+l/2 e~ z ( 1 + — + —Ur - ^-r + ---Y 

V 12z 288z 2 51,840? J 

8 . 3.2 Use Stirling’s formula to estimate 52!, the number of possible rearrangements of cards 
in a standard deck of playing cards. 

8 . 3.3 By integrating Eq. (8.51) from z — 1 to z and then letting z —> 00 , evaluate the constant 
Ci in the asymptotic series for the digamma function i//(z). 

8 . 3.4 Show that the constant C 2 in Stirling’s formula equals 1 In 2tt by using the logarithm of 
the doubling formula. 
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Figure 8.5 Accuracy of Stirling’s formula. 


Table 8.1 


s 


---V2jt s s+l ' 2 e- s 

r(i + 1) 


--- •' 

r(i + i) 



1 

0.92213 

0.99898 

2 

0.95950 

0.99949 

3 

0.97270 

0.99972 

4 

0.97942 

0.99983 

5 

0.98349 

0.99988 

6 

0.98621 

0.99992 

7 

0.98817 

0.99994 

8 

0.98964 

0.99995 

9 

0.99078 

0.99996 

10 

0.99170 

0.99998 


8.3.5 By direct expansion, verify the doubling formula for z = n + k\n is an integer. 

8.3.6 Without using Stirling’s series show that 


8.3.7 


(a) ln(n!) < 


rn +1 

l 1 


nil 

J 1 


In A' c/a, (b) ln(n!) > / In a c/a; n is an integer > 2. 


Notice that the arithmetic mean of these two integrals gives a good approximation for 
Stirling’s series. 

Test for convergence 



2p+ I y,(2p-l)!!(2p + l)!! 

2p + 2 ~ lt ^ Q (2p)\\(2p + 2)!! 
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8 . 3.8 


8 . 3.9 


8 . 3.10 


This series arises in an attempt to describe the magnetic field created by and enclosed 
by a current loop. 


Show that 


Show that 


lim x b ~ a 

x —>oo 


(x + a)\ 
(x + b)l 


= 1 . 


lim 

n—>oo 


(2n-m nl/2 

(2 n)!! 


“ 1/2 . 


Calculate the binomial coefficient ( 2 ") to six significant figures for n = 10, 20, and 30. 
Check your values by 


(a) a Stirling series approximation through terms in n , 

(b) a double precision calculation. 

ANS. ( 2 °) = 1.84756 x 10 5 , (^) = 1.37846 x 10 11 , 

( 30 ) = 1.18264 x 10 17 . 

8.3.11 Write a program (or subprogram) that will calculate log 10 (v!) directly from Stirling’s 
series. Assume that x > 10. (Smaller values could be calculated via the factorial re¬ 
currence relation.) Tabulate log 10 (x!) versus x for x — 10(10)300. Check your results 
against AMS-55 (see Additional Readings for this reference) or by direct multiplication 
(for n — 10, 20, and 30). 

Check value. log 10 (100!) = 157.97. 

8.3.12 Using the complex arithmetic capability of FORTRAN, write a subroutine that will cal¬ 
culate ln(z!) for complex z based on Stirling’s series. Include a test and an appropriate 
error message if z is too close to a negative real integer. Check your subroutine against 
alternate calculations for z real, z pure imaginary, and z = 1 + ib (Exercise 8.2.23). 

Check values. |(/0.5)!| = 0.82618 
phase (iO.5)! = -0.24406. 


8.4 The Beta Function 


Using the integral definition (Eq. (8.25)), we write the product of two factorials as the 
product of two integrals. To facilitate a change in variables, we take the integrals over a 
finite range: 


e~ u u m du [ e~ v v n dv, 

J 0 

Replacing u with x 2 and v with y 2 , we obtain 

m\n\= lim 4 f e~* 2 x 2 ' n+l dx [ 
J 0 Jo 


m\n\ = lim 


a A —>00 JO 


f 

Jo 


a 


St(m) > -1, 
St(n) > -1. 


e~ y2 y 2n+i dy. 


(8.56a) 


(8.56b) 
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Figure 8.6 Transformation from 
Cartesian to polar coordinates. 


Transforming to polar coordinates gives us 

mini = lim 4 f° e~ r2 r 2m+2n+3 dr /"* cos 2m+1 6 sin 2 " +1 Odd 
Jo Jo 


fTT/l 

= (m+n+ 1)12/ cos 2m+1 0 sin 2 ” +1 0 d9. (8.57) 

Jo 

Flere the Cartesian area element dxdy has been replaced by rdrdO (Fig. 8.6). The last 
equality in Eq. (8.57) follows from Exercise 8.1.11. 

The definite integral, together with the factor 2, has been named the beta function: 


B(m + 1, n + 1) = 2 


r-Tl/l 

/ cos 2m+1 
Jo 


6 sin 


2n+l 


Odd 


mini 

(m + n + 1)! 


(8.58a) 


Equivalently, in terms of the gamma function and noting its symmetry. 


B(p,q) 


r(p)T(g) 

r (p + q) ’ 


B(q • p) — B(p, q). 


(8.58b) 


The only reason for choosing m + 1 and n + 1, rather than m and n, as the arguments of B 
is to be in agreement with the conventional, historical beta function. 


Definite Integrals, Alternate Forms 

The beta function is useful in the evaluation of a wide variety of definite integrals. The 
substitution t — cos 2 9 converts Eq. (8.58a) to 7 

mini r i 

B(m + 1,n + 1) =-—-=/ t m (\-t) n dt. (8.59a) 

(;«+« + !)! Jo 


7 The Laplace transform convolution theorem provides an alternate derivation of Eq. (8.58a), compare Exercise 15.11.2. 
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Replacing t by x 2 , we obtain 


2 (m 


— -= f x 2m+{ {\- X 2 )' 1 dx. (8.59b) 

- n + 1)! Jo ' 


The substitution t — u/( 1 + u ) in Eq. (8.59a) yields still another useful form, 

m!n! r°° u" 

(m 


n\n\ f 

■ n + 1)! ~ Jo 


o (1 + u) m+n + 2 


c/it. 


(8.60) 


The beta function as a definite integral is useful in establishing integral representations of 
the Bessel function (Exercise 11.1.18) and the hypergeometric function (Exercise 13.4.10). 

Verification of na/smna Relation 


If we take m = a, n = —a, — 1 < a < 1, then 

u a 


L 


0 (1 + m ) 2 


du = a\(—a)\. 


(8.61) 


By contour integration this integral may be shown to be equal to 7ra/sinjr<7 (Exer¬ 
cise 7.1.18), thus providing another method of obtaining Eq. (8.32). 


Derivation of Legendre Duplication Formula 


The form of Eq. (8.58a) suggests that the beta function may be useful in deriving the 
doubling formula used in the preceding section. From Eq. (8.59a) with m = n = z and 
9t(z) > -1, 


z!z! 

(2z + 1)! 



r (1 — t) z dt. 


(8.62) 


By substituting t = (1 + s)/2, we have 


zlz- 

(2z + 1)! 


= 2 


-2 z- 


7 > 


ds — 2 


-2 z 


I ' 1 


- 2 ) z ds. 


(8.63) 


The last equality holds because the integrand is even. Evaluating this integral as a beta 
function (Eq. (8.59b)), we obtain 


z!z! 

(2 z+l)! 


= 2 


(z+5)!' 


(8.64) 


Rearranging terms and recalling that (—J)! = tx ] I 2 , we reduce this equation to one form 
of the Legendre duplication formula, 

z!(z + 2 )! = 2- 2z - { tx 1,1 {2z + 1)!. (8.65a) 

Dividing by (z + J), we obtain an alternate form of the duplication formula: 


z!(z — i)! = 2“ 2;: 7r 1/2 (2z)!. 


(8.65b) 
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Although the integrals used in this derivation are defined only for JH(z) > — 1, the results 
(Eqs. (8.65a) and (8.65b) hold for all regular points z by analytic continuation . 8 

Using the double factorial notation (Section 8.1), we may rewrite Eq. (8.65a) (with z = 
n, an integer) as 

(n + j)! = 7 r 1 / 2 ( 2 n + l)!!/2" +1 . (8.65c) 

This is often convenient for eliminating factorials of fractions. 


Incomplete Beta Function 


Just as there is an incomplete gamma function (Section 8.5), there is also an incomplete 
beta function, 


L 


B x (p,q)= I t p l ( 1 - t) q 1 dt 


7-1 . 


0 < x < 1 , p > 0 , q > 0 (if x = 1 ). ( 8 . 66 ) 


Clearly, B x= \{p, q) becomes the regular (complete) beta function, Eq. (8.59a). A power- 
series expansion of B x (p, q) is the subject of Exercises 5.2.18 and 5.7.8. The relation to 
hypergeometric functions appears in Section 13.4. 

The incomplete beta function makes an appearance in probability theory in calculating 
the probability of at most k successes in n independent trials . 9 


Exercises 


8 . 4.1 Derive the doubling formula for the factorial function by integrating (sin27) 2,1+1 = 
(2 sin 6 cos @) 2 " +1 (and using the beta function). 

8 . 4.2 Verify the following beta function identities: 


8 . 4.3 


(a) 

B(a, b) = 

B(a + 1, b) + B(a , b + 

(b) 

B(a, b) — 

a + b 

—-— B(a, b + 1), 
b 



b- 1 

(c) 

B{a, b) — 

- B(a + 1, b — 1), 



a 

(d) 

B(a, b)B{a + b,c) — B(b , c)B(a, 

(a) 

Show that 



/>-> 


1 / 2 x 2 " dx — 


7T/2, 

_(2 n- 1 )!! 
* (2n + 2 )!!’ 


n — 0 

n= 1,2,3,.... 


x If 2 z is a negative integer, we get the valid but unilluminating result 00 = 00 . 

^W. Feller, An Introduction to Probability Theory and Its Applications, 3rd ed. New York: Wiley (1968), Section VI. 10. 
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(b) Show that 




l/1 x 2n dx=\ (2n — 1)!! 


n= 1,2,3,.... 


Show that 




Evaluate /_j(l + x) a (l — x) b dx in terms of the beta function. 


2 2n+l — , n > — 1 

(2n + 1)! 


(2n + 1)!!’ 


n = 0,1,2,_ 


Show, by means of the beta function, that 


ANS. 2 a+i,+1 B(a + 1, fc + 1). 


0 < a < 1 . 


J, (z — x ) 1 a (x — t) a sinjra’ 

Show that the Dirichlet integral 

[[ xl’vUxdy= = fl( ' ,+ L ‘ i + 1) . 

JJ ■ ' (p + q + 2)! p + 9+2 

where the range of integration is the triangle bounded by the positive x- and y-axes and 
the line x + y = 1. 


Show that 


fOO POO , 

/ / e -(x +y +2xyc OS e) dxd y = 

Jo J 0 


What are the limits on 0 ? 

Hint. Consider oblique xy-coordinates. 


Evaluate (using the beta function) 


ANS. —it <0 <jt. 


) I<S[(i )!] 2 


" /2 c„ s -„<«,= r ,2 s = 

) Jo 2 ( 0 / 2 )! 


(« - 1)!! 


7t (n — 1)!! 
2 nS! 


for n odd, 


for n even. 
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8 . 4.10 


8 . 4.11 


8 . 4.12 


8 . 4.13 


8 . 4.14 


8 . 4.15 


Evaluate f ( ! (1 — x 4 ) '^ 2 clx as a beta function. 


ANS. 


[(?)!] 2 -4 

(27T)V2 


= 1.311028777. 


Given 


2 / 7 \ v r 71 / 1 

J v (z) = -;—(-) / sin 2l ’0cos(zcos0)t/0, JH(v) > — i, 

7t l / 2 (v- Jo 

show, with the aid of beta functions, that this reduces to the Bessel series 


j v (z)=j2(~ i y 


i 


s=0 


s!(s + u)! \2 


2s+v 


identifying the initial J v as an integral representation of the Bessel function, J v (Sec¬ 
tion 11.1). 

Given the associated Legendre function 

C(x) = (2 rn-l)!!(l-x 2 ) m/2 , 

Section 12.5, show that 


(a) 

(b) jjcw] 2 ^ 


m = 0, 1,2,. 


= 2 • (2m — 1)!, m= 1,2,3,.... 


Show that 
(a) 


(b) 


C x 2s+ \\-x 2 )- l/2 dx 
Jo 

[ x 2p {l - x 2 ) q dx— 

Jo 


(2s)\\ 

(2s + 1)!! ’ 

1 (P~\)\q\ 


2 (p + q + jV- 


A particle of mass m moving in a symmetric potential that is well described by V (x) — 
A\x\ n has a total energy \m(dx/dt) 2 + V(x) = E. Solving for dx/dt and integrating 
we find that the period of motion is 


r = 2\/2 m 


JO 


dx 


1 0 (E — Ax’ 1 ) 1 / 2 ’ 

where x max is a classical turning point given by 4x” lax = E. Show that 

2 [2nm ( E\ 1/n T(1 In) 

r = -•, 


2 j2jtm ( E^ 1 

_ nV E \A/ 


r(l/n + 2 ) 


Referring to Exercise 8.4.14, 



526 Chapter 8 Gamma-Factorial Function 


(a) Determine the limit as n -> oo of 

2 \2nm / E\ l/n T(1 /n) 
n\ E VA/ r(l/n + 

(b) Find lim r from the behavior of the integrand (E — Ax' 1 ) -1 / 2 . 

n-+oo 

(c) Investigate the behavior of the physical system (potential well) as n -> oo. Obtain 
the period from inspection of this limiting physical system. 


8 . 4.16 Show that 

sinh“ x 1 { a + \ B — a\ 

- ^—dx — -B\ -, --), 

cosh^ x 2 \ 2 2 / 

Hint. Let sinh 2 x = it. 



— 1 < a < p. 


8 . 4.17 The beta distribution of probability theory has a probability density 


fix) = 


r(« + l) t 

r(o;)r(jS) 


d-x/" 1 , 


with ^ restricted to the interval (0, 1). Show that 


a 

(a) (x}(mean) =——. 

01 + p 

(b) cr 2 (variance) = (x 2 ) — (x) 2 


«/6 

(a + /3) 2 (a + p + 1)' 


8 . 4.18 From 


lim 

n—> oo 


Jq /2 sin 2 " 6 dO 
Jq /2 sin 2 " +1 0 d9 


= 1 


derive the Wallis formula for n: 

7T _ 2-2 4-4 6-6 
2 “ L3'L5'T7"' ' 

8 . 4.19 Tabulate the beta function B(p, q) for p and q — 1.0(0.1)2.0 independently. 

Check value. 5(1.3,1.7) = 0.40774. 

8 . 4.20 (a) Write a subroutine that will calculate the incomplete beta function B x (p. q). For 

0.5 < x < 1 you will find it convenient to use the relation 

B x {p, q) = B(p , q) - B { _ x (q, p). 

(b) Tabulate B x (%, |). Spot check your results by using the Gauss-Legendre quadra¬ 
ture. 
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8.5 The Incomplete Gamma Functions and Related 
Functions 


Generalizing the Euler definition of the gamma function (Eq. (8.5)), we define the incom¬ 
plete gamma functions by the variable limit integrals 


y{a, x) 


I e 't a 1 dt , 

Jo 


SH(fl) > 0 


and 


nOO 

T(a,.r) = / e~'t a ~ [ dt. 

J X 


Clearly, the two functions are related, for 

y(a , x ) + r(a, x ) = r(o). 


(8.67) 


( 8 . 68 ) 


The choice of employing y (a, x) or T (a, a:) is purely a matter of convenience. If the para¬ 
meter a is a positive integer, Eq. (8.67) may be integrated completely to yield 


y(n,x) = (n - 1)!M - e x ^ — 


n —1 


s=0 


n— 1 


(8.69) 


T(n,x) = (n — l)\e ' —, n=l,2,_ 

z —' 5! 


s=0 


For nonintegral a, a power-series expansion of yia, x) for small x and an asymptotic ex¬ 
pansion of r (a, x) (denoted as / (x. p) ) are developed in Exercise 5.7.7 and Section 5.10: 


y(a, x) — x a )^(-l)" 


72=0 


n\(a + n) 


|x| ~ 1 (small x), 


rui.x)-x“ '<■ 'V (fl ~ 1)! -1 

(a — 1 — « )! x n 

72=0 
oo 

= x a ~ 1 e~ x ^(—1) 


(8.70) 


(n — a)\ 1 

—, x 1 (large v). 


72=0 


(—«)! x n 


These incomplete gamma functions may also be expressed quite elegantly in terms of con¬ 
fluent hypergeometric functions (compare Section 13.5). 


Exponential Integral 

Although the incomplete gamma function F(«, x) in its general form (Eq. (8.67)) is only 
infrequently encountered in physical problems, a special case is quite common and very 
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Figure 8.7 The exponential integral, 
E\ (x) = — Ei(— x). 


useful. We define the exponential integral by 10 

e~* 

—Ei(— jc) = / - dt — Ei(x). 

J X * 


(8.71) 


(See Fig. 8.7.) Caution is needed here, for the integral in Eq. (8.71) diverges logarithmically 
as x -> 0. To obtain a series expansion for small x, we start from 


E\ (x) = T(0, x) = lirn[T(a) — y(a, x)]. 
We may split the divergent term in the series expansion for y (a, x ), 


E i(x) = lim 

ci —> 0 


« r (« ) — x a 


■E 

n= 1 


(-l)'V' 


Using FHopital’s rule (Exercise 5.6.8) and 


— laT(a)} = — a! — — e ln ( a! l — a \is(a + 1), 
da da da 

and then Eq. (8.40), 11 we obtain the rapidly converging series 

(-1 ) n x" 


E\(x) — —y — In.r — ^ ■ 


(8.72) 


(8.73) 


(8.74) 


(8.75) 


n =1 


An asymptotic expansion E\(x) e — % + • • •] for x -> oo is developed in Sec¬ 
tion 5.10. 


The appearance of the two minus signs in — Ei(—*) is a historical monstrosity. AMS-55, Chapter 5, denotes this integral as 
E\ (x). See Additional Readings for the reference. 
dx a /da = x a \nx. 


11 
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Further special forms related to the exponential integral are the sine integral, cosine 
integral (Fig. 8.8), and logarithmic integral, defined by 12 


f°° sint 

si(x) = — / - dt 

Jx t 

f°° cos t 

Ci(x) = — / - dt 

Jx t 

r du 

li(x) = / -= Ei(lnx) 

Jo In u 


(8.76) 


for their principal branch, with the branch cut conventionally chosen to be along the nega¬ 
tive real axis from the branch point at zero. By transforming from real to imaginary argu¬ 
ment, we can show that 


si(jc) = —[Ei(ix) — Ei(—tx)l = — \E\{ix) — E\{— ix)l, (8.77) 

2 i 2 i 

whereas 

Ci(x) = -[Ei(/x) +Ei(— ix)\ = ~^[E\{ix) + (— /-t)], | arg.r| < —. (8.78) 

Adding these two relations, we obtain 


Ei(«) = Ci(jc) + isi(jf), (8.79) 

to show that the relation among these integrals is exactly analogous to that among e lx , 
cos*, and sin.r. Reference to Eqs. (8.71) and (8.78) shows that Ci(x) agrees with the 
definitions of AMS-55 (see Additional Readings for the reference). In terms of li \, 


E\{ix) — —Ci(x) + isi(x). 


Asymptotic expansions of Ci(x) and si(.r) are developed in Section 5.10. Power-series 
expansions about the origin for Ci(x), si(x), and li(x) may be obtained from those for 


l2 Another sine integral is given by Si(x) = si Or) + tt/2. 
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Figure 8.9 Error function, erf.v. 

the exponential integral, E\ (x ), or by direct integration. Exercise 8.5.10. The exponential, 
sine, and cosine integrals are tabulated in AMS-55, Chapter 5, (see Additional Readings 
for the reference) and can also be accessed by symbolic software such as Mathematica, 
Maple, Mathcad, and Reduce. 


Error Integrals 


The error integrals 


2 f z _,2 2 r°° .2 

erf z=I e dt , erfcz = 1 — erf z = = / e dt 

J o V 71 " Jz 


(8.80a) 


(normalized so that erf oo = 1) are introduced in Exercise 5.10.4 (Fig. 8.9). Asymptotic 
forms are developed there. From the general form of the integrands and Eq. (8.6) we ex¬ 
pect that erf z and erfc z may be written as incomplete gamma functions with a = \. The 
relations are 


erfz = 7r 1 / 2 y(j,z 2 ), erfcz = tt 1 / 2 T(j,z 2 ). (8.80b) 

The power-series expansion of erfz follows directly from Eq. (8.70). 


Exercises 

8.5.1 Show that 


OO 

y(a, x ) = e~ x 

n =0 


( a -W x g+n 
(a + n)\ 


(a) by repeatedly integrating by parts. 

(b) Demonstrate this relation by transforming it into Eq. (8.70). 

Show that 
d'" 

(a) -ttX x a V(a,x)] = (-l) m x a m y(a+m,x), 
dx m 


8.5.2 
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d m r(fl) 

(b) -[ e x v(a, x)l = e x - y{a — m,x). 

dx m 1 y J T(a -m) r 

8.5.3 Show that y(a, x) and T{a, a') satisfy the recurrence relations 

(a) y(a + 1, x) — ay (a, x) — x a e~ x , 

(b) T(a + 1, x) — aT(a, x) + x a e~ x . 


8.5.4 The potential produced by a 15 hydrogen electron (Exercise 12.8.6) is given by 


V(r) = 


q 




^y(3,2r) + r(2,2r)[. 


(a) For r « 1, show that 


(b) For r 1, show that 


V(r) = 


q 


47reo fl o 


V(r) = 


l--r 2 + -- 


1 


47reoflo r 


Here r is expressed in units of ao, the Bohr radius. 

Note. For computation at intermediate values of r. Eqs. (8.69) are convenient. 

8.5.5 The potential of a 2 P hydrogen electron is found to be (Exercise 12.8.7) 


V (r) = 


1 


q 


4nso 24flo 
1 


-y(5, r) + T(4, r) 


q ^ ^y(l,r) + r 1 Y(2,r)\P 1 {cose). 


47 teo 120oo 

Here r is expressed in units of ao, the Bohr radius. Pj (cos 9) is a Fegendre polynomial 
(Section 12.1). 


(a) For c<<l, show that 
V (r) = 


(b) For r 1, show that 


1 


q 


4tt£o ao 


1 


1 


7 - 7T7'-"' P 2(COS0) + ' 


1 q 

V(r) = — • — 
47T£q aor 


120 


1 -»P 2 (cos0) + ■ 

r- 


8.5.6 Prove that the exponential integral has the expansion 


/ oo e ~t 00 

- dt — —y — lnx — ^2 

1 n =1 


{-l) n X n 


where y is the Euler-Mascheroni constant. 
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8.5.7 


8.5.8 


8.5.9 

8.5.10 


Show that E i ( z ) may be written as 

e~ zt 

E\(z) = e~ z \ - - dt. 

Jo 1 +t 

Show also that we must impose the condition | argi| < 7 t/2 . 

Related to the exponential integral (Eq. (8.71)) by a simple change of variable is the 
function 


E n {x) = 


Show that E n (x) satisfies the recurrence relation 

1 X 

E„+i(x) = —e~ x - -E n (x), 
n n 

With E n (x) as defined in Exercise 8.5.8, show that 
Develop the following power-series expansions: 


dt. 

n = 1,2,3,.... 

E n (Q) — l/(n — 1), n > 1. 


(a) 

(b) 


OO 

si(x) = -^ + ]T 
n =0 


(-l)"x 2 " +1 
(2n + 1 )( 2 « + 1 )! ’ 


OO 

Ci(x) — y + In x + ^ 

n =1 


(~l) n x 2n 
2n(2n)\ ' 


8 . 5.11 An analysis of a center-fed linear antenna leads to the expression 

f x 1 — cos t 
/ - dt. 

Jo t 

Show that this is equal to y + In x — Ci(.r). 

8 . 5.12 Using the relation 

r(a) = y(a, x) + r(< 7 , .r), 

show that if y(a,x) satisfies the relations of Exercise 8.5.2, then r(a,.r) must satisfy 
the same relations. 

8 . 5.13 (a) Write a subroutine that will calculate the incomplete gamma functions y (n , x) and 

T (n , x) foi' n a positive integer. Spot check F (n , x) by Gauss-Laguerre quadratures, 
(b) Tabulate y(n, x) and F (n, x) for x = 0.0(0.1)1.0 and n = 1, 2, 3. 

8 . 5.14 Calculate the potential produced by a 1 S hydrogen electron (Exercise 8.5.4) (Fig. 8.10). 
Tabulate V ( r)/(q/4 tt e^cio ) for x — 0.0(0.1)4.0. Check your calculations for r <§C 1 and 
for r 1 by calculating the limiting forms given in Exercise 8.5.4. 

8 . 5.15 Using Eqs. (5.182) and (8.75), calculate the exponential integral E\ (x) for 

(a) x = 0 . 2 ( 0 . 2 ) 1 . 0 , (b) x = 6 . 0 ( 2 . 0 ) 10 . 0 . 

Program your own calculation but check each value, using a library subroutine if avail¬ 
able. Also check your calculations at each point by a Gauss-Laguerre quadrature. 



8.5 Additional Readings 


533 



Figure 8.10 Distributed charge potential produced 
by a 15 hydrogen electron. Exercise 8.5.14. 


You’ll find that the power-series converges rapidly and yields high precision for small 
x. The asymptotic series, even for x — 10, yields relatively poor accuracy. 

Check values. £i(1.0) = 0.219384 

Ex (10.0) =4.15697 x 1(T 6 . 

8 . 5.16 The two expressions for E\(x), (1) Eq. (5.182), an asymptotic series and (2) Eq. (8.75), 
a convergent power series, provide a means of calculating the Euler-Mascheroni con¬ 
stant y t° high accuracy. Using double precision, calculate y from Eq. (8.75), with 
E\(x) evaluated by Eq. (5.182). 

Hint. As a convenient choice take x in the range 10 to 20. (Your choice of x will set 
a limit on the accuracy of your result.) To minimize errors in the alternating series of 
Eq. (8.75), accumulate the positive and negative terms separately. 

ANS. For x — 10 and “double precision,” y — 0.57721566. 


Additional Readings 


Abramowitz, M., and I. A. Stegun, eds.. Handbook of Mathematical Functions with Formulas, Graphs, and 
Mathematical Tables (AMS-55). Washington, DC: National Bureau of Standards (1972), reprinted, Dover 
(1974). Contains a wealth of information about gamma functions, incomplete gamma functions, exponential 
integrals, error functions, and related functions — Chapters 4 to 6. 

Artin, E., The Gamma Function (translated by M. Butler). New York: Holt, Rinehart and Winston (1964). Demon¬ 
strates that if a function f{x ) is smooth (log convex) and equal to (n — 1)! when x = n = integer, it is the 
gamma function. 

Davis, H. T., Tables of the Higher Mathematical Functions. Bloomington, IN: Principia Press (1933). Volume I 
contains extensive information on the gamma function and the poly gamma functions. 

Gradshteyn, I. S., and I. M. Ryzhik, Table of Integrals, Series, and Products. New York: Academic Press (1980). 

Luke, Y. L., The Special Functions and Their Approximations, Vol. 1. New York: Academic Press (1969). 

Luke, Y. L., Mathematical Functions and Their Approximations. New York: Academic Press (1975). This is 
an updated supplement to Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical 
Tables (AMS-55). Chapter 1 deals with the gamma function. Chapter 4 treats the incomplete gamma function 
and a host of related functions. 
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Chapter 9 


Differential Equations 


9.1 Partial Differential Equations 

Introduction 


In physics the knowledge of the force in an equation of motion usually leads to a differen¬ 
tial equation. Thus, almost all the elementary and numerous advanced parts of theoretical 
physics are formulated in terms of differential equations. Sometimes these are ordinary 
differential equations in one variable (abbreviated ODEs). More often the equations are 
partial differential equations (PDEs) in two or more variables. 

Let us recall from calculus that the operation of taking an ordinary or partial derivative 
is a linear operation (£),' 

d(cnp(x) + b\[f (x)) dcp d\[r 

-= a -f b -, 

dx dx dx 

for ODEs involving derivatives in one variable x only and no quadratic, (di/s/dx) 2 , or 
higher powers. Similarly, for partial derivations. 


In general 


3 (a(p(x, y) + b\[r(x, y)) dcp(x,y) 

- : - : — = a - : — 

dx dx 


3i Hx, y ) 

+b ^r- 


C(acp + b\J/) — aC((p) + bC(\jr). 


Thus, ODEs and PDEs appear as linear operator equations, 

CtJ/ — F, (9.1) 


1 We are especially interested in linear operators because in quantum mechanics physical quantities are represented by linear 
operators operating in a complex, infinite-dimensional Hilbert space. 
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where F is a known (source) function of one (for ODEs) or more variables (for PDEs), £ is 
a linear combination of derivatives, and \!/ is the unknown function or solution. Any linear 
combination of solutions is again a solution if F — 0; this is the superposition principle 
for homogeneous PDEs. 

Since the dynamics of many physical systems involve just two derivatives, for exam¬ 
ple, acceleration in classical mechanics and the kinetic energy operator, ~ V 2 , in quan¬ 
tum mechanics, differential equations of second order occur most frequently in physics. 
(Maxwell’s and Dirac’s equations are first order but involve two unknown functions. Elim¬ 
inating one unknown yields a second-order differential equation for the other (compare 
Section 1.9).) 


Examples of PDEs 


Among the most frequently encountered PDEs are the following: 


1. Laplace’s equation, V 2 i/r = 0. 

This very common and very important equation occurs in studies of 

a. electromagnetic phenomena, including electrostatics, dielectrics, steady currents, 
and magnetostatics, 

b. hydrodynamics (irrotational flow of perfect fluid and surface waves), 

c. heat flow, 

d. gravitation. 

2. Poisson’s equation, V 2 i/ f = —p/so. 

In contrast to the homogeneous Laplace equation, Poisson’s equation is nonhomo- 
geneous with a source term —p/so- 

3. The wave (Helmholtz) and time-independent diffusion equations, V 2 i/f ± kr\\) — 0. 

These equations appear in such diverse phenomena as 

a. elastic waves in solids, including vibrating strings, bars, membranes, 

b. sound, or acoustics, 

c. electromagnetic waves, 

d. nuclear reactors. 


4. 


5. 

6 . 


The time-dependent diffusion equation 


V 2 ^ = 


1 9iA 
a 2 dt 


and the corresponding four-dimensional forms involving the d’Alembertian, a four¬ 
dimensional analog of the Laplacian in Minkowski space. 


9^9^ = 9 2 


1 9 2 
c 2 dt 2 


- V 2 . 


The time-dependent wave equation, 9 2 i/r = 0. 

The scalar potential equation, d 2 i// — p/so- 

Like Poisson’s equation, this equation is nonhomogeneous with a source term 

p/s 0 . 
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7. 

8 . 


The Klein-Gordon equation, 3 2 \[r — ~n 2 ij/, and the corresponding vector equations, 
in which the scalar function i jr is replaced by a vector function. Other, more compli¬ 
cated forms are common. 

The Schrodinger wave equation, 

ft 2 t 3 \lr 

- V 2 i/r + V t/r = i h - 

2m 3 1 

and 


fc 2 

2m 


V 2 i/r + V \j/ — Exjr 


for the time-independent case. 

9. The equations for elastic waves and viscous fluids and the telegraphy equation. 

10. Maxwell’s coupled partial differential equations for electric and magnetic fields and 
those of Dirac for relativistic electron wave functions. For Maxwell’s equations see 
the Introduction and also Section 1.9. 


Some general techniques for solving second-order PDEs are discussed in this section. 

1. Separation of variables, where the PDE is split into ODEs that are related by com¬ 
mon constants that appear as eigenvalues of linear operators, C\jf = /i//, usually in one 
variable. This method is closely related to symmetries of the PDE and a group of 
transformations (see Section 4.2). The Helmholtz equation, listed example 3, has this 
form, where the eigenvalue k 2 may arise by separation of the time t from the spatial 
variables. Likewise, in example 8 the energy E is the eigenvalue that arises in the 
separation of t from r in the Schrodinger equation. This is pursued in Chapter 10 in 
greater detail. Section 9.2 serves as introduction. ODEs may be attacked by Frobenius’ 
power-series method in Section 9.5. It does not always work but is often the simplest 
method when it does. 

2. Conversion of a PDE into an integral equation using Green’s functions applies to 
inhomogeneous PDEs, such as examples 2 and 6 given above. An introduction to the 
Green’s function technique is given in Section 9.7. 

3. Other analytical methods, such as the use of integral transforms, are developed and 
applied in Chapter 15. 

Occasionally, we encounter equations of higher order. In both the theory of the slow 
motion of a viscous fluid and the theory of an elastic body we find the equation 

(V 2 )V = 0. 

Fortunately, these higher-order differential equations are relatively rare and are not dis¬ 
cussed here. 

Although not so frequently encountered and perhaps not so important as second-order 
ODEs, first-order ODEs do appear in theoretical physics and are sometimes intermediate 
steps for second-order ODEs. The solutions of some more important types of first-order 
ODEs are developed in Section 9.2. First-order PDEs can always be reduced to ODEs. 
This is a straightforward but lengthy process and involves a search for characteristics that 
are briefly introduced in what follows; for more details we refer to the literature. 
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Classes of PDEs and Characteristics 


Second-order PDEs form three classes: (i) Elliptic PDEs involve V 2 or c~ 2 d 2 /dt 2 + V 2 
(ii) parabolic PDEs, cid/dt + V 2 ; (iii) hyperbolic PDEs, c~ 2 d 2 /dt 2 — V 2 . These canonical 
operators come about by a change of variables £ = £(x, y), rj = r](x, y) in a linear operator 
(for two variables just for simplicity) 


C — a 


dx 2 


d 2 d 2 3 a 

■ 2 h -p c —r- + d — + c — -p f, 

dxd y 3 y 2 3x 3 y 


(9.2) 


which can be reduced to the canonical forms (i), (ii), (iii) according to whether the dis¬ 
criminant D — ac — b 2 > 0, = 0, or < 0. If f (x, >’) is determined from the first-order, but 
nonlinear, PDE 


a 


d$ 

dx 




+ c 



(9.3) 


then the coefficient of 3 2 /3f 2 in C (that is, Eq. (9.3)) is zero. If rj is an independent solution 
of the same Eq. (9.3), then the coefficient of 3 2 /3 rj 2 is also zero. The remaining operator, 
3 2 /3|3)7, in £ is characteristic of the hyperbolic case (iii) with D <0 (a —0 — c leads to 
D — —b 2 < 0), where the quadratic form a) 2 + 2b), + c factorizes and, therefore, Eq. (9.3) 
has two independent solutions f(x,y), '7<x. y). In the elliptic case (i) with D > 0, the 
two solutions §, i] are complex conjugate, which, when substituted into Eq. (9.2), remove 
the mixed second-order derivative instead of the other second-order terms, yielding the 
canonical form (i). In the parabolic case (ii) with D = 0, only 3 2 /3£ 2 remains in C, while 
the coefficients of the other two second-order derivatives vanish. 

If the coefficients a , b, c in £ are functions of the coordinates, then this classification is 
only local; that is, its type may change as the coordinates vary. 

Let us illustrate the physics underlying the hyperbolic case by looking at the wave 
equation, Eq. (9.2) (in 1 + 1 dimensions for simplicity) 

/ 1 3 2 3 2 \ M 


Since Eq. (9.3) now becomes 



and factorizes, we determine the solution of 3£ /dt — c 3 £/dx — 0. This is an arbitrary 
function f = F(x + ct ), and § = G(x — ct) solves d$/dt + cd^/dx — 0, which is readily 
verified. By linear superposition a general solution of the wave equation is i// = F(x + ct) + 
G(x — ct). For periodic functions F, G we recognize the lines x + ct and x — ct as the 
phases of plane waves or wave fronts, where not all second-order derivatives of \jr in the 
wave equation are well defined. Normal to the wave fronts are the rays of geometric optics. 
Thus, the lines that are solutions of Eq. (9.3) and are called characteristics or sometimes 
bicharacteristics (for second-order PDEs) in the mathematical literature correspond to the 
wave fronts of the geometric optics solution of the wave equation. 
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For the elliptic case let us consider Laplace’s equation, 

3 2 i jr 3 2 xjr 

—— H-- =0 

dx 2 dy 2 ’ 

for a potential xjr of two variables. Here the characteristics equation. 



2 


+ 




3y / \ dx dy ) 


= 0 , 


has complex conjugate solutions: £ = F(x + iy) for dtj/dx + i(d$/dy) = 0 and § = 
G(x — iy) for 3§ /dx — i (dtj/dy) — 0. A general solution of Laplace’s equation is therefore 
i fr — F(x + iy) + G(x — iy), as well as the real and imaginary parts of xjr, which are called 
harmonic functions, while polynomial solutions are called harmonic polynomials. 

In quantum mechanics the Wentzel-Kramers-Brillouin (WKB) form xjr = exp (—iS/h) 
for the solution of the Schrodinger equation, a complex parabolic PDE, 


h 1 


2m 


dxjr 


— V + V \xjr = ih ——, 


3 1 


leads to the Hamilton-Jacobi equation of classical mechanics, 

1 , 3 S 

— (VS) 2 +E= —, (9.4) 

2m dt 

in the limit h —> 0. The classical action S obeys the Hamilton-Jacobi equation, which is the 
analog of Eq. (9.3) of the Schrodinger equation. Substituting Vi/r = —ixj/'WS/h, di/f/dt — 
—i\[r(dS/dt)/ti into the Schrodinger equation, dropping the overall nonvanishing factor i jr, 
and taking the limit of the resulting equation as h -> 0, we indeed obtain Eq. (9.4). 

Finding solutions of PDEs by solving for the characteristics is one of several general 
techniques. For more examples we refer to H. Bateman, Partial Differential Equations 
of Mathematical Physics, New York: Dover (1944); K. E. Gustafson, Partial Differential 
Equations and Hilbert Space Methods, 2nd ed.. New York: Wiley (1987), reprinted Dover 
(1998). 

In order to derive and appreciate more the mathematical method behind these solutions 
of hyperbolic, parabolic, and elliptic PDEs let us reconsider the PDE (9.2) with constant 
coefficients and, at first, d = e — f — 0 for simplicity. In accordance with the form of the 
wave front solutions, we seek a solution f = F(i)) of Eq. (9.2) with a function f = $(t, x) 
using the variables t, x instead of x, y. Then the partial derivatives become 


and 


3i jr 3f dF dxjr 3£ dF 

dx dx dt; ’ dt dt dt; ’ 

d 2 x/r _ d 2 $ dF d$ d$ d 2 F 
dxdt dxdt dt; dx dt dff 2 ’ 


3 2 i jr 

d 2 $ dF 


\ 2 d 2 F 

dx 2 

dx 2 dt; 

V3-r y 

) ~diff 

d 2 x[r 

_ 3 2 f dF , 

2 an 

2 d 2 F 

~dt 2 ~ 

' dt 2 d% ' 

ydtj 

W' 


using the chain rule of differentiation. When § depends on x and t linearly, these partial 
derivatives of xjr yield a single term only and solve our PDE (9.2) as a consequence. From 
the linear t; = ax + ft we obtain 

d 2 xj/ _ 2 d 2 F 3 2 xjf _ dfF d 2 xjr _ 2 d 2 F 

a^ _0r ^F’ 3v3r _ 01 P~df 2 ’ 
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and our PDE (9.2) becomes equivalent to the analog of Eq. (9.3), 


d 2 F 

(a 2 a + 2 afib + /3 2 c) —— T — 0. 

dtf z 


(9.5) 


j 2 p 

A solution of = 0 only leads to the trivial i fr — k\x + k 2 t + k 3 with constant kj that is 

Clq 

linear in the coordinates and for which all second derivatives vanish. From a 2 a + 2afib + 
P 2 c — 0 , on the other hand, we get the ratios 


- = -[-b zb ( b 2 ac) l/2 ] = n ,2 (9.6) 

a c 

j 2 p 

as solutions of Eq. (9.5) with -jdr ^ 0 in general. The lines §1 = x + r\t and £2 = x + r 2 t 
will solve the PDE (9.2), with \f/(x, t ) = b ('£,\) + G(^i ) corresponding to the generalization 
of our previous hyperbolic and elliptic PDE examples. 

For the parabolic case, where b 2 = ac, there is only one ratio from Eq. (9.6), fi /a — 
r — — b/c , and one solution, 1 // (x , 1) — F(x — bt/c). In order to find the second gen¬ 
eral solution of our PDE (9.2) we make the Ansatz (trial solution) Tfr(x,t) = i//o(x, t) ■ 
G(x — bt/c). Substituting this into Eq. (9.2) we find 


2 V f o , ,, 3 2 iAo 3 2 iAo _ 

9^ + ^^97 +C l^“ 


for ifr 0 since, upon replacing F —> G, G solves Eq. (9.5) with d 2 G /V/f 2 / 0 in general. 
The solution i^o can be any solution of our PDE (9.2), including the trivial ones such as 
i//{) = x and \jj() = t. Thus we obtain the general parabolic solution. 


\f/(x, t) = F 




VaiOc t)G 




with ijfQ — x or xf/Q = t, etc. 

With the same Ansatz one finds solutions of our PDE (9.2) with a source term, for 
example, / / 0 , but still d — e — 0 and constant a, b, c. 

Next we determine the characteristics, that is, curves where the second order derivatives 
of the solution 1 // are not well defined. These are the wave fronts along which the solutions 
of our hyperbolic PDE (9.2) propagate. We solve our PDE with a source term / ^ 0 and 
Cauchy boundary conditions (see Table 9.1) that are appropriate for hyperbolic PDEs, 
where xjj and its normal derivative difr/dn are specified on an open curve 


C:x = x(s), t — t(s), 


with the parameter s the length on C. Then dr — (dx, dt ) is tangent and hds = (dt, —dx) 
is normal to the curve C, and the first-order tangential and normal derivatives are given by 
the chain rule 
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From these two linear equations, df/dt and df/dx can be determined on C, provided 


dx dt 

ds ds 

dt _ dx_ 

ds ds 



For the second derivatives we use the chain rule again: 

d df dx 3 2 f dt d 2 f 

ds dx ds dx 2 ds dxdt' 


d 3i Jr dx d 2 f dt d 2 f 
ds dt ds dxdt ds dt 2 


(9.7a) 


(9.7b) 


From our PDE (9.2), and Eqs. (9.7a,b), which are linear in the second-order derivatives, 
they cannot be calculated when the determinant vanishes, that is. 


a 

dx 

ds 

o 


2b 

dt 

ds 

dx 

ds 


C 

o 

dt 

ds 



dx dt 

~ 2b TsTs +c 



(9.8) 


From Eq. (9.8), which defines the characteristics, we find that the tangent ratio dx /dt obeys 


c 



dx 


— 2b -h a — 0, 

dt 


so 

-=-\b±(b 2 -ac) 1/2 ]. (9.9) 

dt c L J 

For the earlier hyperbolic wave (and elliptic potential ) equation examples, b — 0 and a , c 
are constants, so the solutions = x + tr, from Eq. (9.6) coincide with the characteristics 
of Eq. (9.9). 


Nonlinear PDEs 


Nonlinear ODEs and PDEs are a rapidly growing and important field. We encountered 
earlier the simplest linear wave equation. 


df df 

-h c-= 0, 

dt dx 


as the first-order PDE of the wave fronts of the wave equation. The simplest nonlinear wave 
equation. 


df 

~dt~ 


3i lr 

+ c(V0 — 

dx 


= 0 , 


(9.10) 


results if the local speed of propagation, c, is not constant but depends on the wave \[r. 
When a nonlinear equation has a solution of the form fix, t) = A cos (lex — cot), where 
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co(k ) varies with k so that of (k) f 0, then it is called dispersive. Perhaps the best-known 
nonlinear dispersive equation is the Korteweg-deVries equation. 


dx[r 

~di 


3 t/r 9 3 i lr 

+ l/f 9^ + 9^ = °’ 


(9.11) 


which models the lossless propagation of shallow water waves and other phenomena. It is 
widely known for its soliton solutions. A soliton is a traveling wave with the property of 
persisting through an interaction with another soliton: After they pass through each other, 
they emerge in the same shape and with the same velocity and acquire no more than a 
phase shift. Let = x — ct ) be such a traveling wave. When substituted into Eq. (9.11) 
this yields the nonlinear ODE 


(<A - c) 


dxf 

~d$ 


which can be integrated to yield 



i i 2 x// 
~d^ 


= c xfr — 


xf 2 

~ 2 ' 


(9.12) 


(9.13) 


There is no additive integration constant in Eq. (9.13) to ensure that d 2 xlr/d § 2 -> 0 with 
xj/ —> 0 for large f so xjj is localized at the characteristic £ = 0, or x = ct. Multiplying 
Eq. (9.13) by dxj//dk; and integrating again yields 



= ci /'' 2 — 


xf/ 2 

T’ 


(9.14) 


where dx]//d% —> 0 for large f Taking the root of Eq. (9.14) and integrating once more 
yields the soliton solution 


x[r(x — ct) = 


3c 

cosh 2 (v / c^^) 


(9.15) 


Some nonlinear topics, for example, the logistic equation and the onset of chaos, are re¬ 
viewed in Chapter 18. For more details and literature, see J. Guckenheimer, P. Holmes, and 
F. John, Nonlinear Oscillations, Dynamical Systems and Bifurcations of Vector Fields, rev. 
ed.. New York: Springer-Verlag (1990). 


Boundary Conditions 

Usually, when we know a physical system at some time and the law governing the physical 
process, then we are able to predict the subsequent development. Such initial values are 
the most common boundary conditions associated with ODEs and PDE. Finding solutions 
that match given points, curves, or surfaces corresponds to boundary value problems. So¬ 
lutions usually are required to satisfy certain imposed (for example, asymptotic) boundary 
conditions. These boundary conditions may take three forms: 

1. Cauchy boundary conditions. The value of a function and normal derivative specified 
on the boundary. In electrostatics this would mean <p, the potential, and E n , the normal 
component of the electric field. 
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Table 9.1 


Boundary 


Type of partial differential equation 


conditions 

Elliptic 

Hyperbolic 

Parabolic 


Laplace, Poisson 

Wave equation in 

Diffusion equation 


in (x,y) 

c*. t) 

in (x, t) 

Cauchy 

Open surface 

Unphysical results 
(instability) 

Unique, stable 
solution 

Too restrictive 

Closed surface 

Too restrictive 

Too restrictive 

Too restrictive 

Dirichlet 

Open surface 

Insufficient 

Insufficient 

Unique, stable 
solution in one 

direction 

Closed surface 

Unique, stable 
solution 

Solution not unique 

Too restrictive 

Neumann 

Open surface 

Insufficient 

Insufficient 

Unique, stable 
solution in one 

direction 

Closed surface 

Unique, stable 
solution 

Solution not unique 

Too restrictive 


2. Dirichlet boundary conditions. The value of a function specified on the boundary. 

3. Neumann boundary conditions. The normal derivative (normal gradient) of a func¬ 
tion specified on the boundary. In the electrostatic case this would be E n and there¬ 
fore a, the surface charge density. 

A summary of the relation of these three types of boundary conditions to the three types 
of two-dimensional partial differential equations is given in Table 9.1. For extended dis¬ 
cussions of these partial differential equations the reader may consult Morse and Feshbach, 
Chapter 6 (see Additional Readings). 

Parts of Table 9.1 are simply a matter of maintaining internal consistency or of common 
sense. For instance, for Poisson’s equation with a closed surface, Dirichlet conditions lead 
to a unique, stable solution. Neumann conditions, independent of the Dirichlet conditions, 
likewise lead to a unique stable solution independent of the Dirichlet solution. Therefore 
Cauchy boundary conditions (meaning Dirichlet plus Neumann) could lead to an inconsis¬ 
tency. 

The term boundary conditions includes as a special case the concept of initial con¬ 
ditions. For instance, specifying the initial position xq and the initial velocity vq in some 
dynamical problem would correspond to the Cauchy boundary conditions. The only differ¬ 
ence in the present usage of boundary conditions in these one-dimensional problems is that 
we are going to apply the conditions on both ends of the allowed range of the variable. 

9.2 First-Order Differential Equations 

Physics involves some first-order differential equations. For completeness (and review) it 
seems desirable to touch on them briefly. We consider here differential equations of the 
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general form 


dy 

dx 


= f(x,y) = - 


P(x,y) 
Q(x, y)' 


(9.16) 


Equation (9.16) is clearly a first-order, ordinary differential equation. It is first order be¬ 
cause it contains the first and no higher derivatives. It is ordinary because the only deriva¬ 
tive, dy/dx, is an ordinary, or total, derivative. Equation (9.16) may or may not be linear, 
although we shall treat the linear case explicitly later, Eq. (9.25). 


Separable Variables 


Frequently Eq. (9.16) will have the special form 


dy 

dx 


= fix, y) = - 


PM 

Q(y) 


Then it may be rewritten as 


P(x) dx + Q(y) dy = 0. 


(9.17) 


Integrating from (.tq, yo) to ( x , y) yields 



P(x) dx 



Q(y)dy = 0. 


Since the lower limits, xq and yo, contribute constants, we may ignore the lower limits of 
integration and simply add a constant of integration. Note that this separation of variables 
technique does not require that the differential equation be linear. 


Example 9.2. 7 parachutist 

We want to find the velocity of the falling parachutist as a function of time and are partic¬ 
ularly interested in the constant limiting velocity, i>o, that comes about by air drag, taken, 
to be quadratic, — bv 2 , and opposing the force of the gravitational attraction, mg , of the 
Earth. We choose a coordinate system in which the positive direction is downward so that 
the gravitational force is positive. For simplicity we assume that the parachute opens im¬ 
mediately, that is, at time t — 0, where v(t — 0) = 0, our initial condition. Newton’s law 
applied to the falling parachutist gives 

mi) = mg — bxr , 

where m includes the mass of the parachute. 

The terminal velocity, I’o, can be found from the equation of motion as t oo; when 
there is no acceleration, it — 0, so 

Zn>o = mg, or i>o = 
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The variables t and v separate 


d v 


g — —v 2 

6 m 


= dt , 


which we integrate by decomposing the denominator into partial fractions. The roots of the 
denominator are at v — ±i>o- Hence 

-l 

u , ' 

8 ' 


—v 

m 


1 


1 


2vob\v + vo v - vo 


Integrating both terms yields 


f 


dV 


8 ~ -V 2 

6 m 

Solving for the velocity yields 

e 2r/r 


1 

21 


m vo + v 

In- 

gb vo - v 


— t. 


1 sinh j t 

’=-^1 = = 


where T — / ^ is the time constant governing the asymptotic approach of the velocity to 
the limiting velocity, vo- 

Putting in numerical values, g — 9.8 m/s 2 and taking b — 700 kg/m, m — 70 kg, gives 
i >0 = V9-8/10 ~ 1 m/s ~ 3.6 km/h ~ 2.23 mi/h, the walking speed of a pedestrian at 
landing, and T — = 1/VlO • 9.8 ~ 0.1 s. Thus, the constant speed vq is reached 

within a second. Finally, because it is always important to check the solution, we verify 
that our solution satisfies 


cosh t/T v o sinh 2 1/T i>o vq v~ 
cosh t/T T cosh 2 t/T T T Tv o 


■g - v 

m 


that is, Newton’s equation of motion. The more realistic case, where the parachutist is in 
free fall with an initial speed v, = i>(0) > 0 before the parachute opens, is addressed in 
Exercise 9.2.18. ■ 


Exact Differential Equations 


We rewrite Eq. (9.16) as 

P(x,y)dx + Q(x,y)dy — 0. (9.18) 

This equation is said to be exact if we can match the left-hand side of it to a differential dcp, 

(9.19) 


dip dip 

dip — —dx + —dy. 
dx dy 


Since Eq. (9.18) has a zero on the right, we look for an unknown function ip{x,y) = 
constant and dip = 0. 
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We have (if such a function <p{x, y) exists) 


and 


3 ip dip 

P(x, y)dx + Q(x, y)dy — —dx + —dy 

dx dv 


(9.20a) 


dip 

dx 


P(x,y), 


dip 

dy 


Q(x, y). 


(9.20b) 


The necessary and sufficient condition for our equation to be exact is that the second, 
mixed partial derivatives of ip(x, y) (assumed continuous) are independent of the order of 
differentiation: 


d 2 (p _ dP(x,y) _ dQ(x,y) _ d 2 tp 
dydx dy dx dxdy 

Note the resemblance to Eqs. (1.133a) of Section 1.13, “Potential Theory.” If Eq. (9.18) 
corresponds to a curl (equal to zero), then a potential, ip(x , y), must exist. 

If ip(x, y) exists, then from Eqs. (9.18) and (9.20a) our solution is 


ip(x,y) = C. 

We may construct ip (x , y) from its partial derivatives just as we constructed a magnetic 
vector potential in Section 1.13 from its curl. See Exercises 9.2.7 and 9.2.8. 

It may well turn out that Eq. (9.18) is not exact and that Eq. (9.21) is not satisfied. 
However, there always exists at least one and perhaps an infinity of integrating factors 
a(x, y) such that 


a(x, y)P(x, y) dx + a(x, y)Q(x, y) dy — 0 


is exact. Unfortunately, an integrating factor is not always obvious or easy to find. Unlike 
the case of the linear first-order differential equation to be considered next, there is no 
systematic way to develop an integrating factor for Eq. (9.18). 

A differential equation in which the variables have been separated is automatically exact. 
An exact differential equation is not necessarily separable. 

The wave front method of Section 9.1 also works for a first-order PDE: 


3 xlr 3i lr 

a(x,y)^~ +b(x,y)^~ = 0. 
dx dy 


(9.22a) 


We look for a solution of the form x/r = F(f), where ^(x , y) = constant for varying x and 
y defines the wave front. Hence 


iif = — dx H —-dy — 0, 
dx dy ' 


while the PDE yields 


dx 


= o 

dy) d^ 


(9.22b) 


(9.23a) 


with dF/dl; / 0 in general. Comparing Eqs. (9.22b) and (9.23a) yields 


dx dy 
a b 


(9.23b) 
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which reduces the PDE to a first-order ODE for the tangent dy/dx of the wave front 
function §(x, >’)• 

When there is an additional source term in the PDE, 


dilr 3i lr 

a- -1- b- -F cijr = 0, 

dx dy 

then we use the Ansatz if/ — if/q(x, y)F(f), which converts our PDE to 


9^0 , , 3tAo 


dx 


dy 


dF ( a* a* 


^ a- -h b— -Fc^o + fo—[ a -—F b— = 0. 


dy 


(9.23c) 


(9.24) 


d% \ dx 

If we can guess a solution if o of Eq. (9.23c), then Eq. (9.24) reduces to our previous 
equation, Eq. (9.23a), from which the ODE of Eq. (9.23b) follows. 


Linear First-Order ODEs 


If fix, y) in Eq. (9.16) has the form —p(x)y + q (x ), then Eq. (9.16) becomes 

^- + p(x)y = q(x). (9.25) 

dx 

Equation (9.25) is the most general linear first-order ODE. If q(x) — 0, Eq. (9.25) is 
homogeneous (in y). A nonzero q(x) may represent a source or a driving term. Equa¬ 
tion (9.25) is linear; each term is linear in y or dy/dx. There are no higher powers, that 
is, y 2 , and no products, yidy/dx). Note that the linearity refers to the y and dy/dx ; p(x) 
and q{x) need not be linear in x. Equation (9.25), the most important of these first-order 
ODEs for physics, may be solved exactly. 

Let us look for an integrating factor a(x) so that 


may be rewritten as 


dy 

a(.v)— + a(x)p(x)y = at(x)q(x) 
dx 


— [a(x)y] = a(x)q(x). 


(9.26) 


(9.27) 


The purpose of this is to make the left-hand side of Eq. (9.25) a derivative so that it can 
be integrated — by inspection. It also, incidentally, makes Eq. (9.25) exact. Expanding 
Eq. (9.27), we obtain 

dy da 

a(x)— + —y = aix)q(x). 
dx dx 

Comparison with Eq. (9.26) shows that we must require 


da 

— =a(x)p(x). 
dx 


(9.28) 


Here is a differential equation for a(x), with the variables a and x separable. We separate 
variables, integrate, and obtain 


a(x) — exp 


r 


p(x)dx 


(9.29) 
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as our integrating factor. 

With a(x) known we proceed to integrate Eq. (9.27). This, of course, was the point of 
introducing a in the first place. We have 

a(x)q(x) dx. 

Now integrating by inspection, we have 

f x 

a(x)y(x) = I a(x)q(x) dx + C. 

The constants from a constant lower limit of integration are lumped into the constant C. 
Dividing by a (x), we obtain 


J ~^[ a ^ y ^] dx = J 


-i f X 

y(x) = [a(x)] / a(x)q(x)dx 


C 


Finally, substituting in Eq. (9.29) for a yields 


y(x) 


= exp — J p(t)dt J exp J 


p{t)dt 


q(s ) ds + C 


(9.30) 


Here the (dummy) variables of integration have been rewritten to make them unambigu¬ 
ous. Equation (9.30) is the complete general solution of the linear, first-order differential 
equation, Eq. (9.25). The portion 


>'i (x) — C exp 



p(t)dt 


(9.31) 


corresponds to the case q(x) — 0 and is a general solution of the homogeneous differential 
equation. The other term in Eq. (9.30), 


V 2 OO — exp 




p(t)dt 


q(s) ds, 


(9.32) 


is a particular solution corresponding to the specific source term q(x). 

Note that if our linear first-order differential equation is homogeneous {q = 0), then it 
is separable. Otherwise, apart from special cases such as p — constant, q — constant, and 
q(x) = apix), Eq. (9.25) is not separable. 

Let us summarize this solution of the inhomogeneous ODE in terms of a method called 
variation of the constant as follows. In the first step, we solve the homogeneous ODE by 
separation of variables as before, giving 


y 

y 


= -p, 


In y = — 



dX + lnC, 


y(x) = Ce~f X rW dx . 


In the second step, we let the integration constant become x-dependent, that is, C -> C (x ). 
This is the “variation of the constant” used to solve the inhomogeneous ODE. Differenti¬ 
ating y(x) we obtain 


/ = - p Ce~f pMdx + C\x)e-f pMdx = —py{x) + C' (x)e~ f p(x)dx . 
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Comparing with the inhomogeneous ODE we find the ODE for C: 

C' e -f pU)dx =q, or C(x) = J ef X p(Y)dY q(X)dX. 

Substituting this C into y = C(x)e~ f p( x )dx reproduces Eq. (9.32). 


Example 9.2.2 RL Circuit 


For a resistance-inductance circuit Kirchhoff’s law leads to 


dl(t) 

L—+ RI (t) = V(t) 
dt 


for the current 7(f), where L is the inductance and R is the resistance, both constant. V ( t ) 
is the time-dependent input voltage. 

From Eq. (9.29) our integrating factor a{t) is 


a(t) = expj —dt — e Rt ^ L . 


Then by Eq. (9.30), 


I it) = e 






e Rt/LV(f) dt + c 


with the constant C to be determined by an initial condition (a boundary condition). 
For the special case V(t) — Vo, a constant. 


1(t) = e 




Yl.k e Rt/L + c 

L R 


= — + Ce~ R,/L 
R + 


If the initial condition is 7 (0) = 0, then C — — Vo/R and 

Now we prove the theorem that the solution of the inhomogeneous ODE is unique up 
to an arbitrary multiple of the solution of the homogeneous ODE. 

To show this, suppose yj, V 2 both solve the inhomogeneous ODE, Eq. (9.25); then 


y[ -y' 2 + p(x)(yi - yi) = 0 


follows by subtracting the ODEs and says that yi — y 2 is a solution of the homogeneous 
ODE. The solution of the homogeneous ODE can always be multiplied by an arbitrary 
constant. 

We also prove the theorem that a first-order homogeneous ODE has only one linearly 
independent solution. This is meant in the following sense. If two solutions are linearly 
dependent, by definition they satisfy ay \ ( x ) + by 2 (x) = 0 with nonzero constants a, b for 
all values of x. If the only solution of this linear relation is a = 0 = b, then our solutions 

yi and y2 are said to be linearly independent. 
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To prove this theorem, suppose yi , V 2 both solve the homogeneous ODE. Then 

— = -p(x) — — implies W(x) = y[y 2 - yiy' 2 = 0. (9.33) 

y i v 2 ' 

The functional determinant W is called the Wronskian of the pair y i, yi. We now show 
that W = 0 is the condition for them to be linearly dependent. Assuming linear dependence, 
that is. 


ay i(x) + byi(x) = 0 

with nonzero constants a, b for all values of x, we differentiate this linear relation to get 
another linear relation. 


ay\ (x) + by 2 (x ) = 0. 

The condition for these two homogeneous linear equations in the unknowns a, b to have a 
nontrivial solution is that their determinant be zero, which is W — 0. 

Conversely, from W — 0, there follows linear dependence, because we can find a non¬ 
trivial solution of the relation 

}’l 

by integration, which gives 

In vi = In yi + In C, or y\ = Cy 2 - 

Linear dependence and the Wronskian are generalized to three or more functions in Sec¬ 
tion 9.6. 


Exercises 


9.2.1 


From Kirchhoff’s law the current I in an RC (resistance-capacitance) circuit (Fig. 9.1) 
obeys the equation 



1 

-I 

C 


— 0 . 


(a) Find I(t). 

(b) For a capacitance of 10,000 pF charged to 100 V and discharging through a resis¬ 
tance of 1 Mf2, find the current I for t — 0 and for t = 100 seconds. 

Note. The initial voltage is IqR or Q/C. where Q = / 0 °° I(t)dt. 

9.2.2 The Laplace transform of Bessel’s equation (n — 0) leads to 

(s 2 + l)f\s) + sf(s) = 0. 


Solve for f(s). 
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Figure 9.1 RC circuit. 


9.2.3 


9.2.4 


The decay of a population by catastrophic two-body collisions is described by 


dN 

dt 


= —kN. 


This is a first-order, nonlinear differential equation. Derive the solution 


N{t) = N 0 \ 1 + - 
to 


-l 


where To = (A:/Vo) 1 . This implies an infinite population at t = — to- 

The rate of a particular chemical reaction A + B —> C is proportional to the concentra¬ 
tions of the reactants A and 5: 

dC ^ = «[A(0) - C(f)][5(0) - C(r)]. 


(a) Find C(t) for A(0) / 5(0). 

(b) Find C ( t ) for A (0) = 5(0). 


9.2.5 


The initial condition is that C (0) = 0. 


A boat, coasting through the water, experiences a resisting force proportional to v", v 
being the boat’s instantaneous velocity. Newton’s second law leads to 


dv , n 

m — = —kv. 
dt 


With v(t = 0) = i>o, x(t = 0) = 0, integrate to find v as a function of time and i> as a 
function of distance. 


9.2.6 


In the first-order differential equation dy/dx = f(x , y) the function / (x, y) is a func¬ 
tion of the ratio y/x: 


dy 

dx 


= g(y/x). 


Show that the substitution of u = y/x leads to a separable equation in u and x. 
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9.2.7 The differential equation 


P(x, y) dx + Q(x,y)dy = 0 


is exact. Construct a solution 


[ x ry 

(p(x,y)— / P(x,y ) dx + / Q(x o, y) dy = constant. 
Jx o Jyo 


9.2.8 The differential equation 


P(x , y) dx + Q(x, y) dy — 0 


is exact. If 


show that 


r 

q>(x,y)= I P(x,y)dx + 
Jx o 


f 

J VI 


y 

yo 


Q(x0, y)dy , 


3 <p 
dx 


P(x, y). 


3 <p 
dy 


Q(x,y). 


Hence <p(x, y) — constant is a solution of the original differential equation. 

9.2.9 Prove that Eq. (9.26) is exact in the sense of Eq. (9.21), provided that a{x) satisfies 
Eq. (9.28). 

9.2.10 A certain differential equation has the form 


fix) dx + g(x)h(y) dy = 0, 


with none of the functions f{x), gfr), h(y) identically zero. Show that a necessary and 
sufficient condition for this equation to be exact is that g(x) = constant. 

9.2.11 Show that 

X 

p{t)dt 

is a solution of 

dy 

-j- +P(x)y(x) =q(x) 
dx 

by differentiating the expression for y (x) and substituting into the differential equation. 

9.2.12 The motion of a body falling in a resisting medium may be described by 

dv 

m — = me — bv 
dt 5 

when the retarding force is proportional to the velocity, v. Find the velocity. Evaluate 
the constant of integration by demanding that i>(0) = 0. 


y(x) 


= exp -f 




9.2 First-Order Differential Equations 


553 


9.2.13 


9.2.14 

9.2.15 


9.2.16 


9.2.17 


9.2.18 


Radioactive nuclei decay according to the law 


dN 

dt 


—XN, 


N being the concentration of a given nuclide and X, the particular decay constant. In a 
radioactive series of n different nuclides, starting with N \, 


dNi 

dt 


-XiN t, 


dN 2 

dt 


— X\N\ — X 2 N 2 , 


and so on. 


Find N 2 (t) for the conditions N\ (0) = No and N 2 (0) — 0. 


The rate of evaporation from a particular spherical drop of liquid (constant density) is 
proportional to its surface area. Assuming this to be the sole mechanism of mass loss, 
find the radius of the drop as a function of time. 

In the linear homogeneous differential equation 

dv 

— = —a v 
dt 

the variables are separable. When the variables are separated, the equation is exact. 
Solve this differential equation subject to i>(0) = t>o by the following three methods: 


(a) Separating variables and integrating. 

(b) Treating the separated variable equation as exact. 

(c) Using the result for a linear homogeneous differential equation. 


ANS. v(t) = v 0 e~ at . 


Bernoulli’s equation, 

C j- + f(x)y = g(x)y n , 
ax 

is nonlinear for n / 0 or 1. Show that the substitution u = y " reduces Bernoulli’s 
equation to a linear equation. (See Section 18.4.) 

ANS.-F (1 — n)f(x)u — (1 — n)g(x). 

dx 

Solve the linear, first-order equation, Eq. (9.25), by assuming y(x) = u(x)v(x), where 
v (x) is a solution of the corresponding homogeneous equation \ q (x ) = 0]. This is the 
method of variation of parameters due to Lagrange. We apply it to second-order equa¬ 
tions in Exercise 9.6.25. 


(a) Solve Example 9.2.1 for an initial velocity i>; = 60 mi/h, when the parachute opens. 
Find v(t). (b) For a sky diver in free fall use the friction coefficient b — 0.25 kg/m and 
mass m — 70 kg. What is the limiting velocity in this case? 
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9.3 Separation of Variables 


The equations of mathematical physics listed in Section 9.1 are all partial differential equa¬ 
tions. Our first technique for their solution splits the partial differential equation of n vari¬ 
ables into n ordinary differential equations. Each separation introduces an arbitrary con¬ 
stant of separation. If we have n variables, we have to introduce n — 1 constants, determined 
by the conditions imposed in the problem being solved. 


Cartesian Coordinates 


In Cartesian coordinates the Helmholtz equation becomes 



(9.34) 


using Eq. (2.27) for the Laplacian. For the present let k 2 be a constant. Perhaps the simplest 
way of treating a partial differential equation such as Eq. (9.34) is to split it into a set of 
ordinary differential equations. This may be done as follows. Let 


fix, y, z) = X(x)Y ( y)Z(z) 


(9.35) 


and substitute back into Eq. (9.34). How do we know Eq. (9.35) is valid? When the differ¬ 
ential operators in various variables are additive in the PDE, that is, when there are no prod¬ 
ucts of differential operators in different variables, the separation method usually works. 
We are proceeding in the spirit of let’s try and see if it works. If our attempt succeeds, then 
Eq. (9.35) will be justified. If it does not succeed, we shall find out soon enough and then 
we shall try another attack, such as Green’s functions, integral transforms, or brute-force 
numerical analysis. With i fr assumed given by Eq. (9.35), Eq. (9.34) becomes 


YZ 


d 2 X 
dx 2 


XZ- 


,d 2 Y 

dy 2 


XY 


,d 2 Z 

dz 2 


k 2 XYZ — 0. 


(9.36) 


Dividing by i fr = XYZ and rearranging terms, we obtain 


1 drX ? 1 d 2 Y 1 d 2 Z 

X dx 2 Y dy 2 Z dz 2 ' ' 

Equation (9.37) exhibits one separation of variables. The left-hand side is a function of x 
alone, whereas the right-hand side depends only on y and z and not on x. But x, y, and z 
are all independent coordinates. The equality of both sides depending on different variables 
means that the behavior of x as an independent variable is not determined by y and z. 
Therefore, each side must be equal to a constant, a constant of separation. We choose 2 


1 drY 
Y ~dy 2 


1 d 2 X 2 


o = / , 

X dx 2 

(9.38) 

1 d 2 Z 2 


Z dz 2 

(9.39) 


“The choice of sign, completely arbitrary here, will be fixed in specific problems by the need to satisfy specific boundary 
conditions. 
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Now, turning our attention to Eq. (9.39), we obtain 


1 d 2 Y , ,, 1 d 2 Z 

_— 4- / z _ 

Y dy 2 Z <fz 2 ’ 


(9.40) 


and a second separation has been achieved. Here we have a function of y equated to a 
function of z, as before. We resolve it, as before, by equating each side to another constant 
of separation, 2 —m 2 . 


1 d 2 Y 2 

-r = —m , 

Y dy 2 

(9.41) 

1 d 2 7 

= £ 2 + / 2 + ,„ 2 = n 2 , 

Z dz- 

(9.42) 


introducing a constant n 2 by k 2 = l 2 + m 2 + n 2 to produce a symmetric set of equations. 
Now we have three ODEs ((9.38), (9.41), and (9.42)) to replace Eq. (9.34). Our assumption 
(Eq. (9.35)) has succeeded and is thereby justified. 

Our solution should be labeled according to the choice of our constants l,m, and n \ that 
is. 


tlmix, y, z ) = Xi(x)Y m (y)Z n (z). (9.43) 

Subject to the conditions of the problem being solved and to the condition k 2 — l 2 + 
m 2 + M, we may choose /, m , and n as we like, and Eq. (9.43) will still be a solution of 
Eq. (9.34), provided X / (x) is a solution of Eq. (9.38), and so on. We may develop the most 
general solution of Eq. (9.34) by taking a linear combination of solutions i/bm, 

4" = ^ ai m jri m . (9.44) 

l,m 

The constant coefficients a are finally chosen to permit T to satisfy the boundary condi¬ 
tions of the problem, which, as a rule, lead to a discrete set of values /, m. 


Circular Cylindrical Coordinates 

With our unknown function i jr dependent on p, <p, and z, the Helmholtz equation becomes 
(see Section 2.4 for V 2 ) 

V 2 i/f (p, (p, z) + k 2 \ls(p, (p, z) = 0, (9.45) 


1 8 / dx/r 
-XT P^) + 


p 3p V' 3 p ) p 2 3 q> 2 


1 3 d 2 \lr l7 

+ - 2 + k~ifr — 0. 

p- dq>- 3 z 


As before, we assume a factored form for i//, 


P,<P, z ) = E(p)ck(<p)Z(z). 


Substituting into Eq. (9.46), we have 


c PZ d / dP 


p dp\ dp 


PZd 2 <I> d 2 Z , 

— — T + T + k 2 P$Z = 0. 

p- d(p z dz 


(9.46) 


(9.47) 


(9.48) 
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All the partial derivatives have become ordinary derivatives. Dividing by P <PZ and moving 
the z derivative to the right-hand side yields 

1 d ( dP\ 1 c/ 2 0 2 1 d 2 Z 

pP dp\ dp J p 2 <J> d<p— Z dz 2 

Again, a function of z on the right appears to depend on a function of p and p on the 
left. We resolve this by setting each side of Eq. (9.49) equal to the same constant. Let us 
choose 3 — l 2 . Then 


d 2 Z 
dz 2 


= l l Z 


and 


1 d ( dP\ 


~n ( P~rr + 


1 d 2 <t> 


+ k 2 = -l 2 . 


pP dp\ dp J p 2< t> dp 2 

Setting k 2 +1 2 — n 2 , multiplying by p 2 , and rearranging terms, we obtain 


2 „2 


pdf dP' 

-( p - I +n~p~ = 

P dp V dp 1 


1 d 2 4 > 
<t> dp 2 


We may set the right-hand side to m 2 and 


d 2 d> 

dp 2 


= —m<S>. 


Finally, for the p dependence we have 


p ^( p f) + , " v -“ 2) ' >=a 


(9.50) 

(9.51) 

(9.52) 

(9.53) 

(9.54) 


This is Bessel’s differential equation. The solutions and their properties are presented in 
Chapter 11. The separation of variables of Laplace’s equation in parabolic coordinates also 
gives rise to Bessel’s equation. It may be noted that the Bessel equation is notorious for the 
variety of disguises it may assume. For an extensive tabulation of possible forms the reader 
is referred to Tables of Functions by Jahnke and Emde. 4 

The original Helmholtz equation, a three-dimensional PDE, has been replaced by three 
ODEs, Eqs. (9.50), (9.53), and (9.54). A solution of the Helmholtz equation is 


f(p,p, z) = P(p)d>(p)Z(z). 


(9.55) 


Identifying the specific P, O, Z solutions by subscripts, we see that the most general solu¬ 
tion of the Helmholtz equation is a linear combination of the product solutions: 


y{p,p,z) = E &mn Pmn (p)O m (( p)Z n (z). 

m,n 


(9.56) 


3 The choice of sign of the separation constant is arbitrary. However, a minus sign is chosen for the axial coordinate z in expec¬ 
tation of a possible exponential dependence on z (from Eq. (9.50)). A positive sign is chosen for the azimuthal coordinate (p in 
expectation of a periodic dependence on (p (from Eq. (9.53)). 

4 E. Jahnke and F. Emde, Tables of functions, 4th rev. ed.. New York: Dover (1945), p. 146; also, E. Jahnke, F. Emde, and 
F. Losch, Tables of Higher Functions, 6th ed., New York: McGraw-Hill (1960). 
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Spherical Polar Coordinates 

Let us try to separate the Helmholtz equation, again with k 2 constant, in spherical polar 
coordinates. Using Eq. (2.48), we obtain 

3 2 i/L 


1 


, 3t fr 


3 


sin#—( r — ) H-1 sin# — 

dr \ dr dd\ 3(9 


r 2 sin# 

Now, in analogy with Eq. (9.35) we try 


di/f 


1 


sin# 3 cp 2 J 


= -k z f. 


i jr(r, #, <p) = R(r)®(6)<£>(ip). 


By substituting back into Eq. (9.57) and dividing by R®<S>, we have 


1 d 


,dR\ 


1 


d 


Rr 2 dr \ dr ) + ©r 2 sin# d6 


sin#- 


d® 


1 


d 2 <S> 


dd ) <J>r 2 sin 2 # dip 2 


= -k\ 


(9.57) 


(9.58) 


(9.59) 


Note that all derivatives are now ordinary derivatives rather than partials. By multiplying 
by r 2 sin 2 #, we can isolate (\/<t>)(d 2 <&/d(p 2 ) to obtain 5 


1 d 2 ® 

<l> dip 2 


— r~ sin“ # 


1 d 


-k z -^- r z — - 


r 2 R dr V dr 


,dR 


1 d ( d® 
.-sin#- 

r 2 sin#©<7#\ dO 


(9.60) 


Equation (9.60) relates a function of <p alone to a function of r and # alone. Since r, #, 
and <p are independent variables, we equate each side of Eq. (9.60) to a constant. In almost 
all physical problems <p will appear as an azimuth angle. This suggests a periodic solution 
rather than an exponential. With this in mind, let us use — mr as the separation constant, 
which, then, must be an integer squared. Then 


1 d 2 <S>((p) 
<J> dtp 2 


and 


1 d 


,dR 


1 


d® 

sin#- 

dO 


r 2 Rdr\ dr) r 2 sin#© dO 
Multiplying Eq. (9.62) by r 2 and rearranging terms, we obtain 


r 2 sin 2 ( 


= -k z 


1 d 


,dR 


__L( ) +r 2 k 2 = 


1 d ( d® 

-1 sin #- 

sin#© d6 V dd 


(9.61) 


(9.62) 


(9.63) 


Rdr\ dr) sin#©^#^ dO) ' sin 2 # 

Again, the variables are separated. We equate each side to a constant, Q , and finally obtain 


1 


sin# dO 


■ „d® , 

sin#- — 

dO J skr# 


,dR 


X — [r z —)+k z R 


r 2 dr 


dr 


©+< 2 © = 0 , 

QR 

^V=0. 


(9.64) 

(9.65) 


5 The order in which the variables are separated here is not unique. Many quantum mechanics texts show the r dependence split 
off first. 




558 


Chapter 9 Differential Equations 


Once more we have replaced a partial differential equation of three variables by three 
ODEs. The solutions of these ODEs are discussed in Chapters 11 and 12. In Chapter 12, for 
example, Eq. (9.64) is identified as the associated Legendre equation, in which the constant 
Q becomes /(/ + 1); / is a non-negative integer because 6 is an angular variable. If k 2 is 
a (positive) constant, Eq. (9.65) becomes the spherical Bessel equation of Section 11.7. 

Again, our most general solution may be written 

ifQm(r, 6,9) = ^ a Qm RQ(r)@ Qm (0)<& m ((p). (9.66) 

Q,m 

The restriction that k 2 be a constant is unnecessarily severe. The separation process will 
still be possible for k 2 as general as 

k 2 = fir) + 4 gm + —^-hicp) + k' 2 . (9.67) 

r- r 1 sin" 0 

In the hydrogen atom problem, one of the most important examples of the Schrodinger 
wave equation with a closed form solution is k 2 — fir), with k 2 independent of 6,<p. 
Equation (9.65) for the hydrogen atom becomes the associated Laguerre equation. 

The great importance of this separation of variables in spherical polar coordinates stems 
from the fact that the case k 2 = k 2 (r ) covers a tremendous amount of physics: a great deal 
of the theories of gravitation, electrostatics, and atomic, nuclear, and particle physics. And 
with k 2 = k 2 (r), the angular dependence is isolated in Eqs. (9.61) and (9.64), which can 
be solved exactly. 

Finally, as an illustration of how the constant m in Eq. (9.61) is restricted, we note that 
<p in cylindrical and spherical polar coordinates is an azimuth angle. If this is a classical 
problem, we shall certainly require that the azimuthal solution O(^) be single-valued; that 
is. 


<t>(<p + 2 tt ) = '!>(£>). 


(9.68) 


This is equivalent to requiring the azimuthal solution to have a period of 2 n. 6 Therefore m 
must be an integer. Which integer it is depends on the details of the problem. If the integer 
\m\ > 1, then <t> will have the period 2 n/m. Whenever a coordinate corresponds to an axis 
of translation or to an azimuth angle, the separated equation always has the form 


for <p, the azimuth angle, and 


d 2 ${q>) 
dcp 2 


= — m 2 <t>(^) 


d 2 Z(z) , 

(9-69) 

for z, an axis of translation of the cylindrical coordinate system. The solutions, of course, 
are sin az and cos az for —a 2 and the corresponding hyperbolic function (or exponentials) 
sinh az and cosh az for +a 2 . 


6 This also applies in most quantum mechanical problems, but the argument is much more involved. If m is not an integer, 
rotation group relations and ladder operator relations (Section 4.3) are disrupted. Compare E. Merzbacher, Single valuedness of 
wave functions. Am. J. Phys. 30: 237 (1962). 
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Table 9.2 Solutions in Spherical Polar Coordinates' 7 


^ — y a lm tylm 

l,m 


1 

2 

3 


a References for some of the functions are P™ (cos 0), m = 0, Section 12.1; m ^ 0, Sec¬ 
tion 12.5; <2j”(cos0). Section 12.10; ji(kr),ni(kr),ii(kr), and ki(kr). Section 11.7. 
^cos nup and sin imp may be replaced by e±* m(f> . 


v 2 f = 0 flrn = 


V 2 \jf + kr\jr = 0 


— kr\jr = 0 


r‘ 


*A/m — 


H P]” (cos 9) 1 1 cc 
Q]"(cos9) ] { si 

H iPI" (cos 9) 11 cc 

Q'"(cos6) | | sin mtp j 


cos mtp 
sin mtp 


| jl(kr) | | Pi" (cos9) | | cos imp | 
l ni(kr) 

| ki(kr) 


, [ il(kr) 

tlm = 1 


P/ m (cos9) 

Q' / "(cos9) 


cos m(p 
sin m(p 


Other occasionally encountered ODEs include the Laguerre and associated Laguerre 
equations from the supremely important hydrogen atom problem in quantum mechanics: 


d 2 y dy 

x—^ + (1 - x)-j- +ay = 0, 
dx- dx 

d 2 y dy 

x—p + (l + k - x)— + ay — 0. 

dx 


(9.70) 


(9.71) 

From the quantum mechanical theory of the linear oscillator we have Hermite’s equation. 


d 2 y dy 

-^-2x—+2ay = 0. (9.72) 

dx z dx 

Finally, from time to time we find the Chebyshev differential equation, 

< i -' 2 )g-4 + " 2 -»- < 9 - 73 > 

For convenient reference, the forms of the solutions of Faplace’s equation, Helmholtz’s 
equation, and the diffusion equation for spherical polar coordinates are collected in Ta¬ 
ble 9.2. The solutions of Faplace’s equation in circular cylindrical coordinates are pre¬ 
sented in Table 9.3. 

General properties following from the form of the differential equations are discussed in 
Chapter 10. The individual solutions are developed and applied in Chapters 11-13. 

The practicing physicist may and probably will meet other second-order ODEs, some of 
which may possibly be transformed into the examples studied here. Some of these ODEs 
may be solved by the techniques of Sections 9.5 and 9.6. Others may require a computer 
for a numerical solution. 

We refer to the second edition of this text for other important coordinate systems. 


• To put the separation method of solving PDEs in perspective, let us review it as a conse¬ 
quence of a symmetry of the PDE. Take the stationary Schrodinger equation H\j/ — Eij/ 
as an example, with a potential V (r) depending only on the radial distance r. Then this 
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Table 9.3 Solutions in Circular Cylindrical Coordinates^ 


y ' a ma ^ma 
m,a 

a. 

V“l/r + = 0 

^ma = I 

[ J, n (ap) 

| N m (ap) 

I cos imp I I e az ] 
j | sin rmp J | e az J 

b. 

vV -ct 2 f = 0 

tffma = I 

\ hnioip) 

| K,„ (ap) 

j I cos imp I I cosofz I 

1 1 sin rmp 1 1 sinaz 1 

c. 

= 0 


I A ) j 

Ip-" 1 )! 

cos rmp 1 
sin m(p 1 


a References for the radial functions are J m (ap ), Section 11.1; N m (ap ), Section 11.3; 
I m (ap) and K m (ap), Section 11.5. 


PDE is invariant under rotations that comprise the group SO(3). Its diagonal genera¬ 
tor is the orbital angular momentum operator L- — —i A, and its quadratic (Casimir) 
invariant is L 2 . Since both commute with H (see Section 4.3), we end up with three 
separate eigenvalue equations: 

Hxjf — Exj/, L~i/ r = /(/ + 1 ) t/r, L z xjf — mxlr. 

Upon replacing L 2 in L 2 by its eigenvalue m 2 , the L 2 PDE becomes Legendre’s ODE, 
and similarly Hx[r — Ex/r becomes the radial ODE of the separation method in spherical 
polar coordinates. 

• For cylindrical coordinates the PDE is invariant under rotations about the 4 -axis only, 
which form a subgroup of SO(3). This invariance yields the generator L z = — i<)/'<)<p 
and separate azimuthal ODE L z \[r = mi,//, as before. If the potential V is invariant under 
translations along the 4 -axis, then the generator —id/dz gives the separate ODE in the 
z variable. 

• In general (see Section 4.3), there are n mutually commuting generators //, with eigen¬ 
values m 1 of the (classical) Lie group G of rank n and the corresponding Casimir in¬ 
variants Cj with eigenvalues c, (Chapter 4), which yield the separate ODEs 

Hi xjf — mill/, Cj \[r — Cj r/r 
in addition to the (by now) radial ODE Hx/s = Exfr. 

Exercises 

9.3.1 By letting the operator V 2 + k 2 act on the general form a\xf/\ ( x , y, z) + ajxklix, y, z), 
show that it is linear, that is, that (V 2 + k 2 )(cnx{r[ + 02^2) = fli(V 2 + k 2 )xfr 1 + 
a 2 (V 2 + k 2 )xj/ 2 - 


V 2 xls + k 2 ir = 0 , 


9.3.2 


Show that the Helmholtz equation. 
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9.3.3 

9.3.4 


9.3.5 


9.3.6 


9.3.7 

9.3.8 


is still separable in circular cylindrical coordinates if k 2 is generalized to k 2 + f(p) + 

(1 /p 2 )g(<P) + h(z)- 

Separate variables in the Helmholtz equation in spherical polar coordinates, splitting off 
the radial dependence first. Show that your separated equations have the same form as 
Eqs. (9.61), (9.64), and (9.65). 


Verify that 


V - i jr(r, 9, (p) + 


k 2 + f(r)+\g(9) + 


1 


r 2 sin 2 6 


h(<p) 


i Js(r, 6,<p) — 0 


is separable (in spherical polar coordinates). The functions /, g. and h are functions 
only of the variables indicated; k 2 is a constant. 


An atomic (quantum mechanical) particle is confined inside a rectangular box of sides 
a. b , and c. The particle is described by a wave function i jr that satisfies the Schrodinger 
wave equation 

ft 2 2 

-V 2 l/r = E\jf. 

2m 

The wave function is required to vanish at each surface of the box (but not to be identi¬ 
cally zero). This condition imposes constraints on the separation constants and therefore 
on the energy E. What is the smallest value of E for which such a solution can be ob¬ 
tained? 


ANS. E = 


n 2 h 2 ( 1 


2m 


a 2 b 2 


For a homogeneous spherical solid with constant thermal diffusivity, K , and 
sources, the equation of heat conduction becomes 



no heat 


9 T(r, t) 
9r 


= KV 2 T(r, t ). 


Assume a solution of the form 


T — R(r)T(t) 


and separate variables. Show that the radial equation may take on the standard form 

0 d 2 R dR r ? 7 n 

r — n + 2r -Hu r-nffl + l) S = 0; n = integer. 

dr 1 dr 

The solutions of this equation are called spherical Bessel functions. 

Separate variables in the thermal diffusion equation of Exercise 9.3.6 in circular cylin¬ 
drical coordinates. Assume that you can neglect end effects and take T = T(p,t). 

The quantum mechanical angular momentum operator is given by L = — i (r x V). Show 
that 


L • L^r = /(/ + l)i/f 

leads to the associated Legendre equation. 

Hint. Exercises 1.9.9 and 2.5.16 may be helpful. 
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9.3.9 


The one-dimensional Schrodinger wave equation for a particle in a potential field V = 
\kx 2 is 


ft 2 d 2 \[r 
2m dx 2 


+ -kx 2 ^/ — Exjf (x). 


(a) Using £ = ax and a constant X, we have 

f mk \ 1 ^ 2 E ( m \ b 2 

B -U) ' 

show that 

d 2 \lr(M) , 9 . 

o. 

(b) Substituting 

V f (?) = ) ; (l)e _|2/2 , 

show that v(§) satisfies the Hermite differential equation. 


9.3.10 Verify that the following are solutions of Laplace’s equation: 

(a) fi = 1/r, r ± 0, (b) ^2 = In . 

2 r r — z 

Vote. The z derivatives of 1/r generate the Legendre polynomials, //,(cos 0), Exer¬ 
cise 12.1.7. The z derivatives of (l/2r) ln[(r + z)/(r — z)] generate the Legendre func¬ 
tions, Q n (cos0). 

9.3.11 If 'h is a solution of Laplace’s equation, = 0, show that 3'T/3z is also a solution. 


9.4 Singular Points 

In this section the concept of a singular point, or singularity (as applied to a differential 
equation), is introduced. The interest in this concept stems from its usefulness in (1) clas¬ 
sifying ODEs and (2) investigating the feasibility of a series solution. This feasibility is the 
topic of Fuchs’ theorem. Sections 9.5 and 9.6. 

All the ODEs listed in Section 9.3 may be solved for dry/dx 2 . Using the notation 
d 2 y/dx 2 = y", we have 7 

y" = f{x,y,y'). (9.74) 

If we write our second-order homogeneous differential equation (in y) as 

y" + P(x)y'+Q(x)y = 0, (9.75) 

we are ready to define ordinary and singular points. If the functions P(x) and Q (x) remain 
finite at x — xq, point x = xo is an ordinary point. However, if either P(x) or Q(x) (or 

7 This prime notation, y' = dy/dx, was introduced by Lagrange in the late 18th century as an abbreviation for Leibniz’s more 
explicit but more cumbersome dy/dx. 
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both) diverges as x —» .to. point xo is a singular point. Using Eq. (9.75), we may distinguish 
between two kinds of singular points. 


1. If either P(x) or Q(x) diverges as x -> .to but (x — xq)P(x ) and 

(.r — X()) 2 Q(x) remain finite as x —» xo, then x = xo is called a regular, or nonessen¬ 
tial, singular point. 

2. If P (x) diverges faster than I /(x — xo) so that (x — xo )P (x) goes to infinity as x -> xo, 
or Q(x) diverges faster than l/(x — xo) 2 so that (x — xo ) 2 Q(x) goes to infinity as 
x -> xq, then point x = xq is labeled an irregular, or essential, singularity. 


These definitions hold for all finite values of xo- The analysis of point x —> oo is similar 
to the treatment of functions of a complex variable (Section 6.6). We set x = 1 /", substitute 
into the differential equation, and then let z -> 0. By changing variables in the derivatives, 
we have 

dy(x) _ dy(z~ l ) dz _ 1 dy(z~ x ) _ _ 2 dy(z ~ l ) (916) 

dx dz dx x 2 dz dz 


d 2 y(x) d 
dx 2 dz 


dy(x ) 
dx 


f=<-a 


dy(z ~ l ) 2 d 2 y(z- 1 ) 

-2 Z -:- Z 


dz 


dz 2 


3 dy(z *) 4 d-y(z l ) 

— 2z -;-b Z 


dz 


dz 2 


(9.77) 


Using these results, we transform Eq. (9.75) into 

z4 S + [2z3 ~ z2p(z ' 1)] ^ + Q{z ~ l)y= °- (9 - 78) 

The behavior at x = oo(z = 0) then depends on the behavior of the new coefficients. 


2z — P(z~ l ) 


and 


Q (z- 1 ) 


as z —>• 0. If these two expressions remain finite, point x = oo is an ordinary point. If they 
diverge no more rapidly than 1 /z and 1 /z 2 , respectively, point x = oo is a regular singular 
point; otherwise it is an irregular singular point (an essential singularity). 


Example 9.4.1 

Bessel’s equation is 

x 2 y" + xy' + (x 2 - n 2 )y = 0. (9.79) 

Comparing it with Eq. (9.75) we have 

1 77 2 

P(x) = ~, Q(x) = 1 -J, 

X x z 

which shows that point x = 0 is a regular singularity. By inspection we see that there are 
no other singular points in the finite range. As x -> oo(z —> 0), from Eq. (9.78) we have 
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Table 9.4 



Equation 

Regular 

singularity 

x = 

Irregular 

singularity 

x = 

1. 

Hypergeometric 

x(x — \)y" + [(1 + a + b)x — c]/ + aby = 0. 

0,1. oo 

- 

2. 

Legendre a 

(1 - x 2 )y" - 2xy' +1(1 + l)y = 0. 

— 1, 1,00 

— 

3. 

Chebyshev 

(1 — x 2 )y" — xy r + n 2 y = 0. 

— 1, 1,00 

— 

4. 

Confluent hypergeometric 
xy" + (c — x)y' — ay = 0. 

0 

oo 

5. 

Bessel 

x 2 y" + xy' + (x 2 — n 2 )y = 0. 

0 

oo 

6. 

Laguerre a 

xy" + (1 -x)y' + ay = 0. 

0 

oo 

7. 

Simple harmonic oscillator 
y" + co 2 y = 0. 

— 

oo 

8. 

Hermite 

y" - 2xy' + 2ay = 0. 


oo 


a The associated equations have the same singular points. 


the coefficients 

2 z — z , 1 - « 2 z 2 

-— and -4-• 

Z z Z 4 

Since the latter expression diverges as z , point .x = oo is an irregular, or essential, singu¬ 
larity. ■ 

The ordinary differential equations of Section 9.3, plus two others, the hypergeometric 
and the confluent hypergeometric, have singular points, as shown in Table 9.4. 

It will be seen that the first three equations in Table 9.4, hypergeometric, Legendre, and 
Chebyshev, all have three regular singular points. The hypergeometric equation, with regu¬ 
lar singularities at 0, 1, and oo is taken as the standard, the canonical form. The solutions of 
the other two may then be expressed in terms of its solutions, the hypergeometric functions. 
This is done in Chapter 13. 

In a similar manner, the confluent hypergeometric equation is taken as the canonical 
form of a linear second-order differential equation with one regular and one irregular sin¬ 
gular point. 


Exercises 

9 . 4.1 Show that Legendre’s equation has regular singularities at x = — 1, 1, and oo. 

9 . 4.2 Show that Laguerre’s equation, like the Bessel equation, has a regular singularity at 
x = 0 and an irregular singularity at x — oo. 
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9.4.3 


Show that the substitution 

1 — x 

x —y —-—, a ——l, b = l+ 1, c=l 

converts the hypergeometric equation into Legendre’s equation. 


9.5 Series Solutions — Frobenius’ Method 


In this section we develop a method of obtaining one solution of the linear, second-order, 
homogeneous ODE. The method, a series expansion, will always work, provided the point 
of expansion is no worse than a regular singular point. In physics this very gentle condition 
is almost always satisfied. 

A linear, second-order, homogeneous ODE may be put in the form 


d 2 y 
dx 2 


+ 

dx 


Q(x)y = 0. 


(9.80) 


The equation is homogeneous because each term contains y(x) or a derivative; linear 
because each y, dy/dx, or dry/dx 2 appears as the first power — and no products. In this 
section we develop (at least) one solution of Eq. (9.80). In Section 9.6 we develop the 

second, independent solution and prove that no third, independent solution exists. 

Therefore the most general solution of Eq. (9.80) may be written as 


y(x) = c\yi (x) + C 2 V 2 (.r). 


(9.81) 


Our physical problem may lead to a nonhomogeneous, linear, second-order ODE, 


dry dy 

— 4 + p ( x )~r + QMy = F (■*)• 

dx- dx 


(9.82) 


The function on the right, F{x), represents a source (such as electrostatic charge) or a 
driving force (as in a driven oscillator). Specific solutions of this nonhomogeneous equa¬ 
tion are touched on in Exercise 9.6.25. They are explored in some detail, using Green’s 
function techniques, in Sections 9.7 and 10.5, and with a Laplace transform technique in 
Section 15.11. Calling this solution y p , we may add to it any solution of the corresponding 
homogeneous equation (Eq. (9.80)). Hence the most general solution of Eq. (9.82) is 


y(x) = ciyi (x) + c 2 y 2 (x) + y P (x). 


(9.83) 


The constants c i and C 2 will eventually be fixed by boundary conditions. 

For the present, we assume that F(x) — 0 and that our differential equation is homoge¬ 
neous. We shall attempt to develop a solution of our linear, second-order, homogeneous 
differential equation, Eq. (9.80), by substituting in a power series with undetermined coef¬ 
ficients. Also available as a parameter is the power of the lowest nonvanishing term of the 
series. To illustrate, we apply the method to two important differential equations, first the 
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linear (classical) oscillator equation 


dry 2 


with known solutions y — sin cox, cos cox. 
We try 


y(.v) = x k (ag + a\x + ajx 2 + a^x 3 + ■ ■ ■) 

OO 

= ^^axx k+x , ao^O, 

1=0 


(9.84) 


(9.85) 


with the exponent k and all the coefficients ax still undetermined. Note that k need not be 
an integer. By differentiating twice, we obtain 


dy 

dx 

d 2 y 

dx 2 


Y ax (k + X)x k+k 1 , 

A=0 

OO 

Y ax (k + X) (k + A - 1 )x k+k ~ 2 . 

x=o 


By substituting into Eq. (9.84), we have 

OO OO 

Yax.(k + X)(k + X - l)x k+k ~ 2 + co 2 Y a ^ xk+l = °- (9.86) 

A=0 A=0 

From our analysis of the uniqueness of power series (Chapter 5), the coefficients of each 
power of x on the left-hand side of Eq. (9.86) must vanish individually. 

The lowest power of x appearing in Eq. (9.86) is x k ~ 2 , for X = 0 in the first summation. 
The requirement that the coefficient vanish 8 yields 


aok(k — 1) = 0. 


We had chosen ao as the coefficient of the lowest nonvanishing terms of the series 
(Eq. (9.85)), hence, by definition, ao ^ 0. Therefore we have 

k(k- 1) = 0. (9.87) 


This equation, coming from the coefficient of the lowest power of x, we call the indicial 
equation. The indicial equation and its roots are of critical importance to our analysis. 
If k = 1, the coefficient a\(k + \)k of x k ~ l must vanish so that a i = 0. Clearly, in this 
example we must require either that k = 0 or k — 1. 

Before considering these two possibilities for k, we return to Eq. (9.86) and demand that 
the remaining net coefficients, say, the coefficient of x k+ ■’ (j > 0), vanish. We set X — j +2 
in the first summation and X — j in the second. (They are independent summations and X 
is a dummy index.) This results in 

a j+ 2 (k + j + 2)(k + j + 1) + oo" a j = 0 


See the uniqueness of power series, Section 5.7. 
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or 


aj+2 aj (k + . i + 2 ) {k + j + iy 


(9.88) 


This is a two-term recurrence relation . 9 Given oj, we may compute cij+2 and then a/+ 4 , 
cij+(>, and so on up as far as desired. Note that for this example, if we start with ao, 
Eq. (9.88) leads to the even coefficients < 12 , « 4 , and so on, and ignores a 1 , < 73 , < 75 , and 
so on. Since <7 1 is arbitrary if k = 0 and necessarily zero if k = 1, let us set it equal to zero 
(compare Exercises 9.5.3 and 9.5.4) and then by Eq. (9.88) 


<73 = «5 = «7 = • • • = 0, 


and all the odd-numbered coefficients vanish. The odd powers of x will actually reappear 
when the second root of the indicial equation is used. 

Returning to Eq. (9.87) our indicial equation, we first try the solution k — 0. The recur¬ 
rence relation (Eq. (9.88)) becomes 


which leads to 


Clj+2 = ' 


or 


(j + 2)0’ + 1) ’ 


(9.89) 


0-2 = —ClQ 


CO 

E2 


- 

2 ! 


CO 

< 7 4 = 


5-6“ 6! a °’ 


fl6 = — «4 


and so on. 


By inspection (and mathematical induction). 


o-2n = (—!)" 


co 


2n 


(2 n)\ 


a 0, 


(9.90) 


and our solution is 


y(x)t =0 = a 0 



(cox ) 2 

2 ! 


(cox ) 4 

4! 


(cox ) 6 
6 ! + 


ao cos cox. (9.91) 


If we choose the indicial equation root k = 1 (Eq. (9.88)), the recurrence relation becomes 


co 


Cl j-\- 2 — Cl j 


(j + 3)(j+2) 


(9.92) 


^The recurrence relation may involve three terms, that is, aj+2> depending on aj and cij—2- Equation (13.2) for the Hermite 
functions provides an example of this behavior. 
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Substituting in j — 0, 2,4, successively, we obtain 

2 2 
co co- 

ai — -flOtr^T = 

CL4. = — Cl2 

a b = —<24 

Again, by inspection and mathematical induction, 


co 2 

ft; 2 

2-3 

3! ' 


ft; 4 

4-5 

- + 5T 

« 2 

co 6 

6-7 



and so on. 


ain = (—!)" 


co 


In 


-a 0 . 


For this choice, k = 1, we obtain 


y(x)k= 1 = flo-t 


1 - 


(2n + 1)! 

(cor) 2 ( cox) 4 (cox) 6 


a 0 
cu 


(ft).r) — 


3! 

(fttv ) 3 

3! 


5! 

(cox) 6 
" 5! 


7! 

(cox) 1 
" 7! 


(9.93) 


= —sincu.r. (9.94) 

co 

To summarize this approach, we may write Eq. (9.86) schematically as shown in Fig. 9.2. 
From the uniqueness of power series (Section 5.7), the total coefficient of each power of x 
must vanish — all by itself. The requirement that the first coefficient (1) vanish leads to 
the indicial equation, Eq. (9.87). The second coefficient is handled by setting a\ = 0. The 
vanishing of the coefficient of x k (and higher powers, taken one at a time) leads to the 
recurrence relation, Eq. (9.88). 


This series substitution, known as Frobenius’ method, has given us two series solutions 
of the linear oscillator equation. However, there are two points about such series solutions 
that must be strongly emphasized: 

1. The series solution should always be substituted back into the differential equation, to 
see if it works, as a precaution against algebraic and logical errors. If it works, it is 
a solution. 

2. The acceptability of a series solution depends on its convergence (including asymptotic 

convergence). It is quite possible for Frobenius’ method to give a series solution that 

satisfies the original differential equation when substituted in the equation but that does 


1 n hi IV 



Figure 9.2 Recurrence relation from power series expansion. 
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not converge over the region of interest. Legendre’s differential equation illustrates this 
situation. 

Expansion About xo 

Equation (9.85) is an expansion about the origin, a'o = 0. It is perfectly possible to replace 
Eq. (9.85) with 

OO 

y(x) = y ^ax(x - xp) k+k , «o^O. (9.95) 

A=0 

Indeed, for the Legendre, Chebyshev, and hypergeometric equations the choice aq = 1 has 
some advantages. The point a'q should not be chosen at an essential singularity — or our 
Frobenius method will probably fail. The resultant series (ao an ordinary point or regular 
singular point) will be valid where it converges. You can expect a divergence of some sort 
when \x — xo\ = |z. s — -vol, where z s is the closest singularity to xq (in the complex plane). 

Symmetry of Solutions 

Let us note that we obtained one solution of even symmetry, y\ ( x) — y \ (— x), and one of 
odd symmetry, yi(x') = —yzi—x). This is not just an accident but a direct consequence of 
the form of the ODE. Writing a general ODE as 

C(x)y(x) = 0, (9.96) 

in which C(x) is the differential operator, we see that for the linear oscillator equation 
(Eq. (9.84)), C(x) is even under parity; that is, 

£(x) = C(-x). (9.97) 

Whenever the differential operator has a specific parity or symmetry, either even or odd, 
we may interchange +x and —a, and Eq. (9.96) becomes 

±C(x)y(-x) = 0, (9.98) 

+ if C(x) is even, — if C{x) is odd. Clearly, if y (x) is a solution of the differential equation, 
y(—x) is also a solution. Then any solution may be resolved into even and odd parts, 

y(x) = \[y(x) + y(-x)] + ;[.v(x) - ?(-*)], (9.99) 

the first bracket on the right giving an even solution, the second an odd solution. 

If we refer back to Section 9.4, we can see that Legendre, Chebyshev, Bessel, simple 
harmonic oscillator, and Hermite equations (or differential operators) all exhibit this even 
parity; that is, their P{x) in Eq. (9.80) is odd and Q(x) even. Solutions of all of them 
may be presented as series of even powers of x and separate series of odd powers of x. 
The Laguerre differential operator has neither even nor odd symmetry; hence its solutions 
cannot be expected to exhibit even or odd parity. Our emphasis on parity stems primarily 
from the importance of parity in quantum mechanics. We find that wave functions usually 
are either even or odd, meaning that they have a definite parity. Most interactions (beta 
decay is the big exception) are also even or odd, and the result is that parity is conserved. 
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Limitations of Series Approach — Bessel’s Equation 


This attack on the linear oscillator equation was perhaps a bit too easy. By substituting 
the power series (Eq. (9.85)) into the differential equation (Eq. (9.84)), we obtained two 
independent solutions with no trouble at all. 

To get some idea of what can happen we try to solve Bessel’s equation, 

x 2 y" + xy' + ( x 2 — n 2 )y = 0, (9.100) 

using y' for dy/dx and y" for d 2 y/dx 2 . Again, assuming a solution of the form 

OO 

y(*) = Y2 a >- xk+k ’ 

x=o 

we differentiate and substitute into Eq. (9.100). The result is 

OO OO 

a x {k + X)(k + X - \)x k+x + ^2 a ; (k + X)x k+x 
1=0 1=0 

oo oo 

+ ^a x x k+x+ 2 -J2 a ^n 2 x k+X = 0. (9.101) 

X =0 A =0 

By setting X = 0, we get the coefficient of x k , the lowest power of x appearing on the 
left-hand side, 

a 0 [k(k — 1) + k — n 2 ] = 0, (9.102) 

and again a 0 ^ 0 by definition. Equation (9.102) therefore yields the indicial equation 

k 2 — n 2 = 0 (9.103) 

with solutions k = ±n. 

It is of some interest to examine the coefficient of x k+] also. Here we obtain 
fli [(k + 1 )k + k + 1 — w 2 ] = 0, 
or 

ai(k+ 1 —n)(k+ 1 + n) = 0. (9.104) 

For k — ±n, neither k + 1 — n nor k + 1 + n vanishes and we must require a\ — 0. 10 

Proceeding to the coefficient of x k+J for k — n, we set X = j in the first, second, and 
fourth terms of Eq. (9.101) and X = j — 2 in the third term. By requiring the resultant 
coefficient of x k+l to vanish, we obtain 

Uj [(« + j)(n + j - !) + (« + j) - n 2 ] + aj -2 = 0. 

When j is replaced by j + 2, this can be rewritten for / > 0 as 

1 

& j -i-2 — / . 

(j + 2) (2 n + j + 2) 

= — ^ are exceptions. 


(9.105) 
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which is the desired recurrence relation. Repeated application of this recurrence relation 
leads to 


1 


02 = —OQ 


dQ tv. 


2 (2n + 2) 2 2 1! (n + 1)! ’ 


1 


(24 = — Cl2 


aonl 


4(2ft + 4) 2 4 2!(ft + 2)! ’ 


1 


d(, = — «4 


do ft! 


and in general. 


6(2ft + 6) 2 6 3!(n + 3)! ’ 

d2p = (-l) P ; 


and so on. 


do ft! 


2 2 Pp\(n + p)l 

Inserting these coefficients in our assumed series solution, we have 


y(x ) = dox n 
In summation form 


1 - 


2 2 1!(« + 1)! 2 4 2!(ft + 2)! 


y(x) = ao^2(-i) j 


,t r n+ 2 j 


j =0 


2 2 ij\(n + j)\ 


= fl 0 2"ft!^(-l)' / - 


1 


j=o 


;!(« + /)! V2 


n+2j 


(9.106) 


(9.107) 


(9.108) 


In Chapter 11 the final summation is identified as the Bessel function ./„ (x ). Notice that 
this solution, J n (x), has either even or odd symmetry, 11 as might be expected from the 
form of Bessel’s equation. 

When k = —n and n is not an integer, we may generate a second distinct series, to be 
labeled J- n (x). However, when —n is a negative integer, trouble develops. The recurrence 
relation for the coefficients a/ is still given by Eq. (9.105), but with 2 n replaced by —2n. 
Then, when j + 2 — 2 n or j = 2(n — 1), the coefficient (i j+i blows up and we have no 
series solution. This catastrophe can be remedied in Eq. (9.108), as it is done in Chapter 11, 
with the result that 


J~ n (x) = (— \) n J n {x), n an integer. (9.109) 

The second solution simply reproduces the first. We have failed to construct a second in¬ 
dependent solution for Bessel’s equation by this series technique when n is an integer. 

By substituting in an infinite series, we have obtained two solutions for the linear oscil¬ 
lator equation and one for Bessel’s equation (two if n is not an integer). To the questions 
“Can we always do this? Will this method always work?’’ the answer is no, we cannot 
always do this. This method of series solution will not always work. 


11 J n (x) is an even function if n is an even integer, an odd function if n is an odd integer. For nonintegral n the x n has no such 
simple symmetry. 
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Regular and Irregular Singularities 


The success of the series substitution method depends on the roots of the indicial equation 
and the degree of singularity of the coefficients in the differential equation. To understand 
better the effect of the equation coefficients on this naive series substitution approach, 
consider four simple equations: 


o' 

II 

r* 

i 

V. 

(9.110a) 


(9.110b) 

// 1 , a 2 

y" + -y'-^y = o, 

X X L 

(9.110c) 

„ 1 , a 2 

y" + y’ - y = Q. 

X~ 

(9.1 lOd) 


The reader may show easily that for Eq. (9.110a) the indicial equation is 

k 2 - k - 6 = 0, 

giving k — 3, —2. Since the equation is homogeneous in x (counting d 2 /dx 2 as x~ 2 ), there 
is no recurrence relation. However,we are left with two perfectly good solutions, ,r’ and 
x~ 2 . 

Equation (9.110b) differs from Eq. (9.110a) by only one power of x, but this sends the 
indicial equation to 


—6flo = 0, 

with no solution at all, for we have agreed that a o / 0. Our series substitution worked for 
Eq. (9.110a), which had only a regular singularity, but broke down at Eq. (9.110b), which 
has an irregular singular point at the origin. 

Continuing with Eq. (9.110c), we have added a term y'/x. The indicial equation is 

k 2 — a 2 — 0, 

but again, there is no recurrence relation. The solutions are y = x a ,x~ a , both perfectly 
acceptable one-term series. 

When we change the power of x in the coefficient of y' from —1 to —2, Eq. (9.1 lOd), 
there is a drastic change in the solution. The indicial equation (with only the y' term con¬ 
tributing) becomes 


k = 0. 


Oj +1 — +Clj 


a 2 ~ j(j - 1) 
7 + 1 


There is a recurrence relation. 
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Unless the parameter a is selected to make the series terminate, we have 


lim 

j—>00 


a j +1 
aj 


lim 

j—>oo 


J'O' + I) 
7 + 1 


lim — = oo. 

j^oo j 


Hence our series solution diverges for all x ^ 0. Again, our method worked for 
Eq. (9.110c) with a regular singularity but failed when we had the irregular singularity 
of Eq. (9.1 lOd). 


Fuchs’ Theorem 

The answer to the basic question when the method of series substitution can be expected 
to work is given by Fuchs’ theorem, which asserts that we can always obtain at least one 
power-series solution, provided we are expanding about a point that is an ordinary point or 
at worst a regular singular point. 

If we attempt an expansion about an irregular or essential singularity, our method may 
fail, as it did for Eqs. (9.110b) and (9.110d). Fortunately, the more important equations 
of mathematical physics, listed in Section 9.4, have no irregular singularities in the finite 
plane. Further discussion of Fuchs’ theorem appears in Section 9.6. 

From Table 9.4, Section 9.4, infinity is seen to be a singular point for all equations 
considered. As a further illustration of Fuchs’ theorem, Fegendre’s equation (with infinity 
as a regular singularity) has a convergent-series solution in negative powers of the argument 
(Section 12.10). In contrast, Bessel’s equation (with an irregular singularity at infinity) 
yields asymptotic series (Sections 5.10 and 11.6). These asymptotic solutions are extremely 
useful. 


Summary 

If we are expanding about an ordinary point or at worst about a regular singularity, the 
series substitution approach will yield at least one solution (Fuchs’ theorem). 

Whether we get one or two distinct solutions depends on the roots of the indicial equa¬ 
tion. 

1. If the two roots of the indicial equation are equal, we can obtain only one solution by 
this series substitution method. 

2. If the two roots differ by a nonintegral number, two independent solutions may be 
obtained. 

3. If the two roots differ by an integer, the larger of the two will yield a solution. 

The smaller may or may not give a solution, depending on the behavior of the coeffi¬ 
cients. In the linear oscillator equation we obtain two solutions; for Bessel’s equation, we 
get only one solution. 
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The usefulness of the series solution in terms of what the solution is (that is, numbers) 
depends on the rapidity of convergence of the series and the availability of the coefficients. 
Many ODEs will not yield nice, simple recurrence relations for the coefficients. In general, 
the available series will probably be useful for |jc| (or \x — jto|) very small. Computers 
can be used to determine additional series coefficients using a symbolic language, such 
as Mathematical 2 Maple, 13 or Reduce. 14 Often, however, for numerical work a direct 
numerical integration will be preferred. 


Exercises 

9.5.1 Uniqueness theorem. The function y (x ) satisfies a second-order, linear, homogeneous 
differential equation. At x = xo, y(x) — yo and dy/dx = y' {) . Show that y(x) is unique, 
in that no other solution of this differential equation passes through the points fro, yo) 
with a slope of y' 0 . 

Hint. Assume a second solution satisfying these conditions and compare the Taylor 
series expansions. 

9.5.2 A series solution of Eq. (9.80) is attempted, expanding about the point x — xo- If a'o is 
an ordinary point, show that the indicial equation has roots k — 0, 1 . 

9.5.3 In the development of a series solution of the simple harmonic oscillator (SHO) equa¬ 
tion, the second series coefficient a\ was neglected except to set it equal to zero. From 
the coefficient of the next-to-the-lowest power of x,x k ~ l , develop a second indicial- 
type equation. 

(a) (SHO equation with k — 0). Show that a\ , may be assigned any finite value (in¬ 
cluding zero). 

(b) (SHO equation with k — 1). Show that ai must be set equal to zero. 

9.5.4 Analyze the series solutions of the following differential equations to see when a\ may 
be set equal to zero without irrevocably losing anything and when a \ must be set equal 
to zero. 

(a) Legendre, (b) Chebyshev, (c) Bessel, (d) Hermite. 

ANS. (a) Legendre, (b) Chebyshev, and (d) Hermite: For k — 0.ai 
may be set equal to zero; for k — 1, a\ must be set equal 
to zero. 

(c) Bessel: a i must be set equal to zero (except for 
k — ±n — — |). 

9.5.5 Solve the Legendre equation 

(1 — x 2 )y" — 2 xy' + n(n + l)y = 0 
by direct series substitution. 

'-.S. Wolfram, Mathematica, A System for Doing Mathematics by Computer, New York: Addison Wesley (1991). 

i 3 A. Heck, Introduction to Maple, New York: Springer (1993). 

i 4 G. Rayna, Reduce Software for Algebraic Computation, New York: Springer (1987). 
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9.5.6 


(a) Verify that the indicial equation is 


k(k- 1) = 0. 


(b) Using k — 0, obtain a series of even powers of x (t/i = 0). 

Vcvcn — <20 


n(n + 1) 2 n{n — 2)(n + l)(n + 3) 4 
1 -—-x H --- x + • • 


2 ! 


4! 


where 


a j+2 = 


j(j + !)-«(« + 1) 

O' + 1)0' + 2) a 


(c) Using k = 1, develop a series of odd powers of x (ai = 1). 


Jodd — a \ 



(n - l)(n + 2) 3 

-XT-•* + 


(u-l)(n-3)(n + 2)(n+4) 5 
-x---+ 


where 


a J +2 = 


0 + 1)0 + 2) — n(» + 1) 

0+2)0+ 3) 


(d) Show that both solutions, Veven and y 0 dd, diverge for x = ± 1 if the series continue 
to infinity. 

(e) Finally, show that by an appropriate choice of n, one series at a time may be con¬ 
verted into a polynomial, thereby avoiding the divergence catastrophe. In quantum 
mechanics this restriction of n to integral values corresponds to quantization of 
angular momentum. 


Develop series solutions for Hermite’s differential equation 
(a) y" - 2 xy' + lay = 0. 


ANS. k(k — 1) = 0, indicial equation. 


For k = 0, 


a j +2 — 2<u 


J -a 


O'+D0'+ 2) 


0 even >> 


Jeven — ^0 


2(— a)x 2 2 2 (—a)(2 — a)x 4 

1 H---1- 


2 ! 


4! 


For k — 1, 


Q j -(_2 — 2 Cl j 
Vodd — a l [" 


j + 1- a 
0+2)0+ 3) 

2(1 -a)x 3 
*+-x- 


0 even )^ 

2 2 (1 — a)(3 — a)x 5 

5! h 
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(b) Show that both series solutions are convergent for all x, the ratio of successive 
coefficients behaving, for large index, like the corresponding ratio in the expansion 
of exp(.r 2 ). 

(c) Show that by appropriate choice of a the series solutions may be cut off and con¬ 
verted to finite polynomials. (These polynomials, properly normalized, become 
the Hermite polynomials in Section 13.1.) 


9.5.7 


9.5.8 


9.5.9 


9.5.10 


9.5.11 


Laguerre’s ODE is 

xL" n (x) + (1 - x)L' n (x) + nL„(x) — 0. 

Develop a series solution selecting the parameter n to make your series a polynomial. 
Solve the Chebyshev equation 

(1 - x 2 )T” - xT’ n + n 2 T n = 0, 

by series substitution. What restrictions are imposed on n if you demand that the series 
solution converge for x — ±1? 

ANS. The infinite series does converge for x = ±1 and no 
restriction on n exists (compare Exercise 5.2.16). 


Solve 


(1 — x 2 )U'j(x) — 3xU' n (x) + n{n + 2)U„(x) = 0, 

choosing the root of the indicial equation to obtain a series of odd powers of x. Since 
the series will diverge for x = 1, choose n to convert it into a polynomial. 

k(k- 1) = 0. 


For k— 1, 


_ 0 + 1)0’ + 3) — n(n + 2) 
a ’ +2 (j + 2)(j +3) Uj ’ 

Obtain a series solution of the hypergeometric equation 

x(x — 1 )y" + [(1 + a + b)x — c\y' + aby = 0. 
Test your solution for convergence. 


Obtain two series solutions of the confluent hypergeometric equation 

xy" + (c — x)y' — ay — 0. 


Test your solutions for convergence. 


9.5.12 


A quantum mechanical analysis of the Stark effect (parabolic coordinates) leads to the 
differential equation 


d / du \ 

d$Yd$) 


1 nr 

-E£ + a - 

2 5 4 | 



u = 0. 


Here a is a separation constant, E is the total energy, and A is a constant, where Fz is 
the potential energy added to the system by the introduction of an electric field. 
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Using the larger root of the indicial equation, develop a power-series solution about 
f = 0. Evaluate the first three coefficients in terms of a 0 . 


Indicial equation 


k 2 ~ 


4 


— 0 , 


= n^"'/ 2 


u($) = a 0 $ 


1 - 


m + 1 


2 (m + 1 )(m + 2) 4 (m + 2) 


Note that the perturbation F does not appear until <23 is included. 

9.5.13 For the special case of no azimuthal dependence, the quantum mechanical analysis of 
the hydrogen molecular ion leads to the equation 


d 

dri 


du 


, 2\““ 


+ au + P rj~u — 0 . 


Develop a power-series solution for u(rf). Evaluate the first three nonvanishing coeffi¬ 
cients in terms of a q. 


Indicial equation k(k — 1) = 0, 


Uk=l —OQT] 


1 + 


2 — a 7 
o 


(2 — a )(12 — a ) 
120 



9.5.14 To a good approximation, the interaction of two nucleons may be described by a 
mesonic potential 


Ae~ ax 

V= -, 

x 

attractive for A negative. Develop a series solution of the resultant Schrodinger wave 
equation 


tl 2 d 2 ir 


2 m dx 2 

through the first three nonvanishing coefficients. 


+ (E- V)\lf = 0 


i/f = ciq[x + \A'x 2 + i^A’ 2 




where the prime indicates multiplication by 2 m/h 2 . 


9.5.15 Near the nucleus of a complex atom the potential energy of one electron is given by 

Ze 2 , 9 . 

V = -(1 + bir + Z?2' )? 

r 

where the coefficients b\ and hi arise from screening effects. For the case of zero angu¬ 
lar momentum show that the first three terms of the solution of the Schrodinger equation 
have the same form as those of Exercise 9.5.14. By appropriate translation of coeffi¬ 
cients or parameters, write out the first three terms in a series expansion of the wave 
function. 
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9.5.16 


If the parameter a 2 in Eq. (9.1KM) is equal to 2, Eq. (9.1 lOd) becomes 


„ 1,2 

y"+ y>--y = 0. 


From the indicial equation and the recurrence relation derive a solution y — 1 + 2x + 
2x 2 . Verify that this is indeed a solution by substituting back into the differential equa¬ 
tion. 


9.5.17 


9.5.18 


The modified Bessel function 7o(x) satisfies the differential equation 

2 dr d 2 

x —y7 0 (x)+ x —7 0 (x)-x I 0 (x) — 0. 
dx L dx 

From Exercise 7.3.4 the leading term in an asymptotic expansion is found to be 

e x 


h)(x) ■ 


*j2it> 


Assume a series of the form 


h)(x) ■ 


\j2nx 

Determine the coefficients b\ and hi. 


{l + b\x 1 + b 2 X 2 H-}. 


ANS. b l = l b 2 = jfg. 

The even power-series solution of Legendre’s equation is given by Exercise 9.5.5. Take 
«0 = 1 and n not an even integer, say n — 0.5. Calculate the partial sums of the series 
through x 200 , x 400 , x 600 ,..., x 2000 for x = 0.95(0.01)1.00. Also, write out the individ¬ 
ual term corresponding to each of these powers. 

Note. This calculation does not constitute proof of convergence at x = 0.99 or diver¬ 
gence at x = 1.00, but perhaps you can see the difference in the behavior of the sequence 
of partial sums for these two values of x. 


9.5.19 


(a) The odd power-series solution of Hermite’s equation is given by Exercise 9.5.6. 
Take ao = 1. Evaluate this series for a = 0, x = 1,2,3. Cut off your calculation 
after the last term calculated has dropped below the maximum term by a factor of 
10 6 or more. Set an upper bound to the error made in ignoring the remaining terms 
in the infinite series. 

(b) As a check on the calculation of part (a), show that the Hermite series Voddlo 1 = 0) 
corresponds to f^exp(x 2 )dx. 

(c) Calculate this integral for x = 1,2, 3. 


9.6 A Second Solution 

In Section 9.5 a solution of a second-order homogeneous ODE was developed by substi¬ 
tuting in a power series. By Fuchs’ theorem this is possible, provided the power series is 
an expansion about an ordinary point or a nonessential singularity. 15 There is no guarantee 


1 Allis is why the classification of singularities in Section 9.4 is of vital importance. 
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that this approach will yield the two independent solutions we expect from a linear second- 
order ODE. In fact, we shall prove that such an ODE has at most two linearly independent 
solutions. Indeed, the technique gave only one solution for Bessel’s equation (n an integer). 
In this section we also develop two methods of obtaining a second independent solution: 
an integral method and a power series containing a logarithmic term. First, however, we 
consider the question of independence of a set of functions. 


Linear Independence of Solutions 


Given a set of functions (px, the criterion for linear dependence is the existence of a relation 
of the form 

£>m = 0, (9.111) 

A 

in which not all the coefficients kx are zero. On the other hand, if the only solution of 
Eq. (9.111) is k) — 0 for all X, the set of functions (fix is said to be linearly independent. 

It may be helpful to think of linear dependence of vectors. Consider A, B, and C in 
three-dimensional space, with A-BxC/0. Then no nontrivial relation of the form 

a A + bK + cC = 0 (9.112) 

exists. A, B, and C are linearly independent. On the other hand, any fourth vector, D, may 
be expressed as a linear combination of A, B, and C (see Section 3.1). We can always write 
an equation of the form 

D-flA —fcB-cC = 0, (9.113) 


and the four vectors are not linearly independent. The three noncoplanar vectors A, B, 
and C span our real three-dimensional space. 

If a set of vectors or functions are mutually orthogonal, then they are automatically lin¬ 
early independent. Orthogonality implies linear independence. This can easily be demon¬ 
strated by taking inner products (scalar or dot product for vectors, orthogonality integral of 
Section 10.2 for functions). 

Let us assume that the functions <px are differentiable as needed. Then, differentiating 
Eq. (9.111) repeatedly, we generate a set of equations 

£>1 = 0, (9.114) 

E*^ = 0, (9.115) 

x 

and so on. This gives us a set of homogeneous linear equations in which k, are the un¬ 
known quantities. By Section 3.1 there is a solution kx^O only if the determinant of the 
coefficients of the kx’ vanishes. This means 


<Pi <P2 

<P[ <P' 2 


1 


(«-i) 




This determinant is called the Wronskian. 


( Pn 

K 


<n- 1) 
<Pn 


= 0 . 


(9.116) 
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1. If the Wronskian is not equal to zero, then Eq. (9.111) has no solution other than 
k\ — 0. The set of functions <p A is therefore linearly independent. 

2. If the Wronskian vanishes at isolated values of the argument, this does not necessarily 
prove linear dependence (unless the set of functions has only two functions). However, 
if the Wronskian is zero over the entire range of the variable, the functions <p- A are 
linearly dependent over this range 16 (compare Exercise 9.5.2 for the simple case of 
two functions). 


Example 9.6.1 linear independence 


The solutions of the linear oscillator equation (9.84) are cp\ — sin cox, (p 2 — cos cox. The 
Wronskian becomes 


sin cox cos cox 
co cos cox — tt>sina>.r 


—co ^ 0 . 


These two solutions, ip\ and (pi, are therefore linearly independent. For just two functions 
this means that one is not a multiple of the other, which is obviously true in this case. 

You know that 

sin cox — ±(1 — cos 2 cox) 1 , 

but this is not a linear relation, of the form of Eq. (9.111). ■ 


Examples 9.6.2 Linear Dependence 


For an illustration of linear dependence, consider the solutions of the one-dimensional dif¬ 
fusion equation. We have cp\ — e x and <p 2 — e~ x , and we add (pc — cosh x, also a solution. 
The Wronskian is 


e 

e 

e 


X 

X 

X 



cosh.r 
sinh x 
cosh.r 


= 0 . 


The determinant vanishes for all x because the first and third rows are identical. Hence 
e x , e~ x , and cosh.r are linearly dependent, and, indeed, we have a relation of the form of 
Eq. (9.111): 


e x + e x — 2 cosh.r = 0 with k\ ^ 0 . ■ 

Now we are ready to prove the theorem that a second-order homogeneous ODE has 
two linearly independent solutions. 

Suppose yi, yi, >’3 are three solutions of the homogeneous ODE (9.80). Then we 
form the Wronskian Wjp = yjy' k — y'jyp of any pair yj, yp of them and recall that 


'^Compare H. Lass, Elements of Pure and Applied Mathematics , New York: McGraw-Hill (1957), p. 187, for proof of this 
assertion. It is assumed that the functions have continuous derivatives and that at least one of the minors of the bottom row of 
Eq. (9.116) (Laplace expansion) does not vanish in [a, b], the interval under consideration. 
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Wj k = y\y'{ — y'jyk- We divide each ODE by y, getting —Q on their right-hand side, 
so 


y 


yj y, 

-L + pJ. 

yj 


-2(x) = ^ + p^. 

yic yk 


Multiplying by 


(yjy'k-y"yk) + P(yjy' k -y'jyk) = o, or w' jk = -pw jk (9.H7) 

for any pair of solutions. Finally we evaluate the Wronskian of all three solutions, expand¬ 
ing it along the second row and using the ODEs for the W/ k : 


W = 


y l yi J3 

y\ y'i yi 

y'l A y'i 


= -y[wi 3 + y ' 2 w' 13 - y ' 3 w' l2 


= P(y\ W 23 - y' 2 Wn + V3W12) = -p 


y\ 

y\ 

y[ 


y 2 
?2 
yi 


y 3 
?3 

yi 


= 0 . 


The vanishing Wronskian, W — 0, because of two identical rows, is just the condition for 
linear dependence of the solutions yj. Thus, there are at most two linearly independent 
solutions of the homogeneous ODE. Similarly one can prove that a linear homogeneous 
nth-order ODE has /? linearly independent solutions yj, so the general solution y(x) = 
Yi CjVj (x) is a linear combination of them. 


A Second Solution 

Returning to our linear, second-order, homogeneous ODE of the general form 

y" + P(x)y'+ Q(x)y = 0, (9.118) 

let y 1 and V 2 be two independent solutions. Then the Wronskian, by definition, is 

w = y 1 yi - y\yi- (9.119) 

By differentiating the Wronskian, we obtain 

W' = y[y' 2 + yiyi - y’[y 2 - y[y’ 2 

= y\[-P(x)yi - Q(x)y 2 \ - yi[-P{x)y[ - Q(x)yi] 

= — P(x)(y\ >2 - y[y 2 )- 

The expression in parentheses is just W, the Wronskian, and we have 

W' = -P(x)W. (9.120) 

In the special case that P(x) = 0, that is, 

y"+Q(x)y = 0, (9.121) 

the Wronskian 

W = yxyi — y\yi = constant. (9.122) 
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Since our original differential equation is homogeneous, we may multiply the solutions vi 
and V 2 by whatever constants we wish and arrange to have the Wronskian equal to unity 
(or —1). This case, Pix) — 0, appears more frequently than might be expected. Recall that 
the portion of V 2 (y) in spherical polar coordinates involving radial derivatives contains 
no first radial derivative. Finally, every linear second-order differential equation can be 
transformed into an equation of the form of Eq. (9.121) (compare Exercise 9.6.11). 

For the general case, let us now assume that we have one solution of Eq. (9.118) by 
a series substitution (or by guessing). We now proceed to develop a second, independent 
solution for which W ^ 0. Rewriting Eq. (9.120) as 

dW 

-= —P dx , 

W 

we integrate over the variable x, from a to x, to obtain 

W(x) 


ln- 


W(a) 


-f 


P(xi)dxi, 


.17 


W(x) = l¥(fl)exp 


-r 


P(xi)dxi 


But 




By combining Eqs. (9.123) and (9.124), we have 

d_ /yz\ = ff , (j) ex P [~fg P(xi)dxi] 
dx \yi / y\ 

Finally, by integrating Eq. (9.125) from X2 — b to X2 = x we get 

exp[- f? P(xi)dx i] 


yi(x) = y\(x)W (a) 


f 


dx 2- 


(9.123) 


(9.124) 


(9.125) 


(9.126) 


[y 1O2)] 2 

Here a and b are arbitrary constants and a term y \ {x)y2 ( b ) /y\ ( b) has been dropped, for it 
leads to nothing new. Since W ( a ), the Wronskian evaluated at x — a, is a constant and our 
solutions for the homogeneous differential equation always contain an unknown normaliz¬ 
ing factor, we set W(a) — 1 and write 


yi(x) = y\(x) 


r 


exp[— f X2 P(x\)dxi\ 

[>'1 fe )] 2 


dx 2- 


(9.127) 


Note that the lower limits x\ — a and X2 = b have been omitted. If they are retained, they 
simply make a contribution equal to a constant times the known first solution, yifx), and 


17 If P(x) remains finite in the domain of interest, W(x) / 0 unless W(a) = 0. That is, the Wronskian of our two solutions is 
either identically zero or never zero. However, if P(x ) does not remain finite in our interval, then W (x) can have isolated zeros 
in that domain and one must be careful to choose a so that W(a) ^ 0. 
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hence add nothing new. If we have the important special case of P(x ) = 0, Eq. (9.127) 
reduces to 

/ ■*' dxo 

r 7 “ • (9.128) 

This means that by using either Eq. (9.127) or Eq. (9.128) we can take one known solu¬ 
tion and by integrating can generate a second, independent solution of Eq. (9.118). This 
technique is used in Section 12.10 to generate a second solution of Legendre’s differential 
equation. 


Example 9.6.3 A Second Solution for the Linear Oscillator Equation 


From d 2 y/dx 2 + y — 0 with P(x) — 0 let one solution be yi = sinx. By applying 
Eq. (9.128), we obtain 

y 2 (x)= sinx f —p— = sinx(— cotx) = — cosx, 

J sirr X 2 

which is clearly independent (not a linear multiple) of sinx. ■ 


Series Form of the Second Solution 

Further insight into the nature of the second solution of our differential equation may be 
obtained by the following sequence of operations. 

1. Express P(x) and Q(x) in Eq. (9.118) as 

OO OO 

p(x)= J2 p> x> ' gm = Y 4> xi - (9 - 129 > 

/=-l j=~2 

The lower limits of the summations are selected to create the strongest possible reg¬ 
ular singularity (at the origin). These conditions just satisfy Fuchs’ theorem and thus 
help us gain a better understanding of Fuchs’ theorem. 

2. Develop the first few terms of a power-series solution, as in Section 9.5. 

3. Using this solution as yi, obtain a second series type solution, y 2 , with Eq. (9.127), 
integrating term by term. 

Proceeding with Step 1, we have 

y" + (p- ix _1 + po + pix H-)/ + (q- 2 x~ 2 + </_ix -1 H- )y = 0, (9.130) 

in which point x = 0 is at worst a regular singular point. If p-\ = q~ \ = q~ 2 — 0, it reduces 
to an ordinary point. Substituting 

OO 

y = Y, a\x k+x 
x=o 
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(Step 2), we obtain 


22^ + X)(k + X — l)otxx k+x 2 + Y. PiX 1 Y,{k + A .)axx k+x 1 


<=-1 A =0 


+ 22 qjx J 22 axxk+X = 0 . 
j=-2 A=0 

Assuming that p_i ^ 0, q -2 7 ^ 0, our indicial equation is 

k(k — 1) + p~ik + q-2 — 0, 

which sets the net coefficient of x k 2 equal to zero. This reduces to 


(9.131) 


k z + ( p -1 - \)k + q-2 = 0. 


(9.132) 


We denote the two roots of this indicial equation by k — a and k = a — n , where n is zero 
or a positive integer. (If n is not an integer, we expect two independent series solutions by 
the methods of Section 9.5 and we are done.) Then 


(k — a)(k — a + n ) — 0, 


(9.133) 


k z + (n — 2 a)k + a (a — n ) — 0, 


and equating coefficients of k in Eqs. (9.132) and (9.133), we have 


P -1 — 1 = n — 2 a . 


(9.134) 


The known series solution corresponding to the larger root k — a may be written as 




Substituting this series solution into Eq. (9.127) (Step 3), we are faced with 


y 2 (x) = y 1 (*) 


eX P<~ fa 2 T.jZ-1 Pi A dx i\ 

x 2*(T.T=o «a-4) 2 


(9.135) 


where the solutions yi and y 2 have been normalized so that the Wronskian W(a) — 1. 
Tackling the exponential factor first, we have 


nX2 °°^ 00 ^ 

/ 22 Pi x \ dx 1 = P -1 lnx 2 + 22 

^ a i=-1 k=0 


ih Xz+l+f(a) 


(9.136) 
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with f(a) an integration constant that may depend on a. Hence, 

f X2 x—> N 

- / ) pi x \ dx i 


exp 


= ex P [~f(a)\x 2 P 1 
= exp [~f(a)]x 2 P ~ l 



i-E 

k =0 


Pk 

k+ 1 



1 

2 ! 


E 


t-0 


Pk x k +1 
A -+1 2 


2 

+ 


(9.137) 

This final series expansion of the exponential is certainly convergent if the original expan¬ 
sion of the coefficient P (x ) was uniformly convergent. 

The denominator in Eq. (9.135) may be handled by writing 

2-. -1 / oo , —2 00 

= x 2 2 “( E«E) = x 2 _2 “E fo> x 2- (9.138) 

'A=0 ' A=0 

Neglecting constant factors, which will be picked up anyway by the requirement that 
W(a) — 1, we obtain 



y 2 (x) = yi(x) f x 2 p 1 2a ( E °- x 2 ) dx 2 - (9.139) 

^ x A=0 ' 


By Eq. (9.134), 


.. /’ I' 2 ‘ y _ r -n-l 

^2 - ^2 5 


(9.140) 


and we have assumed here that n is an integer. Substituting this result into Eq. (9.139), we 
obtain 

yi(x) = yi(x)J {cQX 2 n ~ { + c\x 2 n + C2X 2 n+l H-h c n x 2 l - )dx 2. (9.141) 

The integration indicated in Eq. (9.141) leads to a coefficient of yi(.r) consisting of two 
parts: 


1. A power series starting with x~ n . 

2. A logarithm term from the integration of x~ l (when a = n). This term always appears 
when n is an integer, unless c n fortuitously happens to vanish. 18 


18 For parity considerations. In a: is taken to be In \x\, even. 
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Example 9.6.4 A Second Solution of Bessel’s Equation 


From Bessel’s equation, Eq. (9.100) (divided by x 2 to agree with Eq. (9.118)), we have 
P(x) = x ~ 1 Q(x) = 1 for the case n — 0. 

Hence p-i — 1, qo — 1; all other pi and qj vanish. The Bessel indicial equation is 

k 2 = 0 

(Eq. (9.103) with n = 0). Hence we verify Eqs. (9.132) to (9.134) with n and a = 0. 

Our first solution is available from Eq. (9.108). Relabeling it to agree with Chapter 11 
(and using ao — 1), we obtain 19 


2 4 

y\{x) = Jq(x) — 1 - y - 0(x 6 ). 


(9.142a) 


Now, substituting all this into Eq. (9.127), we have the specific case corresponding to 
Eq. (9.135): 

exp[— f X2 x~ l dx i] 


y 2 (x) = Jo(x ) 


r 


[i -xl/A+xyeA — ] 2 

From the numerator of the integrand, 

r - x2 dx i 
x 1 


dx 2- 


(9.142b) 


cxp [“/' 


= exp[—I 11 T 2 ] 


1 


X 2 


This corresponds to the x 2 P ' in Eq. (9.137). From the denominator of the integrand, using 
a binomial expansion, we obtain 


1-—4—— 

4 64 

Corresponding to Eq. (9.139), we have 


-2 


y 2 (x) = Jq(x) / — 

T2 


'f 


xi 5xi 

= l + TT + ^f + " 
2 32 


xi 5xi 

i + ^ + ^ + -- 
2 32 


dx 2 


x^“ 3x^ 

= /oWUn.r + : -h --h • 

1 4 128 


(9.142c) 


Let us check this result. From Eqs. (11.62) and (11.64), which give the standard form of 
the second solution (higher-order terms are needed) 

“■ 2 3x 4 


2 2 

N 0 (x) = —[lnx - In2 + y ]7o(t) H- 

n it 


x 

~4 


128 




(9.142d) 


Two points arise: (1) Since Bessel’s equation is homogeneous, we may multiply y 2 (x) by 
any constant. To match Nq(x), we multiply our y 2 (x) by 2/tt. (2) To our second solution. 


19. 


The capital O (order of) as written here means terms proportional to and possibly higher powers of x. 
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(2/7 t)j2(x), we may add any constant multiple of the first solution. Again, to match Nq(x) 
we add 

2 

— [— In 2 + y]./o (•*), 

it 

where y is the usual Euler-Mascheroni constant (Section 5.2). 20 Our new, modified second 
solution is 


yi(x) = 


2 2 

— [In— ln2 + y]7o(jf) H- Jq(x) 

i r it 


x 2 5a 4 1 

T + l28 + "T 


(9.142e) 


Now the comparison with No(x) becomes a simple multiplication of Jq(x) from 
Eq. (9.142a) and the curly bracket of Eq. (9.142c). The multiplication checks, through 
terms of order x 2 and a' 4 , which is all we carried. Our second solution from Eqs. (9.127) 
and (9.135) agrees with the standard second solution, the Neumann function, Nq(x). 

From the preceding analysis, the second solution of Eq. (9.118), yi(x), may be written 
as 


OO 

yi(x) = y\{x)\nx + ^ d/x' +a , (9.142f) 

j=-n 


the first solution times In a and another power series, this one starting with a“ _ ", which 
means that we may look for a logarithmic term when the indicial equation of Sec¬ 
tion 9.5 gives only one series solution. With the form of the second solution specified 
by Eq. (9.142f), we can substitute Eq. (9.142f) into the original differential equation and 
determine the coefficients dj exactly as in Section 9.5. It may be worth noting that no se¬ 
ries expansion of In a is needed. In the substitution. In a will drop out; its derivatives will 
survive. ■ 


The second solution will usually diverge at the origin because of the logarithmic factor 
and the negative powers of a in the series. For this reason yi{x) is often referred to as 
the irregular solution. The first series solution, vi(a), which usually converges at the 
origin, is called the regular solution. The question of behavior at the origin is discussed in 
more detail in Chapters 11 and 12, in which we take up Bessel functions, modified Bessel 
functions, and Legendre functions. 


Summary 

The two solutions of both sections (together with the exercises) provide a complete solu¬ 
tion of our linear, homogeneous, second-order ODE — assuming that the point of expan¬ 
sion is no worse than a regular singularity. At least one solution can always be obtained 
by series substitution (Section 9.5). A second, linearly independent solution can be con¬ 
structed by the Wronskian double integral, Eq. (9.127). This is all there are: No third, 
linearly independent solution exists (compare Exercise 9.6.10). 

The nonhomogeneous, linear, second-order ODE will have an additional solution: the 
particular solution. This particular solution may be obtained by the method of variation 
of parameters. Exercise 9.6.25, or by techniques such as Green’s function. Section 9.7. 

20 The Neumann function Nq is defined as it is in order to achieve convenient asymptotic properties. Sections 11.3 and 11.6. 
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Exercises 

9.6.1 

9.6.2 

9.6.3 

9.6.4 

9.6.5 

9.6.6 

9.6.7 

9.6.8 


You know that the three unit vectors x, y, and z are mutually perpendicular (orthogonal). 
Show that x, y, and z are linearly independent. Specifically, show that no relation of the 
form of Eq. (9.111) exists for x, y, and z. 

The criterion for the linear independence of three vectors A, B, and C is that the equa¬ 
tion 


a A + /xB + cC = 0 

(analogous to Eq. (9.111)) has no solution other than the trivial a — b — c = 0. Using 
components A = (Ai, A 2, A3), and so on, set up the determinant criterion for the exis¬ 
tence or nonexistence of a nontrivial solution for the coefficients a, b, and c. Show that 
your criterion is equivalent to the triple scalar product A ■ B x C / 0. 

Using the Wronskian determinant, show that the set of functions 

x n ] 

1, — (n=l,2,...,A0 
n\ | 

is linearly independent. 

If the Wronskian of two functions vi and V2 is identically zero, show by direct integra¬ 
tion that 


y 1 = cyi, 

that is, that y 1 and V2 are dependent. Assume the functions have continuous derivatives 
and that at least one of the functions does not vanish in the interval under consideration. 

The Wronskian of two functions is found to be zero at xq — s < x < xq + s for arbitrarily 
small s > 0. Show that this Wronskian vanishes for all x and that the functions are 
linearly dependent. 

The three functions sinx, e x , and e~ x are linearly independent. No one function can be 
written as a linear combination of the other two. Show that the Wronskian of sinx, e x , 
and e~ x vanishes but only at isolated points. 

ANS. W — 4sinx, 

W = 0 for x — ±mr, n = 0,1,2,_ 

Consider two functions <p 1 — x and q >2 = \x\= x sgnx (Fig. 9.3). The function sgnx is 
the sign of x. Since (p\ — 1 and q>\ — sgnx, W(<p \, cp^) — 0 for any interval, including 
[—1, +1]. Does the vanishing of the Wronskian over [—1, +1] prove that <p\ and are 
linearly dependent? Clearly, they are not. What is wrong? 

Explain that linear independence does not mean the absence of any dependence. Illus¬ 
trate your argument with cosh x and e x . 

Legendre’s differential equation 

(l — x 2 )y" — 2 xy' + n(n + l)y = 0 


9.6.9 
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Figure 9.3 x and |x|. 


has a regular solution P„(x) and an irregular solution Q n (x). Show that the Wronskian 
of P n and <2» is given by 

Pn(x)Q' n (x) - P' n (x)Q n (x) = -^4, 

1 — x z 

with A„ independent of x. 

9.6.10 Show, by means of the Wronskian, that a linear, second-order, homogeneous ODE of 
the form 


y"(x) + P(x)y'(x) + Q(x)y(x) = 0 

cannot have three independent solutions. (Assume a third solution and show that the 
Wronskian vanishes for all x.) 

9.6.11 Transform our linear, second-order ODE 

y" + P(x)y' + Q(x)y — 0 


by the substitution 


y = z exp 


1 f x 

2 J P(t)dt 


and show that the resulting differential equation for z is 


Z + q(x)z — 0, 


where 

q(x) = Q(x) - \P'{x) - \P 2 {x). 

Note. This substitution can be derived by the technique of Exercise 9.6.24. 

9.6.12 Use the result of Exercise 9.6.11 to show that the replacement of (p(r ) by r(p(r) may be 
expected to eliminate the first derivative from the Laplacian in spherical polar coordi¬ 
nates. See also Exercise 2.5.18(b). 
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9.6.13 


9.6.14 


9.6.15 


9.6.16 

9.6.17 


By direct differentiation and substitution show that 

exp[— f s P(t)dt] 


yi(x) = y\(x) 


r 


[yiG )] 2 


ds 


satisfies (like yi(x)) the ODE 

y 2 00 + P(x)y' 2 (x) + Q(x)y 2 (x) = 0. 
Note. The Leibniz formula for the derivative of an integral is 


d r h ^ a) f 

— / f (x, a) dx = / 
J 2(a) Je 


da 


h(ol) df(x,a) r -.dh(a) 

dx + j [«( a), aj - 


g(a) 


da 


da 


In the equation 


yi(x) satisfies 


y 2 (x) = yi(x) 


f 


exp[— f s P(t)dt] 
[vi (j )] 2 


ds 


y'\ + P(x)y[ + Q(x)yi = 0. 


/[<?(<*), 


«] 


dg(a) 

da 


The function y 2 (x ) is a linearly independent second solution of the same equation. 
Show that the inclusion of lower limits on the two integrals leads to nothing new, that 
is, that it generates only an overall constant factor and a constant multiple of the known 
solution yi (x). 


Given that one solution of 

,, 1 , 777 2 

R" + -R' - t R = 0 

r r- 

is R — r' n , show that Eq. (9.127) predicts a second solution, R = r~ m . 

Using y\(x) — ^^ 0 (— l)' , x 2 " +1 /(2« + 1)! as a solution of the linear oscillator equa¬ 
tion, follow the analysis culminating in Eq. (9.142f) and show that — 0 so that the 
second solution does not, in this case, contain a logarithmic term. 

Show that when n is not an integer in Bessel’s ODE, Eq. (9.100), the second solution 
of Bessel’s equation, obtained from Eq. (9.127), does not contain a logarithmic term. 


9.6.18 (a) One solution of Hermite’s differential equation 

y" — 2 xy' + lay — 0 

for a — 0 is yi(x) = 1. Find a second solution, y 2 (x), using Eq. (9.127). Show that 
your second solution is equivalent to y 0 dd (Exercise 9.5.6). 

(b) Find a second solution for a = 1, where y i (x ) — x, using Eq. (9.127). Show that 
your second solution is equivalent to y e ven (Exercise 9.5.6). 


9.6.19 One solution of Laguerre’s differential equation 

xy" + (1 — x)y' + ny = 0 


for n — 0 is vi (x) — I. Using Eq. (9.127), develop a second, linearly independent solu¬ 
tion. Exhibit the logarithmic term explicitly. 
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9.6.20 


9.6.21 


9.6.22 


9.6.23 


9.6.24 


For Laguerre’s equation with n — 0, 

[ x e s 

yi{x) — / —ds. 

(a) Write yiix) as a logarithm plus a power series. 

(b) Verify that the integral form of yiix), previously given, is a solution of Laguerre’s 
equation (n = 0 ) by direct differentiation of the integral and substitution into the 
differential equation. 

(c) Verify that the series form of y 2 (x ), part (a), is a solution by differentiating the 
series and substituting back into Laguerre’s equation. 

One solution of the Chebyshev equation 

(1 - x 2 )y" - xy' + n 2 y — 0 

for n = 0 is yi = 1 . 


(a) Using Eq. (9.127), develop a second, linearly independent solution. 

(b) Find a second solution by direct integration of the Chebyshev equation. 


Hint. Let v = y' and integrate. Compare your result with the second solution given in 
Section 13.3. 

ANS. (a) y 2 — sin -1 x. 

(b) The second solution, V n (x), is not defined for n — 0. 


One solution of the Chebyshev equation 

(1 - x 2 )y" - xy' + n 2 y — 0 

for n — 1 is y\{x) — x. Set up the Wronskian double integral solution and derive a 
second solution, y 2 (x). 

ANS. y 2 = -(l-* 2 ) 1/2 . 

The radial Schrodinger wave equation has the form 


h 2 d 2 h 2 

2m dr 2 ^ ^ 2mr 2 


■V(r) 


y(r) = Ey(r). 


The potential energy V (r) may be expanded about the origin as 

b -1 

V(r) = -1- bo + b\r H-. 

r 

(a) Show that there is one (regular) solution starting with r /+1 . 

(b) From Eq. (9.128) show that the irregular solution diverges at the origin as r 


-l 


Show that if a second solution, V 2 , is assumed to have the form y 2 (x) — y\(x)f(x), 
substitution back into the original equation 

>2 + P(x)y' 2 + Q{x)y 2 — 0 
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9.6.25 


leads to 



exp [~f s P(t)dt] 

-«- ds 

[VlG )] 2 


in agreement with Eq. (9.127). 


If our linear, second-order ODE is nonhomogeneous, that is, of the form of Eq. (9.82), 

the most general solution is 


y{x) = yi (x) + y 2 (x) + y p (x). 


(yi and y 2 are independent solutions of the homogeneous equation.) 
Show that 


y p (x) = y 2 {x) 



yi(s)F(s)ds 
W{yiC?), V2(^)} 



y 2 (s)F(s)ds 

W{yi(.s),y2(s)}’ 


with W{yi(.r), y 2 {x)} the Wronskian of yi(s) and y 2 (s). 

Hint. As in Exercise 9.6.24, let y p (x) = y\ (x)v(x) and develop a first-order differential 
equation for v'(x). 


9.6.26 (a) Show that 


has two solutions: 


y + 


1 — a 2 

4x 2 


~y — o 


yi(x) = ao-t (1+ “ )/2 , 
y 2 (x) = flo-r (1 "°' ,/2 . 

(b) For a = 0 the two linearly independent solutions of part (a) reduce to yio = flo.r 1 / 2 . 
Using Eq. (9.128) derive a second solution, 

y 2 o(x) = a 0 x l/2 lnx. 


Verify that y 2 o is indeed a solution. 

(c) Show that the second solution from part (b) may be obtained as a limiting case from 
the two solutions of part (a): 

>’20 (x) = lim (— -— V 

a->0\ a. J 


9.7 Nonhomogeneous Equation—Green’s Function 

The series substitution of Section 9.5 and the Wronskian double integral of Section 9.6 
provide the most general solution of the homogeneous, linear, second-order ODE. The 
specific solution, y p , linearly dependent on the source term ( F(x ) of Eq. (9.82)) may be 
cranked out by the variation of parameters method. Exercise 9.6.25. In this section we turn 
to a different method of solution — Green’s function. 

For a brief introduction to Green’s function method, as applied to the solution of a non¬ 
homogeneous PDE, it is helpful to use the electrostatic analog. In the presence of charges 
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the electrostatic potential i// satisfies Poisson’s nonhomogeneous equation (compare Sec¬ 
tion 1.14), 

V 2 i/f = — — (mks units), (9.143) 

£0 

and Laplace’s homogeneous equation, 

vV = 0 , (9.144) 


in the absence of electric charge (p — 0). If the charges are point charges q,, we know that 
the solution is 



l 


(9.145) 


a superposition of single-point charge solutions obtained from Coulomb’s law for the force 
between two point charges q\ and q 2 . 


F = 


qiqir 


(9.146) 


4itsor 2 

By replacement of the discrete point charges with a smeared-out distributed charge, charge 
density p, Eq. (9.145) becomes 


xfr (r — 0) = 


~f 

4 Jte 0 J 


P(r) 


dr 


4-jtbo J r 

or, for the potential at r = ri away from the origin and the charge at r = r 2 . 


iA(ri) 


1 


f p(r 2 ) 

J l r t — 


4nso 


dr2- 


(9.147) 


(9.148) 


We use i jr as the potential corresponding to the given distribution of charge and there¬ 
fore satisfying Poisson’s equation (9.143), whereas a function G, which we label Green’s 
function, is required to satisfy Poisson’s equation with a point source at the point defined 
by r 2 : 


V 2 G = — S (r i — r 2 ). 


(9.149) 


Physically, then, G is the potential at ri corresponding to a unit source at r 2 . By Green’s 
theorem (Section 1.11, Eq. (11.104)) 


J (i/ f V 2 G — GV 2 i/r)fl , T 2 = J (ir'VG-GVxlr)-da. 


(9.150) 


Assuming that the integrand falls off faster than r 2 we may simplify our problem by 
taking the volume so large that the surface integral vanishes, leaving 


J f\ 2 Gdr 2 = J GV 2 \l/dr 2 , 


or, by substituting in Eqs. (9.143) and (9.149), we have 

G(rj,r 2 )p(r 2 ) 


-/ 


Vr(r 2 )S(ri - r 2 )dr 2 = 


-/ 


So 


d r 2 . 


(9.151) 


(9.152) 
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Integration by employing the defining property of the Dirac delta function (Eq. (1.171b)) 
produces 


VK r i) = 



G(ri,r2)p(r 2 )t/T2. 


(9.153) 


Note that we have used Eq. (9.149) to eliminate V 2 G but that the function G itself is 
still unknown. In Section 1.14, Gauss law, we found that 



(9.154) 


0 if the volume did not include the origin and —4 tt if the origin were included. This result 
from Section 1.14 may be rewritten as in Eq. (1.170), or 


v2 (i) = = ,9155) 

corresponding to a shift of the electrostatic charge from the origin to the position r = r 2 . 
Here r \2 = |r 1 — r 2 |, and the Dirac delta function <5 (r 1 — r 2 ) vanishes unless ri = r 2 . 
Therefore in a comparison of Eqs. (9.149) and (9.155) the function G (Green’s function) 
is given by 


G(ri,r 2 ) 


1 


47T|ri - r 2 | 

The solution of our differential equation (Poisson’s equation) is 

1 f p(r 2 ) 


f(r\) = 


f 


4jre 0 J |r 1 - r 2 


-dr 2 , 


(9.156) 


(9.157) 


in complete agreement with Eq. (9.148). Actually \[r( ri), Eq. (9.157), is the particular 
solution of Poisson’s equation. We may add solutions of Laplace’s equation (compare 
Eq. (9.83)). Such solutions could describe an external field. 

These results will be generalized to the second-order, linear, but nonhomogeneous dif¬ 
ferential equation 


Gy(ri) = -/(it), 


(9.158) 


where C is a linear differential operator. The Green’s function is taken to be a solution of 


£G(ri,r 2 ) = -<5(ri -r 2 ), 


(9.159) 


analogous to Eq. (9.149). The Green’s function depends on boundary conditions that may 
no longer be those of electrostatics in a region of infinite extent. Then the particular solution 
y(ri) becomes 


v(ri) = 


/ 


G(ri,r 2 )/(r 2 )£/T 2 . 


(9.160) 
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(There may also be an integral over a bounding surface, depending on the conditions spec¬ 
ified.) 

In summary, Green’s function, often written G(ri,r 2 ) as a reminder of the name, is a 
solution of Eq. (9.149) or Eq. (9.159) more generally. It enters in an integral solution 
of our differential equation, as in Eqs. (9.148) and (9.153). For the simple, but impor¬ 
tant, electrostatic case we obtain Green’s function, G(ri,r 2 ), by Gauss’ law, comparing 
Eqs. (9.149) and (9.155). Finally, from the final solution (Eq. (9.157)) it is possible to 
develop a physical interpretation of Green’s function. It occurs as a weighting function or 
propagator function that enhances or reduces the effect of the charge element p(r 2 )dx 2 
according to its distance from the field point ri. Green’s function, G(ri,r 2 ), gives the ef¬ 
fect of a unit point source at r 2 in producing a potential at ri. This is how it was introduced 
in Eq. (9.149); this is how it appears in Eq. (9.157). 

Symmetry of Green’s Function 

An important property of Green’s function is the symmetry of its two variables; that is, 

G(r 1 ,r 2 ) = G(r 2 ,r I ). (9.161) 

Although this is obvious in the electrostatic case just considered, it can be proved under 
more general conditions. In place of Eq. (9.149), let us require that G(r, r i) satisfy 21 

V • [/>(!•)VG(r, n)] + Xq(r)G(r, n) = -8 (r - n), (9.162) 

corresponding to a mathematical point source at r = iq. Here the functions p( r) and q(r) 
are well-behaved but otherwise arbitrary functions of r. The Green’s function, G(r, r 2 ), 
satisfies the same equation, but the subscript 1 is replaced by subscript 2. The Green’s 
functions, G(r, r i) and G(r,r 2 ), have the same values over a given surface S of some 
volume of finite or infinite extent, and their normal derivatives have the same values over 
the surface S , or these Green’s functions vanish on S (Dirichlet boundary conditions. Sec¬ 
tion 9.1). 22 Then G(r, r 2 ) is a sort of potential at r, created by a unit point source at r 2 . 

We multiply the equation for G(r, ri) by G(r, r 2 ) and the equation for G(r, r 2 ) by 
G(r, ri) and then subtract the two; 

G(r, r 2 )V ■ [p(r)VG(r,n)] - G(r,n)V • [p(r)VG(r, r 2 )] 

= — G(r, r 2 )S(r - n) + G(r, n)j(r - r 2 ). (9.163) 

The first term in Eq. (9.163), 

G(r,r 2 )V.[p(r)VG(r,n)], 

may be replaced by 

V • [G(r, r 2 )p(r)VG(r, n)] - VG(r, r 2 ) • p(r)VG(r, n). 

21 Equation (9.162) is a three-dimensional, inhomogeneous version of the self-adjoint eigenvalue equation, Eq. (10.8). 

22 Any attempt to demand that the normal derivatives vanish at the surface (Neumann’s conditions, Section 9.1) leads to trouble 
with Gauss’ law. It is like demanding that f E • da = 0 when you know perfectly well that there is some electric charge inside 
the surface. 



596 


Chapter 9 Differential Equations 


A similar transformation is carried out on the second term. Then integrating over the vol¬ 
ume whose surface is S and using Green’s theorem, we obtain a surface integral: 

I [G(r, r 2 )p(r) VG(r, n) - G(r, n)p(r)VG(r, r 2 )] • da 
= -G(r 1 ,r 2 ) + G(r 2 ,ri). (9.164) 

The terms on the right-hand side appear when we use the Dirac delta functions in 
Eq. (9.163) and carry out the volume integration. With the boundary conditions earlier 
imposed on the Green’s function, the surface integral vanishes and 

G(r 1 ,r 2 ) = G(r 2 ,r 1 ), (9.165) 

which shows that Green’s function is symmetric. If the eigenfunctions are complex, bound¬ 
ary conditions corresponding to Eqs. (10.19) to (10.20) are appropriate. Equation (9.165) 
becomes 


G(r 1 ,r 2 ) = G*(r 2 ,r 1 ). (9.166) 

Note that this symmetry property holds for Green’s functions in every equation in the 
form of Eq. (9.162). In Chapter 10 we shall call equations in this form self-adjoint. The 
symmetry is the basis of various reciprocity theorems; the effect of a charge at r 2 on the 
potential at ri is the same as the effect of a charge at ri on the potential at r 2 . 

This use of Green’s functions is a powerful technique for solving many of the more 
difficult problems of mathematical physics. 


Form of Green’s Functions 


Let us assume that C is a self-adjoint differential operator of the general form 23 

A = Vr • [p(ri)Vi] + tf( ri ). (9.167) 

Here the subscript 1 on C emphasizes that C operates on rj. Then, as a simple generaliza¬ 
tion of Green’s theorem, Eq. (1.104), we have 

f(vC2U-uC2v)dr 2 = J p(vV 2 M — wV 2 u) • dcr 2 , (9.168) 

in which all quantities have r 2 as their argument. (To verify Eq. (9.168), take the divergence 
of the integrand of the surface integral.) We let u( r 2 ) = y(r 2 ) so that Eq. (9.158) applies 
and u(r 2 ) = G(ri,r 2 ) so that Eq. (9.159) applies. (Remember, G(ri,r 2 ) = G(r 2 ,ri).) 
Substituting into Green’s theorem we get 

J {-G(r 1 ,r 2 )/(r 2 ) + y(r 2 )5(ri -r 2 )}dx 2 
— J p(r 2 ){G(ri,r 2 )V 2 y(r 2 ) — y(r 2 )V 2 G(rj,r 2 )} ■ da 2 . (9.169) 


23 


C\ may be in 1, 2, or 3 dimensions (with appropriate interpretation of V \). 
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When we integrate over the Dirac delta function 

y(ri) = J G(ri,r 2 )/(r 2 )t/T 2 

+ J p( r 2 ){G(rt, r 2 )V 2 y(r 2 ) — y(r 2 )V 2 G(ri, r 2 )} • da 2 , (9.170) 

our solution to Eq. (9.158) appears as a volume integral plus a surface integral. If y and 
G both satisfy Dirichlet boundary conditions or if both satisfy Neumann boundary con¬ 
ditions, the surface integral vanishes and we regain Eq. (9.160). The volume integral is a 
weighted integral over the source term /(r 2 ) with our Green’s function G(rj, r 2 ) as the 
weighting function. 

For the special case of p(r\) = 1 and q(v\ ) — 0, £ is V 2 , the Laplacian. Let us integrate 

V 2 G(r 1 ,r 2 ) = -5(n-r 2 ) (9.171) 


over a small volume including the point source. Then 


/ 


Vi 


• ViG(ri,r 2 )t/ri = - 


/ 


<5(ri — r 2 )t/ti = — 1. 


(9.172) 


The volume integral on the left may be transformed by Gauss’ theorem, as in the develop¬ 
ment of Gauss’ law— Section 1.14. We find that 


j ViG(ri, r 2 ) ■ do\ = — 1. 


(9.173) 


This shows, incidentally, that it may not be possible to impose a Neumann boundary con¬ 
dition, that the normal derivative of the Green’s function, dG/dn, vanishes over the entire 
surface. 

If we are in three-dimensional space, Eq. (9.173) is satisfied by taking 


9 

- —G(ri, r 2 ) = — 
orn 


1 

4tT 


1 

|ri — r 2 | 2 ’ 


rn — |ri — r 2 |. 


(9.174) 


The integration is over the surface of a sphere centered at r 2 . The integral of Eq. (9.174) is 


G(ri,r 2 ) 


1 1 

An |ri — r 2 | ’ 


(9.175) 


in agreement with Section 1.14. 

If we are in two-dimensional space, Eq. (9.173) is satisfied by taking 


9 

dpn 


G(p 1 , P 2 ) — 


1 

2 7t 


1 

\P\ - Pl\' 


(9.176) 


with r being replaced by p, p — (x 2 + y 2 ) 1 / 2 , and the integration being over the circumfer¬ 
ence of a circle centered on p 2 . Here p\ 2 = \P\ — p 2 \- Integrating Eq. (9.176), we obtain 

G(p l ,p 2 ) = -^\n\p l -p 2 \. (9.177) 

To G(p |, p 2 ) (and to G(ri, r 2 )) we may add any multiple of the regular solution of the 
homogeneous (Laplace’s) equation as needed to satisfy boundary conditions. 
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Table 9.5 Green’s Functions" 



Laplace 

V 2 

Helmholtz 

V 2 + k 2 

Modified Helmholtz 
V 2 -k 1 

One-dimensional space 

Two-dimensional space 

Three-dimensional space 

No solution 

for (—oo, oo) 

-E n i/>i -pi i 

Z7T 

1 1 

i 

— exp(ik\xi - x 2 \) 

2k 

exp(tT|r! - r 2 |) 

LexpC-fclA'! -x 2 \) 
2k 

^-K Q (k\ Pl - P2 \) 

2 tt 

expl-t.-lr, — r 2 |) 

4jt |r! — r 2 | 

Trlr, — r 2 | 

4zr |r! — r 2 | 


a These are the Green’s functions satisfying the boundary condition G(ri,r 2 ) = 0 as —» oo for the Laplace and modified 
Helmholtz operators. For the Helmholtz operator, G(r[,r 2 ) corresponds to an outgoing wave. is the Hankel function of 
Section 11.4. Kq is he modified Bessel function of Section 11.5. 


The behavior of the Laplace operator Green’s function in the vicinity of the source point 
rj = r 2 shown by Eqs. (9.175) and (9.177) facilitates the identification of the Green’s 
functions for the other cases, such as the Helmholtz and modified Helmholtz equations. 

1. For ri ^ r 2 , G(ri, r 2 ) must satisfy the homogeneous differential equation 

AG(r 1 ,r 2 ) = 0, ri ^r 2 . (9.178) 

2. As n —> r 2 (or p { —> p 2 ), 

1 

G(/Oj,/OT)Ri-ln|/Oj— p 2 \, two-dimensional space, (9.179) 

2jt 

1 1 

G(ri,rT) — •-, three-dimensional space. (9.180) 

4tt |r! — r 2 | 

The term ±k 2 in the operator does not affect the behavior of G near the singular point 
rj = r 2 . For convenience, the Green’s functions for the Laplace, Helmholtz, and modified 
Helmholtz operators are listed in Table 9.5. 


Spherical Polar Coordinate Expansion 24 

As an alternate determination of the Green’s function of the Laplace operator, let us assume 
a spherical harmonic expansion of the form 

OO / 

G(ri,r 2 ) = EE 8l(rur 2 )Yi n (8u<p 1 )Yl n *(e2, Vi), (9.181) 

1=0 m=—l 

where the summation index / is the same for the spherical harmonics, as a consequence 
of the symmetry of the Green’s function. We will now determine the radial functions 


24 This section is optional here and may be postponed to Chapter 12. 
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gl(r\, r l)- From Exercises 1.15.11 and 12.6.6, 

1 

5(ri - r 2 ) = — 2 5(ri - r 2 )<5(cos$i - cos0 2 )<5(<pi - <p 2 ) 


1 OO / 

= -^5(n - r 2 ) EE F, m (0i,^i)F ; m *(0 2 ,^ 2 ). (9.182) 

^ I /=0 m=—l 


Substituting Eqs. (9.181) and (9.182) into the Green’s function differential equation, 
Eq. (9.171), and making use of the orthogonality of the spherical harmonics, we obtain 
a radial equation: 


n—^[rigl(n,r 2 )] -1(1 + l)gi(n,r 2 ) = -S(n - r 2 ). 


(9.183) 


This is now a one-dimensional problem. The solutions 25 of the corresponding homoge¬ 
neous equation are and . If we demand that g/ remain finite as r\ —»■ 0 and vanish 
as r\ —>• oo, the technique of Section 10.5 leads to 


gl(n,r 2 ) 


1 

21 + 1 


zL 

^ +I 

A 

^ +1 


n < r 2 , 


n > r 2 , 


(9.184) 


or 


gl (r\,r 2 ) 


1 

2Z+ 1 



(9.185) 


Hence our Green’s function is 


CXD / 


G(ir,r 2 ) = E E 

1=0 m=—l 


1 rl 

2 / + l^+ r 


(0i, (pi)Y™*(6 2 , (p 2 ). 


(9.186) 


Since we already have G(t|. r 2 ) in closed form, Eq. (9.175), we may write 


1 1 

An |ri — r 2 | 


CXD / 


EE 


1 rl 
21+ l^ 1 


Yr(9u<pi)Yr<h’<P2)- 


(9.187) 


One immediate use for this spherical harmonic expansion of the Green’s function is 
in the development of an electrostatic multipole expansion. The potential for an arbitrary 
charge distribution is 


i " (ri) = i/ 


P( r 2 ) 
|ri — r 2 | 


dr 2 


25 Compare Table 9.2. 



600 


Chapter 9 Differential Equations 


(which is Eq. (9.148)). Substituting Eq. (9.187), we get 

i “ ' i y”(o un) 


iin^ d e 2 rl„n\. 


for r i > r 2 . 


This is the multipole expansion. The relative importance of the various terms in the double 
sum depends on the form of the source, p(r 2 ). 

Legendre Polynomial Addition Theorem 26 

From the generating expression for Legendre polynomials, Eq. (12.4a), 


ii i \ > r. 

- ' - = — > —ttt f) (cos y ), 

4tr |ri-r 2 | 4jr ^ ri +1 


(9.188) 


where y is the angle included between vectors ri and r 2 , Fig. 9.4. Equating Eqs. (9.187) 
and (9.188), we have the Legendre polynomial addition theorem: 


Pi (cos y ) = =~~r 


(9.189) 
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It is instructive to compare this derivation with the relatively cumbersome derivation of 
Section 12.8 leading to Eq. (12.177). 


Circular Cylindrical Coordinate Expansion 27 


In analogy with the preceding spherical polar coordinate expansion, we write 


1 

<5(ri - r 2 ) = —5(pi - p 2 )S(<Pi - <p 2 )<$(zi - z 2 ) 
Pi 


1 

= — <5(pi - P2) 
Pi 


1 

An 2 


E 


e im(<pi-<p 2 ) 


m =—oo 



e ik(zi-z 2 ) dkt 


(9.190) 


using Exercise 12.6.5 and Eq. (1.193c) and the Cauchy principal value. But why a summa¬ 
tion for the ^-dependence and an integration for the ."-dependence? The requirement that 
the azimuthal dependence be single-valued quantizes m, hence the summation. No such 
restriction applies to k. 

To avoid problems later with negative values of k, we rewrite Eq. (9.190) as 
1 1 00 1 r°° 

<H r i — r 2 ) = —<5(pi — pi)— Y e " n(n ~ <n) — \ cos k(z\-Z 2 )dk. (9.191) 

* 2lt m=oo ^ 


We assume a similar expansion of the Green’s function. 


G(ru r 2 ) = 


1 

In 2 


OQ 

E Srn(Pl,P2)e im ^-^ 
m=—co 



cosk(zi — Z2)dk, 


(9.192) 


with the p-dependent coefficients g m (pi, p 2 ) to be determined. Substituting into 
Eq. (9.171), now in circular cylindrical coordinates, we find that if g(pi, p 2 ) satisfies 


d dg m 
dpi l dpi 


k 2 pi + 


2 ~\ 

m 

Pi . 


gm — —<$(pi - P2), 


(9.193) 


then Eq. (9.171) is satisfied. 

The operator in Eq. (9.193) is identified as the modified Bessel operator (in self- 
adjoint form). Hence the solutions of the corresponding homogeneous equation are u\ — 
I m (kp), U 2 — K m (kp). As in the spherical polar coordinate case, we demand that G be 
finite at pi = 0 and vanish as pi —> oo. Then the technique of Section 10.5 yields 


gm (Pi > Pi) — ~y m {kp < ) K m (kp> ). (9.194) 


This corresponds to Eq. (9.155). The constant A comes from the Wronskian (see 
Eq. (9.120)): 


l m (kp)K' m (kp) - l' m (kp)K m (kp) = 


A 

P(kp)' 


" 7 This section is optional here and may be postponed to Chapter 11. 


(9.195) 
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From Exercise 11.5.10, A = —1 and 

8m (Pi> Pi) = I m (k P< )K m (k P> ). (9.196) 

Therefore our circular cylindrical coordinate Green’s function is 

1 1 
G(ri,r 2 ) = — 


4?r |ri-r 2 | 


1 °° roc 

= J Im{k P <)K m {k P> )e im ^-^ cosA:(zi - z 2 ) dk. 


(9.197) 


Exercise 9.7.14 is a special case of this result. 


Example 9 . 7. 7 Quantum Mechanical Scattering — Neumann Series Solution 


The quantum theory of scattering provides a nice illustration of integral equation tech¬ 
niques and an application of a Green’s function. Our physical picture of scattering is as 
follows. A beam of particles moves along the negative z-axis toward the origin. A small 
fraction of the particles is scattered by the potential V(r) and goes off as an outgoing 
spherical wave. Our wave function i//(r) must satisfy the time-independent Schrodinger 
equation 


or 


h~ t 

- W-f(r) + V(r)i/r(r) = Etfr{r), 

2m 


vV(r) + A: 2 i/Tr) = - 


—V (r) i/r (r) 
n 


k 2 


2m E 


(9.198a) 

(9.198b) 


From the physical picture just presented we look for a solution having an asymptotic 
form 

VKrW k » r + fk(e,<p) — . (9.199) 

r 

Here e lk °' r is the incident plane wave 28 with ko the propagation vector carrying the sub¬ 
script 0 to indicate that it is in the 0 = 0 (z-axis) direction. The magnitudes ko and k are 
equal (ignoring recoil), and e ,kr /r is the outgoing spherical wave with an angular (and 
energy) dependent amplitude factor ft (9, (p). 29 Vector k has the direction of the outgoing 
scattered wave. In quantum mechanics texts it is shown that the differential probability of 
scattering, do/dQ., the scattering cross section per unit solid angle, is given by \fk(9, cp\ 2 . 

Identifying [—(2m//i 2 )V(r)t/f(r)] with /(r) ofEq. (9.158), we have 

lKrt) = ~j ^V(r 2 ) 1 A(r 2 )G(r 1 ,r 2 )^ 3 r 2 (9.200) 


28 For simplicity we assume a continuous incident beam. In a more sophisticated and more realistic treatment, Eq. (9.199) would 
be one component of a Fourier wave packet. 

29 If V (r) represents a central force, will be a function of 6 only, independent of azimuth. 
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by Eq. (9.170). This does not have the desired asymptotic form of Eq. (9.199), but we may 
add to Eq. (9.200) e' k °' ri , a solution of the homogeneous equation, and put i// (r) into the 
desired form: 

f{r l ) = e ik ^- y^Jv(r 2 )Vr(r 2 )G( r u r 2 )d 3 r 2 . (9.201) 

Our Green’s function is the Green’s function of the operator £ — V 2 + k 2 (Eq. (9.198)), 
satisfying the boundary condition that it describe an outgoing wave. Then, from Table 9.5, 
G(ri,r 2 ) = exp(/fc|ri - r 2 |)/(4jr|ri -r 2 |) and 

, C 2m e ik |r 1 -r 2 | 

ri) = e ik « r ‘- / v{T 2 )f{T 2 ) — -- d 3 r 2 . (9.202) 

J h 2 4tt |ri — r 2 | 

This integral equation analog of the original Schrodinger wave equation is exact. Employ¬ 
ing the Neumann series technique of Section 16.3 (remember, the scattering probability is 
very small), we have 

V r o( r i) = e ,k °' r| , (9.203a) 

which has the physical interpretation of no scattering. 

Substituting i/ r o(i‘ 2 ) = e ,k °' r2 into the integral, we obtain the first correction term, 

, r 2m e ik l r !—r 2 l 

iA 1 (rD = e ,k °- ri - / -jf(r 2 )-—:- -e lk ° T * d 3 r 2 . (9.203b) 

J h~ 4tt |ri — r 2 1 

This is the famous Born approximation. It is expected to be most accurate for weak poten¬ 
tials and high incident energy. If a more accurate approximation is desired, the Neumann 
series may be continued . 30 ■ 


Example 9.7.2 Quantum Mechanical Scattering —Green’s Function 


Again, we consider the Schrodinger wave equation (Eq. (9.198b)) for the scattering prob¬ 
lem. This time we use Fourier transform techniques and derive the desired form of the 
Green’s function by contour integration. Substituting the desired asymptotic form of the 
solution (with k replaced by ko), 

e ik ° r 

f (r) ~ e ,koZ + f kQ (0, <p) -= e' k ° z + 4 (r), (9.204) 

into the Schrodinger wave equation, Eq. (9.198b), yields 

(V 2 + ^)<D(r) = U( r)e ikoz + U( r)O(r). (9.205a) 


Here 

h 2 

— U( r) = V(r), 
2m 


■^°This assumes the Neumann series is convergent. In some physical situations it is not convergent and then other techniques are 
needed. 
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the scattering (perturbing) potential. Since the probability of scattering is much less than 1, 
the second term on the right-hand side of Eq. (9.205a) is expected to be negligible (relative 
to the first term on the right-hand side) and thus we drop it. Note that we are approximat¬ 
ing our differential equation with 

(V 2 + &o)<J>(r) = U(r)e ikoz . (9.205b) 

We now proceed to solve Eq. (9.205b), a nonhomogeneous PDE. The differential oper¬ 
ator V 2 generates a continuous set of eigenfunctions 

vVk(r) = —£V k (r), (9.206) 


where 

V / k(r) = ( 27 rr 3 /V kr . 


These plane-wave eigenfunctions form a continuous but orthonormal set, in the sense that 

J V f k 1 ( r )V f k 2 (r)^ 3 r = 5(ki-k 2 ) 

(compare Eq. (15.21d)). 31 We use these eigenfunctions to derive a Green’s function. 

We expand the unknown function <f>(ri) in these eigenfunctions, 

cb(ri) = jA kl V%(ri)^i, (9.207) 

a Fourier integral with A kl , the unknown coefficients. Substituting Eq. (9.207) into 
Eq. (9.205b) and using Eq. (9.206), we obtain 

J A k {kl - k 2 )\j/ k (r)d 3 k = U(r)e ik ° z . (9.208) 

Using the now-familiar technique of multiplying by (r ) and integrating over the space 

coordinates, we have 


J A k] (kl-k\)d 3 k\ J V/k 2 ( r )V/k| (r) d 3 r — A kl (k$ — k 2 ) 

= J *k 2 (r)U(r)e ikoz d 3 r . (9.209) 

Solving for A k , and substituting into Eq. (9.207) we have 


<*>(r 2 ) = 


^k 2 (r 2 )d i k 2 . (9.210) 


Hence 


= J (kfj-kl) 1 J ^ k 2 (ri)U(ri)e ,koZ1 d 3 n 

®(ri) = j iAk,(ri )(kl-k\)~ l d 3 h j K t ( r 2 )U (r 2 )e ik(>zz d 3 r 2 , (9.211) 


31 cfir = dx dydz, a (three-dimensional) volume element in r-space. 
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replacing k 2 by ki and iq by r 2 to agree with Eq. (9.207). Reversing the order of integra¬ 
tion, we have 


cj>(n) = - J Gic Q (jL[, r 2 )U (r 2 )e ikoZ2 <Pr 2 , 

where Gy (r i, r 2 ), our Green’s function, is given by 

-f 


G ka ( ri,r 2 ) = 


-a k i, 


k 2 -k 2 
K i K o 


(9.212) 


(9.213) 


analogous to Eq. (10.90) of Section 10.5 for discrete eigenfunctions. Equation (9.212) 
should be compared with the Green’s function solution of Poisson’s equation (9.157). 

It is perhaps worth evaluating this integral to emphasize once more the vital role played 
by the boundary conditions. Using the eigenfunctions from Eq. (9.206) and 

dPk — k 2 dk sin 6 dO dcp, 


we obtain 

J /»oo /»7r nln gikpcosO 

G k 0 ( r i,r 2 )= , / / / —--y dcpsinO dd k 2 dk. (9.214) 

(2 ny J o Jo Jo k 2 — k£ 

Here kp cos 6 has replaced k • ( r i — r 2 )- with p — rj — r 2 indicating the polar axis in k- 
space. Integrating over (p by inspection, we pick up a 2jt . The 0 -integration then leads 
to 

\ e ikp _ e ~ikp 

Gio(ri ’ r 2) = 4^1 ~i^r kdk ’ (9 - 215) 

and since the integrand is an even function of k, we may set 

1 f°° (e ilc — e~' K ) 

(92i6> 

The latter step is taken in anticipation of the evaluation of G k (Xi, r 2 ) as a contour integral. 
The symbols k and 0(0 > 0) represent kp and kop, respectively. 

If the integral in Eq. (9.216) is interpreted as a Riemann integral, the integral does not 
exist. This implies that C~ l does not exist, and in a literal sense it does not. C = V 2 + k 2 
is singular since there exist nontrivial solutions 1 // for which the homogeneous equation 
£1 jr — 0. We avoid this problem by introducing a parameter y, defining a different opera¬ 
tor jC~\ and taking the limit as y —> 0. 

Splitting the integral into two parts so that each part may be written as a suitable contour 
integral gives us 


C(r|.r 2 ) 


1 / Ke ,K dK 1 / K e ,K dK 

8jt 2 pi Jc l k 2 — cr 2 ^~ 87r 2 p/ Jc , k 2 — a 2 


(9.217) 


Contour C\ is closed by a semicircle in the upper half-plane, C 2 by a semicircle in 
the lower half-plane. These integrals were evaluated in Chapter 7 by using appropriately 
chosen infinitesimal semicircles to go around the singular points k — ±er. As an alternative 
procedure, let us first displace the singular points from the real axis by replacing cr by 
a + iy and then, after evaluation, taking the limit as y —*■ 0 (Fig. 9.5). 
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Figure 9.5 Possible Green’s 
function contours of integration. 


For y positive, contour C\ encloses the singular point k — cr + iy and the first integral 
contributes 


2jti ■ -e i{a+iy \ 
2 


From the second integral we also obtain 


2ni • - e i(a+i Y\ 
2 


the enclosed singularity being k = — (er + iy). Returning to Eq. (9.217) and letting y —> 0, 
we have 


G(ri,r 2 ) = -— e" 
4yrp 


e i<r 0 |ri-r 2 | 
47T |r i — r 2 f 


(9.218) 


in full agreement with Exercise 9.7.16. This result depends on starting with y positive. Had 
we chosen y negative, our Green’s function would have included e~ la , which corresponds 
to an incoming wave. The choice of positive y is dictated by the boundary conditions we 
wish to satisfy. 

Equations (9.212) and (9.218) reproduce the scattered wave in Eq. (9.203b) and consti¬ 
tute an exact solution of the approximate Eq. (9.205b). Exercises 9.7.18 and 9.7.20 extend 
these results. ■ 
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Exercises 

9.7.1 

9.7.2 


9.7.3 


9.7.4 


9.7.5 


Verify Eq. (9.168), 


/< 


-/ 


(vC2U — uCiV) dl2 = I piv^ 2U — u\ 2V) ' dV2- 


Show that the terms +£ 2 in the Helmholtz operator and —A: 2 in the modified Helmholtz 
operator do not affect the behavior of G(ri, r 2 ) in the immediate vicinity of the singular 
point ri = r 2 . Specifically, show that 


lim 

|ri—r 2 |- 


J 


k z G(ri, r 2 )dr 2 = 1. 


Show that 


exp(fA-|ri — r 2 |) 

4jr|ri — r 2 | 

satisfies the two appropriate criteria and therefore is a Green’s function for the 
Helmholtz equation. 

(a) Find the Green’s function for the three-dimensional Helmholtz equation. Exer¬ 
cise 9.7.3, when the wave is a standing wave. 

(b) How is this Green’s function related to the spherical Bessel functions? 

The homogeneous Helmholtz equation 

V 2 <p + X 2 cp — 0 

has eigenvalues Xj and eigenfunctions (pi. Show that the corresponding Green’s function 
that satisfies 


V 2 G( ri , r 2 ) + X 2 G(r u r 2 ) = -S (n - r 2 ) 


may be written as 


G(ri,r 2 ) = ^ 


<Pi(Xl)<Pi(*2) 
Xr — X 2 


i =1 

An expansion of this form is called a bilinear expansion. If the Green’s function is 
available in closed form, this provides a means of generating functions. 

9.7.6 An electrostatic potential (mks units) is 

7 e ~ ar 

<P( r) = 


47T£o 


Reconstruct the electrical charge distribution that will produce this potential. Note that 
q>(r) vanishes exponentially for large r, showing that the net charge is zero. 

Za 2 e~ ar 


ANS. p(r) = ZS(r) - 


471 r 
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9.7.7 Transform the ODE 

d 2 y(r ) 2 e~ r 

-jY - k 2 y{r) + Vo-y(r) = 0 

dr z r 

and the boundary conditions y(0) = y( oo) = 0 into a Fredholm integral equation of the 
form 

foo e -t 

y(r)=X\ G(r,t) - y(t)dt. 

Jo t 

The quantities Vq — X and k 2 are constants. The ODE is derived from the Schrodinger 
wave equation with a mesonic potential: 


G(r, t) = 


e kt sinhkr, 0 <r <t. 


-e kr sinh kt, t<r< oo. 


9.7.8 A charged conducting ring of radius a (Example 12.3.3) may be described by 

P (r) = ^r~ 2 S(r ~ «)^( cos0 )- 

Using the known Green’s function for this system, Eq. (9.187) find the electrostatic 
potential. 

Hint. Exercise 12.6.3 will be helpful. 

9.7.9 Changing a separation constant from k 2 to —k 2 and putting the discontinuity of the first 
derivative into the "-dependence, show that 


00 POO 

T / e im ^-^J m (k Pl )J m (kp2)e 
o 


—*|zi—Z2l , 


47 r|n-r 2 | ^ Jo 

Hint. The required b(f>\ — pi) may be obtained from Exercise 15.1.2. 

9.7.10 Derive the expansion 

exp[«jfc|n - r 2 |] ~ Mkn W^ikn), n < r 2 

- = ik ) 

47 r|ri — r 2 | f-f ... .,( 1 )., , 

1=0 Jl(kr 2 )h, '(kn), r\>r 2 


x Yr(.9i,n)Yr(e 2 ,<p 2 ). 


Hint. The left side is a known Green’s function. Assume a spherical harmonic expansion 
and work on the remaining radial dependence. The spherical harmonic closure relation. 
Exercise 12.6.6, covers the angular dependence. 

9.7.11 Show that the modified Helmholtz operator Green’s function 

exp(—fc|ri - r 2 |) 

4zr|r! -r 2 | 
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9.7.12 


9.7.13 


9.7.14 


9.7.15 


has the spherical polar coordinate expansion 


exp(— £|ri — r 2 |) 
47r |ri - r 2 | 


OO / 

kJ2'l(kr<)k,(k r> ) J2 Yj n (6 l , ( p l )Y; n *(e 2 ,V2)- 

1=0 m=—l 


Note. The modified spherical Bessel functions ij(kr ) and kj(kr) are defined in Exer¬ 
cise 11.7.15. 


From the spherical Green’s function of Exercise 9.7.10, derive the plane-wave expan¬ 
sion 

OO 

e' kr = ^2 il (2l + l)j,(kr)P,(cosy), 

1=0 

where y is the angle included between k and r. This is the Rayleigh equation of Exer¬ 
cise 12.4.7. 

Hint. Take r 2 S> r i so that 

k ri 

In - r 2 | -> r 2 - r 20 • ri = r 2 - - — . 

k 

Let r 2 -> oo and cancel a factor of e lkri /r 2 . 


From the results of Exercises 9.7.10 and 9.7.12, show that 


e ix = J2'‘( 2l +l )M*)- 

1=0 


(a) From the circular cylindrical coordinate expansion of the Laplace Green’s function 
(Eq. (9.197)), show that 


1 


(p 2 + z 2 ) 1 / 2 


= -f 

tr Jo 


— / Ko(kp) cos kzdk. 


This same result is obtained directly in Exercise 15.3.11. 
(b) As a special case of part (a) show that 


f 


Ko(k)dk — —. 


Noting that 


is an eigenfunction of 


r) = 


Jk r 


(27 T ) 3 / 2 


(V 2 + k 2 )i/s k (r) — 0 

(Eq. (9.206)), show that the Green’s function of C — V 2 may be expanded as 


1 


47T |ri — r 2 | (2 tt) 


— [ e * 

7T) 3 J 


(ri-r 2 ) 


d 5 k 
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9.7.16 


9.7.17 


9.7.18 


9.7.19 


9.7.20 


Using Fourier transforms, show that the Green’s function satisfying the nonhomoge- 
neous Helmholtz equation 

(V 2 +£2)G(n,r 2 ) = —5(n-r 2 ) 


is 


G(ri,r 2 ) 


in agreement with Eq. (9.213). 


1 f e ' k fr i-r 2 ) 

= (2 p-q d k 


The basic equation of the scalar Kirchhoff diffraction theory is 


^(ri) = 


1 

47T 



Vi/Ur 2 ) - ijr( r 2 )V 



• da 2 , 


where i// satisfies the homogeneous Helmholtz equation and r — rj — r 2 |. Derive this 
equation. Assume that ri is interior to the closed surface .S' 2 . 

Hint. Use Green’s theorem. 


The Born approximation for the scattered wave is given by Eq. (9.203b) (and 
Eq. (9.211)). From the asymptotic form, Eq. (9.199), 


e ikr 2m 

fk(0,<p) - = -~2 

r h 


I 


V (r 2 ) 


g (T|r-r 2 | 
4jr|r - r 2 | 


o /k 0 r 2 j3 


d r 2 . 


For a scattering potential V (r 2 ) that is independent of angles and for r >> r 2 , show that 


2m f 

fk(e,<p) = —- Y / 

h~ Jo 


T/ , sin(|k 0 — k|r 2 ) 
riV (r 2 ) ---—- dr 2 . 

k 0 - k 


Here ko is in the 9—0 (original "-axis) direction, whereas k is in the (9, <p) direction. 
The magnitudes are equal: |ko| = |k|; m is the reduced mass. 

Hint. You have Exercise 9.7.12 to simplify the exponential and Exercise 15.3.20 to 
transform the three-dimensional Fourier exponential transform into a one-dimensional 
Fourier sine transform. 


Calculate the scattering amplitude fk(9, tp) for a mesonic potential V(r) = Vo(e~ ar /ar). 
Hint. This particular potential permits the Born integral. Exercise 9.7.18, to be evaluated 
as a Laplace transform. 


ANS .f k (9,<p) = - 


2m Vo 1 

h 2 a a 2 + (ko — k ) 2 


The mesonic potential V ( r ) = Vo(e~ ar /ar) may be used to describe the Coulomb scat¬ 
tering of two charges <71 and q 2 . We let a -» 0 and Vo —> 0 but take the ratio Vo/a to 
be qiq 2 /4jtso. (For Gaussian units omit the 47 T£o-) Show that the differential scattering 
cross section da/d£i — \fk(9 , (p )| 2 is given by 

da / <7 i<7 2 \ 2 1 p 2 frk 2 

d£l \47T£oJ 16£ 2 sin 4 ( 0 / 2 ) ’ 2m 2m 

It happens (coincidentally) that this Born approximation is in exact agreement with both 
the exact quantum mechanical calculations and the classical Rutherford calculation. 
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9.8 Heat Flow, or Diffusion, PDE 


Here we return to a special PDE to develop fairly general methods to adapt a special solu¬ 
tion of a PDE to boundary conditions by introducing parameters that apply to other second- 
order PDEs with constant coefficients as well. To some extent, they are complementary to 
the earlier basic separation method for finding solutions in a systematic way. 

We select the full time-dependent diffusion PDE for an isotropic medium. Assuming 
isotropy actually is not much of a restriction because, in case we have different (constant) 
rates of diffusion in different directions, for example in wood, our heat flow PDE takes the 
form 


3 x/r 


3 2 xft 


dx 2 


+ b 


3 y 2 


+ c 


d 2 - 

3 z 2 ’ 


2 u ’A 


(9.219) 


if we put the coordinate axes along the principal directions of anisotropy. Now we sim¬ 
ply rescale the coordinates using the substitutions x = aft, y — hi], z — eft to get back the 
original isotropic form of Eq. (9.219), 


3$ _ 3 2 cp g 2 0 3 2 <J> 

~dt~ ~ Jft 2 + Ihj 2 + Jft 2 


(9.220) 


for the temperature distribution function <t>(§, rj, ft, t) = \[r(x, y, z, t). 

For simplicity, we first solve the time-dependent PDE for a homogeneous one¬ 
dimensional medium, a long metal rod in the x -direction, say. 


dift ->3 2 i ft 

3 1 3x 2 ’ 


(9.221) 


where the constant a measures the diffusivity, or heat conductivity, of the medium. We 
attempt to solve this linear PDE with constant coefficients with the relevant exponential 
product Ansatz i Jr = e“ x ■ e^', which, when substituted into Eq. (9.221), solves the PDE 
with the constraint j J > = a 2 a 2 for the parameters. We seek exponentially decaying solutions 
for large times, that is, solutions with negative ft values, and therefore set a — ito, a 2 — 
—or for real a> and have 


\l/(x,t) = e l0>x e 0,2a2> = (cos&jx + i sin o)X)e 


Forming real linear combinations we obtain the solution 

2 2 

i/r(x, t) — {A cos, cox + B s,\na>x)e~ w a ' 


for any choice of A, B,co, which are introduced to satisfy boundary conditions. Upon sum¬ 
ming over multiples nco of the basic frequency for periodic boundary conditions or inte¬ 
grating over the parameter co for general (nonperiodic boundary conditions), we find a 
solution, 

i/f(x,r) = J\A(co) cos cox + B(co) sin (ox]e~ a M ‘ dco, (9.222) 

that is general enough to be adapted to boundary conditions at t = 0, say. When the bound¬ 
ary condition gives a nonzero temperature as for our rod, then the summation method 
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applies (Fourier expansion of the boundary condition). If the space is unrestricted (as for 
an infinitely extended rod), the Fourier integral applies. 

• This summation or integration over parameters is one of the standard methods for gen¬ 
eralizing specific PDE solutions in order to adapt them to boundary conditions. 


Example 9.8.1 A Specific Boundary Condition 


Let us solve a one-dimensional case explicitly, where the temperature at time t — 0 is 
t//() (x ) = 1 = const, in the interval between x = +1 and x = — 1 and zero for x > I and 
x < 1. At the ends, x = ±1, the temperature is always held at zero. 

For a finite interval we choose the cosUnx /2) spatial solutions of Eq. (9.221) for integer 
/, because they vanish at x = ±1. Thus, at t — 0 our solution is a Fourier series. 


i//(x, 0) 


OO 




Ttlx 
COS - 


2 


1 , 


— 1 < x < 1 


with coefficients (see Section 14.1.) 


-jC 


Ttlx 2 Ttlx 

ai — I 1 • cos-= — sin- 

' 2 In 2 


,T=— 1 


4 In 4(—l) m 

= — sin — =-, 

Ttl 2 (2m + l)n 

a\ — 0, l — 2m. 


I — 2m + 1 ; 


Including its time dependence, the full solution is given by the series 

-t((2m+V)na/2) 2 


4 vA (-1)'" 

l lr(x, t) — — > -COS 

Tt ^ 2m + 1 
m =0 


TtX 

(2m + 1 ) — 


(9.223) 


which converges absolutely for t > 0 but only conditionally at t = 0 , as a result of the 
discontinuity at x = ± 1 . 

Without the restriction to zero temperature at the endpoints of the given finite interval, 
the Fourier series is replaced by a Fourier integral. The general solution is then given by 
Eq. (9.222). At t — 0 the given temperature distribution tJ/q = l gives the coefficients as 
(see Section 15.3) 


Therefore 


1 

[ 1 

1 

sin cox 

— 

/ cos cox dx 

= - 


7t „ 

1 -1 

71 

CO 


2 

roo 

sin co 


i lr(x,t) — — 

/ 

-c 


Tt 

Jo 

CO 


X —— 1 


2 sin cu 


7T ft) 


B(co) = 0. 


doo. 


(9.224) 


In three dimensions the corresponding exponential Ansatz i jf = e ' k r / a +pr ] eac j s to a 
solution with the relation fl = — k 2 = — k 2 for its parameter, and the three-dimensional 



9.8 Heat Flow, or Diffusion, PDE 


613 


form of Eq. (9.221) becomes 


3 2 tZr d~\lr d 2 \[r ? 

3 ^ + 3 ^ + 3 ^ + ^ = °’ 


(9.225) 


which is the Helmholtz equation, which may be solved by the separation method just 
like the earlier Laplace equation in Cartesian, cylindrical, or spherical coordinates under 
appropriately generalized boundary conditions. 

In Cartesian coordinates, with the product Ansatz of Eq. (9.35), the separated x- and y- 
ODEs from Eq. (9.221) are the same as Eqs. (9.38) and (9.41), while the z-ODE, Eq. (9.42), 
generalizes to 


1 d 2 Z 
Z~d ? 


—k 2 + I 2 + m 2 — n 2 > 0, 


(9.226) 


where we introduce another separation constant, n 2 , constrained by 

k 2 = l 2 + m 2 — n 2 


(9.227) 


to produce a symmetric set of equations. Now, our solution of Helmholtz’s Eq. (9.225) 
is labeled according to the choice of all three separation constants l,m,n subject to the 
constraint Eq. (9.227). As before the z-ODE, Eq. (9.226), yields exponentially decaying 
solutions ~ e~ nz . The boundary condition at z = 0 fixes the expansion coefficients ai m , as 
in Eq. (9.44). 

In cylindrical coordinates, we now use the separation constant / 2 for the z-ODE, with an 
exponentially decaying solution in mind. 


d 2 Z 

dz 2 


= 1 2 Z> 0, 


(9.228) 


so Z ~ e~ tz , because the temperature goes to zero at large z. If we set k 2 + l 2 = n 2 , 
Eqs. (9.53) to (9.54) stay the same, so we end up with the same Fourier-Bessel expansion, 
Eq. (9.56), as before. 

In spherical coordinates with radial boundary conditions, the separation method leads to 
the same angular ODEs in Eqs. (9.61) and (9.64), and the radial ODE now becomes 


1 d / 2 ^\ 
r 2 dr \ dr ) 


+ k 2 



Q = /(/ + !), 


(9.229) 


that is, of Eq. (9.65), whose solutions are the spherical Bessel functions of Section 11.7. 
They are listed in Table 9.2. 

The restriction that k 2 be a constant is unnecessarily severe. The separation process will 
still work with Helmholtz’s PDE for k 2 as general as 

k 2 = f{r) + 4 8(0) + + k' 2 . (9.230) 

r~ r 1 sin 6 

In the hydrogen atom we have k 2 — f ( r ) in the Schrodinger wave equation, and this leads 
to a closed-form solution involving Laguerre polynomials. 
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Alternate Solutions 


In a new approach to the heat flow PDE suggested by experiments, we now return 
to the one-dimensional PDE, Eq. (9.221), seeking solutions of a new functional form 
i fr(x, t ) = u(xI\[t ), which is suggested by Example 15.1.1. Substituting u(f), £ = x/^/t, 
into Eq. (9.221) using 

dif _ u' 3 2 iA _ u" 9l/ r _ x , 

dx ~ VT dx 2 ~ t ’ dt ~ 2 V^ U ; 

with the notation w'(£) = ^|, the PDE is reduced to the ODE 

2aV(£) + £w'(£) = 0. (9.232) 



where <l> denotes Gauss’ error function (see Exercise 5.10.4). See Example 15.1.1 for a 
derivation using a Fourier transform. We need to generalize this specific solution to adapt 
it to boundary conditions. 

To this end we now generate new solutions of the PDE with constant coefficients 
by differentiating a special solution, Eq. (9.234). In other words, if if(x,t) solves the 
PDE in Eq. (9.221), so do ^ and because these derivatives and the differentiations 
of the PDE commute; that is, the order in which they are carried out does not matter. Note 
carefully that this method no longer works if any coefficient of the PDE depends on t 
or x explicitly. However, PDEs with constant coefficients dominate in physics. Examples 
are Newton’s equations of motion (ODEs) in classical mechanics, the wave equations of 
electrodynamics, and Poisson’s and Laplace’s equations in electrostatics and gravity. Even 
Einstein’s nonlinear field equations of general relativity take on this special form in local 
geodesic coordinates. 

Therefore, by differentiating Eq. (9.234) with respect to x, we find the simpler, more 
basic solution 


\/f\(x,t)= — i=e 4fl2 ', 

Cly/tTC 


(9.235) 
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and, repeating the process, another basic solution. 


i r i(x,t)= - -- e *a 2 ‘. (9.236) 

2a 3 Vf 3 7r 

Again, these solutions have to be generalized to adapt them to boundary conditions. And 
there is yet another method of generating new solutions of a PDE with constant coeffi¬ 
cients: We can translate a given solution, for example, i//r(x, t) —>■ ij/\ (x — a, t), and then 

integrate over the translation parameter a. Therefore 

1 r°° (x-a) 2 

f(x,t) = -— / C(a)e W-doc (9.237) 

2 d\Jtiz J —oo 

is again a solution, which we rewrite using the substitution 

X — (X 

f =a — x—2 da ——2a d% \Tt ■ (9.238) 

2 ajt 

Thus, we find that 

If 00 2 

1 Hx,t)=— C(x-2a^Vt)e~^ dt; (9.239) 

j — OO 


is a solution of our PDE. In this form we recognize the significance of the weight function 
C(x) from the translation method because, at t — 0, i//(x, 0) = C(x) = iro(x) is deter¬ 
mined by the boundary condition, and e~^~d% — *Jjt. Therefore, we can also write 
the solution as 

1 r°° 2 

xls(x,t)=— ir 0 (x-2a%sTt)e- % d%, (9.240) 

J —oo 

displaying the role of the boundary condition explicitly. From Eq. (9.240) we see that 
the initial temperature distribution, i/o(x), spreads out over time and is damped by the 
Gaussian weight function. 


Example 9.8.2 Special Boundary Condition Again 


Let us express the solution of Example 9.8.1 in terms of the error function solution of 
Eq. (9.234). The boundary condition at t — 0 is i//q(x) — 1 for — 1 < x < 1 and zero 
for |x| > 1. From Eq. (9.240) we find the limits on the integration variable £ by setting 
x — 2af s/t — ±1. This yields the integration endpoints £ = (±1 + x)/2ax/t. Therefore 
our solution becomes 


ir(x, t) — 


1 

yfn 



t 2 

d$. 


Using the error function defined in Eq. (9.234) we can also write this solution as follows 


ijs(x, t) — 


1 

2 



x + 1\ 

2aV~t) 



(9.241) 
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Comparing this form of our solution with that from Example 9.8.1 we see that we can 
express Eq. (9.241) as the Fourier integral of Example 9.8.1, an identity that gives the 
Fourier integral, Eq. (9.224), in closed form of the tabulated error function. ■ 


Finally, we consider the heat flow case for an extended spherically symmetric medium 
centered at the origin, which prescribes polar coordinates r,0,ip. We expect a solution of 
the form \[r( r, t) — u(r , t). Using Eq. (2.48) we find the PDE 


du 1 /d 2 u 2 3 u\ 
3 1 \ dr 2 r dr ) 


(9.242) 


which we transform to the one-dimensional heat flow PDE by the substitution 


v(r, t) 

du 

1 8v 

V 

du 

i dv 

r 

dr 

r dr 

r 2 ’ 

~dr ~ 

r 3 1 ' 


d 2 u 

1 d 2 v 

2 dv 

2v 



dr 2 

r dr 2 

y.2 fiy 

H — r- 

r 3 



This yields the PDE 

dv 2 3 2 u 
— = a ~— « . 
3 1 dr 2 


(9.243) 


(9.244) 


Example 9.8.3 Spherically Symmetric Heat Flow 


Let us apply the one-dimensional heat flow PDE with the solution Eq. (9.234) to a spheri¬ 
cally symmetric heat flow under fairly common boundary conditions, where x is released 
by the radial variable. Initially we have zero temperature everywhere. Then, at time t — 0, 
a finite amount of heat energy Q is released at the origin, spreading evenly in all directions. 
What is the resulting spatial and temporal temperature distribution? 

Inspecting our special solution in Eq. (9.236) we see that, for t —> 0, the temperature 

v(r, t) C _j£_ 

— — = — e 4aL (9.245) 

r Vf 3 

goes to zero for all r ^ 0, so zero initial temperature is guaranteed. As t -¥ oo, the temper¬ 
ature v/r -* 0 for all r including the origin, which is implicit in our boundary conditions. 
The constant C can be determined from energy conservation, which gives the constraint 

Q — a p f -d 3 r = - f r 2 e 4aL dr = apa 3 C, (9.246) 

J r Vr 3 Jo 

where p is the constant density of the medium and er is its specific heat. Here we have 
rescaled the integration variable and integrated by parts to get 


pOO r 2 pC 

/ e 4a 2 t r 2 dr = (2aVt) 3 
Jo Jo 

r 

Jo 






h I OO 

2 


r * 

/ e~t d% = 
Jo 


~ 4 ~ 


o 
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The temperature, as given by Eq. (9.245) at any moment, which is at fixed t, is a Gaussian 
distribution that flattens out as time increases, because its width is proportional to ~Jt. As 
a function of time the temperature is proportional to f -3 / 2 e -r / r , with T = r 2 /Aa 2 , which 
rises from zero to a maximum and then falls off to zero again for large times. To find the 
maximum, we set 

j t (r- 3 /V^) = r 5 / 2 e- T " (1 - 0 = 0, (9.247) 

from which we find t = 2T /3. ■ 


In the case of cylindrical symmetry (in the plane z — 0 in plane polar coordinates 
p — jx 2 + y 2 , <p) we look for a temperature i Jr — u(p, t ) that then satisfies the ODE (using 
Eq. (2.35) in the diffusion equation) 


du 2 ( 9 2 « 1 du\ 
dt \3p 2 P dp) ’ 


(9.248) 


which is the planar analog of Eq. (9.244). This ODE also has solutions with the functional 
dependence p/\ft = r. Upon substituting 


= V (t7 


dll 

37 


p v 

' 27372 ’ 


du 


3 2 u v' 


— = -f, = - (9-249) 


dp sft 


dp 


into Eq. (9.248) with the notation v' = we find the ODE 

fl v + | - + -V' = 0. 

r 2 


(9.250) 


This is a first-order ODE for v', which we can integrate when we separate the variables v 
and r as 


v 


n 


v' 



+ 



(9.251) 


This yields 


C -iL v7 --fii. 
v{r)=—e 4 a 2 — C—e *a 2 t . 
r p 


(9.252) 


This special solution for cylindrical symmetry can be similarly generalized and adapted to 
boundary conditions, as for the spherical case. Finally, the ^-dependence can be factored 
in, because z separates from the plane polar radial variable p. 


In summary, PDEs can be solved with initial conditions, just like ODEs, or with bound¬ 
ary conditions prescribing the value of the solution or its derivative on boundary surfaces, 
curves, or points. When the solution is prescribed on the boundary, the PDE is called a 
Dirichlet problem ; if the normal derivative of the solution is prescribed on the boundary, 
the PDE is called a Neumann problem. 

When the initial temperature is prescribed for the one-dimensional or three-dimensional 
heat equation (with spherical or cylindrical symmetry) it becomes a weight function of the 
solution, in terms of an integral over the generic Gaussian solution. The three-dimensional 
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heat equation, with spherical or cylindrical boundary conditions, is solved by separation 
of the variables, leading to eigenfunctions in each separated variable and eigenvalues as 
separation constants. For finite boundary intervals in each spatial coordinate, the sum over 
separation constants leads to a Fourier-series solution, while infinite boundary conditions 
lead to a Fourier-integral solution. The separation of variables method attempts to solve 
a PDF by writing the solution as a product of functions of one variable each. General 
conditions for the separation method to work are provided by the symmetry properties of 
the PDF, to which continuous group theory applies. 

Additional Readings 


Bateman, H., Partial Differential Equations of Mathematical Physics. New York: Dover (1944), 1st ed. (1932). 
A wealth of applications of various partial differential equations in classical physics. Excellent examples of 
the use of different coordinate systems — ellipsoidal, paraboloidal, toroidal coordinates, and so on. 

Cohen, H., Mathematics for Scientists and Engineers. Englewood Cliffs, NJ: Prentice-Hall (1992). 

Courant, R., and D. Hilbert, Methods of Mathematical Physics, Vol. 1 (English edition). New York: Interscience 
(1953), Wiley (1989). This is one of the classic works of mathematical physics. Originally published in Ger¬ 
man in 1924, the revised English edition is an excellent reference for a rigorous treatment of Green’s functions 
and for a wide variety of other topics on mathematical physics. 

Davis, P. J., and P. Rabinowitz, Numerical Integration. Waltham, MA: Blaisdell (1967). This book covers a great 
deal of material in a relatively easy-to-read form. Appendix 1 (On the Practical Evaluation of Integrals by 
M. Abramowitz) is excellent as an overall view. 

Garcia, A. L., Numerical Methods for Physics. Englewood Cliffs, NJ: Prentice-Hall (1994). 

Hamming, R. W., Numerical Methods for Scientists and Engineers, 2nd ed. New York: McGraw-Hill (1973), 
reprinted Dover (1987). This well-written text discusses a wide variety of numerical methods from zeros of 
functions to the fast Fourier transform. All topics are selected and developed with a modern computer in mind. 

Hubbard, J., and B. H. West, Differential Equations. Berlin: Springer (1995). 

Ince, E. L., Ordinary Differential Equations. New York: Dover (1956). The classic work in the theory of ordinary 
differential equations. 

Lapidus, L., and J. H. Seinfeld, Numerical Solutions of Ordinary Differential Equations. New York: Academic 
Press (1971). A detailed and comprehensive discussion of numerical techniques, with emphasis on the Runge- 
Kutta and predictor-corrector methods. Recent work on the improvement of characteristics such as stability is 
clearly presented. 

Margenau, H., and G. M. Murhpy, The Mathematics of Physics and Chemistry, 2nd ed. Princeton, NJ: Van Nos¬ 
trand (1956). Chapter 5 covers curvilinear coordinates and 13 specific coordinate systems. 

Miller, R. K., and A.N. Michel, Ordinary Differential Equations. New York: Academic Press (1982). 

Morse, P. M., and H. Feshbach, Methods of Theoretical Physics. New York: McGraw-Hill (1953). Chapter 5 
includes a description of several different coordinate systems. Note that Morse and Feshbach are not above 
using left-handed coordinate systems even for Cartesian coordinates. Elsewhere in this excellent (and difficult) 
book are many examples of the use of the various coordinate systems in solving physical problems. Chapter 7 
is a particularly detailed, complete discussion of Green’s functions from the point of view of mathematical 
physics. Note, however, that Morse and Feshbach frequently choose a source of 4n8 (r — r r ) in place of our 
<5(r — r'). Considerable attention is devoted to bounded regions. 

Murphy, G. M., Ordinary Differential Equations and Their Solutions. Princeton, NJ: Van Nostrand (1960). A thor¬ 
ough, relatively readable treatment of ordinary differential equations, both linear and nonlinear. 

Press, W. H., B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, Numerical Recipes, 2nd ed. Cambridge, UK: 
Cambridge University Press (1992). 

Ralston, A., and H. Wilf, eds.. Mathematical Methods for Digital Computers. New York: Wiley (1960). 
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Ritger, P. D., and N. J. Rose, Differential Equations with Applications. New York: McGraw-Hill (1968). 
Stakgold, I., Green’s Functions and Boundary Value Problems, 2nd ed. New York: Wiley (1997). 

Stoer, J., and R. Burlirsch, Introduction to Numerical Analysis. New York: Springer-Verlag (1992). 

Stroud, A. H., Numerical Quadrature and Solution of Ordinary Differential Equations, Applied Mathematics 
Series, Vol. 10. New York: Springer-Verlag (1974). A balanced, readable, and very helpful discussion of var¬ 
ious methods of integrating differential equations. Stroud is familiar with the work in this field and provides 
numerous references. 
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Chapter 10 


Sturm-Liouville 
Theory—Orthogonal 
Functions 


In the preceding chapter we developed two linearly independent solutions of the second- 
order linear homogeneous differential equation and proved that no third, linearly inde¬ 
pendent solution existed. In this chapter the emphasis shifts from solving the differential 
equation to developing and understanding general properties of the solutions. There is a 
close analogy between the concepts in this chapter and those of linear algebra in Chap¬ 
ter 3. Functions here play the role of vectors there, and linear operators that of matri¬ 
ces in Chapter 3. The diagonalization of a real symmetric matrix in Chapter 3 corre¬ 
sponds here to the solution of an ODE defined by a self-adjoint operator C in terms 
of its eigenfunctions, which are the “continuous” analog of the eigenvectors in Chap¬ 
ter 3. Examples for the corresponding analogy between Hermitian matrices and Her- 
mitian operators are Hamiltonians in quantum mechanics and their energy eigenfunc¬ 
tions. 

In Section 10.1 the concepts of self-adjoint operator, eigenfunction, eigenvalue, and Her¬ 
mitian operator are presented. The concept of adjoint operator, given first in terms of dif¬ 
ferential equations, is then redefined in accordance with usage in quantum mechanics, 
where eigenfunctions take complex values. The vital properties of reality of eigenvalues 
and orthogonality of eigenfunctions are derived in Section 10.2. In Section 10.3 we dis¬ 
cuss the Gram-Schmidt procedure for systematically constructuring sets of orthogonal 
functions. Finally, the general property of the completeness of a set of eigenfunctions is 
explored in Section 10.4, and Green’s functions from Chapter 9 are continued in Sec¬ 
tion 10.5. 
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10.1 Self-Adjoint ODEs 


In Chapter 9 we studied, classified, and solved linear, second-order ODEs corresponding 
to linear, second-order differential operators of the general form 


Cu(x) — po(x)—^u(x) + Pi(x) — u(x) + P 2 (x)u(x). (10.1) 

clx A ax 

The coefficients p${x), p\{x), and pj(x) are real functions of x, and over the region 
of interest, a < x < b, the first 2 — i derivatives of pi(x) are continuous. Reference to 
Eq. (9.118) shows that P(x) — pi(x)/po(x) and Q(x) — p 2 (x)/po(x). Hence, po(x) must 
not vanish for a < x < b. Now, the zeros of po(x) are singular points (Section 9.4), and 
the preceding statement means that our interval [a, b ] must be given so that there are no 
singular points in the interior of the interval. There may be and often are singular points on 
the boundaries. 

For a linear operator C, the analog of a quadratic form for a matrix in Chapter 3 is the 
integral 

f b 

(u\C\u) = (u\Cu) = / u(x)Cu(x)dx 

J a 
b 

u{pou" + p\u + p 2 u}dx, (10.2) 

where the primes on the real function u(x) denote derivatives, as usual, and, for simplicity, 
u{x) is taken to be real. If we shift the derivatives to the first factor, u, in Eq. (10.2) by 
integrating by parts once or twice, we are led to the equivalent expression. 



(u\C\u) = \ii(x)(p\ - p' 0 )u(x)] b x=a 


f 


dx 2 


[pou] 


dx 


[pin] + P 2 U \udx. 


(10.3) 


If we require that the integrals in Eqs. (10.2) and (10.3) be identical for all (twice differ¬ 
entiable) functions u, then the integrands have to be equal. The comparison then yields 


u(p” ) - p\ )u +2 u(pq - p\)u' = 0, 


or 


Po(x) = pi(x), (10.4) 

and, as a bonus, the terms at the boundaries x = a and x = b in Eq. (10.3) then also vanish. 

Because of the analogy with the transposed matrix in Chapter 3, it is convenient to define 
the linear operator in Eq. (10.3), 



10.1 Self-Adjoint ODEs 


623 


as the adjoint 1 operator £. We have defined the adjoint operator £ and have shown that if 
Eq. (10.4) is satisfied, (Cu\u) = (u\Cu). Following the same procedure we can show more 
generally that (v\Cu) = (Cv\u). When this condition is satisfied. 


- d 

du(x) 


Lu — Lu — —— 
dx 

P(x) 

dx 

+ q(x)u(x ), 





( 10 . 6 ) 


the operator £ is said to be self-adjoint. Here, for the self-adjoint case, po(x) is replaced 
by p(x) and pi(x ) by q(x) to avoid unnecessary subscripts. The form of Eq. (10.6) al¬ 
lows carrying out two integrations by parts in Eq. (10.3) (and Eq. (10.22) and following) 
without integrated terms. 2 Note that a given operator is not inherently self-adjoint; its self¬ 
adjointness depends on the properties of the function space in which it acts and on the 
boundary conditions. 

In a survey of the ODEs introduced in Section 9.3, Legendre’s equation and the linear 
oscillator equation are self-adjoint, but others, such as the Laguerre and Hermite equations, 
are not. However, the theory of linear, second-order, self-adjoint differential equations is 
perfectly general because we can always transform the non-self-adjoint operator into the 
required self-adjoint form. Consider Eq. (10.1) with p ' 0 ^ p\. If we multiply £ by 3 


1 

Po(x) 



Pi (O' 

-’ 

Po(t) 


we obtain 


Po(x) 


exp 


r 


pi (0 


dt 


Po(t) J 


jZu(x) — — 
dx 


exp 


7 


pdt) 

po(t)' 


dt 


du(x) ] 


dx 


P2(x) 

Po(x) 


exp 


7 


Pl(t) 

Po(t)~ J 


dt 


I 


u, 


(10.7) 


which is clearly self-adjoint (see Eq. (10.6)). Notice the po(x) in the denominator. This is 
why we require po(x) / 0, a < x < b. In the following development we assume that C has 
been put into self-adjoint form. 


*The adjoint operator bears a somewhat forced relationship to the adjoint matrix. A better justification for the nomenclature 
is found in a comparison of the self-adjoint operator (plus appropriate boundary conditions) with the self-adjoint matrix. The 
significant properties are developed in Section 10.2. Because of these properties, we are interested in self-adjoint operators. 
2 The full importance of the self-adjoint form (plus boundary conditions) will become apparent in Section 10.2. In addition, 
self-adjoint forms will be required for developing Green’s functions in Section 10.5. 

3 If we multiply £ by f(x)/po(x) and then demand that 


f\x) = 


fP\ 
P0 ’ 


so that the new operator will be self-adjoint, we obtain 
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Eigenfunctions, Eigenvalues 


Schrodinger’s wave equation 


H\j/(x) — E\l/(x) 

is the major example of an eigenvalue equation in physics; here the differential operator 
C is defined by the Hamiltonian H and may no longer be real, and the eigenvalue be¬ 
comes the total energy E of the system. The eigenfunction \jr(x) may be complex and is 
usually called a wave function. A variational formulation of this Schrodinger equation 
appears in Section 17.7. Based on spherical, cylindrical, or some other symmetry prop¬ 
erties, a three- or four-dimensional PDE or eigenvalue equation such as the Schrodinger 
equation may separate into eigenvalue equations in a single variable each. Examples are 
Eqs. (9.41), (9.42), (9.50), and (9.53). However, sometimes an eigenvalue equation takes 
the more general self-adjoint form 

Cu(x) + Xw(x)u(x) — 0, (10.8) 

where the constant X is the eigenvalue 4 and w(x) is a known weight or density func¬ 
tion; w(x ) > 0 except possibly at isolated points at which w(x) — 0. (In Section 10.1, 
w(x) = 1.) For a given choice of the parameter X, a function u,(x), which satisfies 
Eq. (10.8) and the imposed boundary conditions, is called an eigenfunction correspond¬ 
ing to X. The constant X is then called an eigenvalue by mathematicians. There is no guar¬ 
antee that an eigenfunction ux(x) will exist for an arbitrary choice of the parameter X. 
Indeed, the requirement that there be an eigenfunction often restricts the acceptable values 
of X to a discrete set. Examples of this for the Legendre, Hermite, and Chebyshev equa¬ 
tions appear in the exercises of Section 9.5. Here we have the mathematical approach to 
the process of quantization in quantum mechanics. 

The inner product of two functions, {v\u} — f b v*(x)w(x)u(x) dx, depends on the 
weight function and generalizes our previous definition, where w(x) = 1. The weight 
function also modifies the definition of orthogonality of two eigenfunctions: They are 
orthogonal if their inner product (uy\i<x) = 0. The extra weight function w(x) appears 
sometimes as an asymptotic wave function \l/oc that is a common factor in all solutions 
of a PDE such as the Schrodinger equation, for example, when the potential V (.r) -* 0 as 
x —> oo in H — T + V. We can find i//-*, when we set V = 0 in the Schrodinger equa¬ 
tion. Another source for w(x) may be a nonzero angular momentum barrier /(/ + I )/x 2 
in a PDE or separated ODE Eq. (9.65) that has a regular singularity and dominates at 
x —> 0. In such a case the indicial equation, such as Eq. (9.87) or (9.103), shows that 
the wave function has x 1 as an overall factor. Since the wave function enters twice in 
matrix elements and orthogonality relations, the weight functions in Table 10.1 come 
from these common factors in both radial wave functions. This is how the exp(— jc) for 
Laguerre polynomials arises and x k exp(—x) for associated Laguerre polynomials in Ta¬ 
ble 10.1. 


4 Note that this mathematical definition of the eigenvalue differs by a sign from the usage in physics. 
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Table 10.1 


Equation 

p(x) 

q(x) 

X 

w{x) 

Legendre** 

1-x 2 

0 

1(1 + 1 ) 

1 

Shifted Legendre** 

x(l — Jr) 

0 

1(1 + 1) 

1 

Associated Legendre** 

l-x 2 

1 

3 

1 

X 

1(1 + 1) 

1 

Chebyshev I 

(1-x 2 ) 1 / 2 

0 

n 2 

(1-x 2 )- 1 / 2 

Shifted Chebyshev I 

[x(l-x)] 1 / 2 

0 

n 2 

(X(1-X)T 112 

Chebyshev II 

(1-x 2 ) 3 / 2 

0 

n(n + 2) 

(1-x 2 ) 1 / 2 

Ultraspherical (Gegenbauer) 

(1 -x 2 ) a+l / 2 

0 

n(n + 2a) 

(l-x 2 ) a ~ 1 / 2 

Bessel**, 0 < x < a 

X 

—n 2 /x 

a 2 

X 

Laguerre, 0 < x < oo 

xe~ x 

0 

a 

e~ x 

Associated Laguerre c 

X k+\ e -x 

0 

a — k 

x k e~ x 

Hermite, 0 < x < oo 

— X‘ ^ 

e x 

0 

2a 

— 

e x 

Simple harmonic oscillator** 

1 

0 

n 2 

1 


a l = 0,1 I <m<l are integers and — 1 < x < 1, 0 < * < 1 for shifted Legendre. 

^Orthogonality of Bessel functions is rather special. Compare Section 11.2. for details. A second type of orthogonality 
is developed in Eq. (11.174). 

c k is a non-negative integer. For more details, see Table 10.2. 

**This will form the basis for Chapter 14, Fourier series. 


Example 10.1.1 Legendre’s Equation 
Legendre’s equation is given by 

(l — x 2 )u r/ — 2xu' + n{n + l)u = 0, —1<x<1. (10.9) 

From Eqs. (10.1), (10.8), and (10.9), 

po(x) — l — x = p, w(x) = 1, 
pi(x) = —2x — p' , X — n(n + 1), 
p 2 (x) — 0 — q. 


Recall that our series solutions of Legendre’s equation (Exercise 9.5.5) 5 diverged unless n 
was restricted to one of the integers. This represents a quantization of the eigenvalue X. ■ 

When the equations of Chapter 9 are transformed into the self-adjoint form, we find 
the following values of the coefficients and parameters (Table 10.1). The coefficient p(x) 
is the coefficient of the second derivative of the eigenfunction. The eigenvalue X is the 
parameter that is available in a term of the form Xw(x)u(x): any x dependence apart from 
the eigenfunction becomes the weighting function w(x). If there is another term containing 
the eigenfunction (not the derivatives), the coefficient of the eigenfunction in this additional 
term is identified as q(x). If no such term is present, q(x) is zero. 


^Compare also Exercise 5.2.15 and 12.10. 
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Example 10.1.2 deuteron 


Further insight into the concepts of eigenfunction and eigenvalue may be provided by an 
extremely simple model of the deuteron, a bound state of a neutron and proton. From 
experiment, the binding energy of about 2 MeV<<C Me 2 , with M — M p = M n , the common 
neutron and proton mass whose small mass difference we neglect. Due to the short range 
of the nuclear force, the deuteron properties do not depend much on the detailed shape of 
the interaction potential. Thus, the neutron-proton nuclear interaction may be modeled by 
a spherically symmetric square well potential: V = Vo < 0 for 0 < r < a, V — 0 for r > a. 
The Schrodinger wave equation is 


h~ 2 

-V“i lr + V\lr — Exlf, 

M 


( 10 . 10 ) 


where the energy eigenvalue E < 0 for a bound state. For the ground state the orbital angu¬ 
lar momentum l — 0 because for / ^ 0 there is the additional positive angular momentum 
barrier. So, with i fr = ^r(r), we may write u(r) = ri/r(r), and, using Exercise 2.5.18, the 
wave equation becomes 


with 


d~u 
dr 2 


+ k\u — 0, 


( 10 . 11 ) 


k\= -y(£- Vo) >0 
h 


( 10 . 12 ) 


for the interior range, 0 < r < a. For a < r < oo, we have 

d 2 u 


dr 2 


with 


■ kiu — 0, 


ME 


ki = -=- > 0. 

h 2 


(10.13) 


(10.14) 


The boundary condition that i jr remain finite at r — 0 implies m( 0) = 0 and 


u\(r) = sink\r, 0 <r<a. 


(10.15) 


In the range outside the potential well, we have a linear combination of the two exponen¬ 
tials. 


ui{r) = Aexp^r + Bexp(—for), a<r<oo. (10.16) 

Continuity of particle and current density demand that u\ (a) — 112 (a) and that u\(a) — 
u' 2 (a). These joining, or matching, conditions give 


sinfcifl = Aexp^a + B exp(— k 2 a), 
k\ coskia = k 2 A exp k 2 a — exp(— k 2 a). 


(10.17) 


The condition that we actually have a bound proton-neutron combination is that 
/“ u 2 (r) dr = 1. This constraint can be met if we impose a boundary condition that 1 j/(r) 
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Figure 1 0.1 A deuteron eigenfunction. 

remain finite as r —*■ oo. And this, in turn, means that A = 0. Dividing the preceding pair 
of equations (to cancel B ), we obtain 

ki IE - Vq 

tan k x a = — L = - J -(10.18) 

k 2 V — E 

a transcendental equation for the energy E with only certain discrete solutions. If E is such 
that Eq. (10.18) can be satisfied, our solutions i<i(r) and injr) can satisfy the boundary 
conditions. If Eq. (10.18) is not satisfied, no acceptable solution exists. The values of 
E for which Eq. (10.18) is satisfied are the eigenvalues; the corresponding functions u \ 
and u 2 (or i fr) are the eigenfunctions. For the deuteron, problem there is one (and only one) 
negative value of E satisfying Eq. (10.18); that is, the deuteron has one and only one bound 
state. 

Now, what happens if E does not satisfy Eq. (10.18), that is, if E ^ Eq is not an 
eigenvalue? In graphical form, imagine that E and therefore k\ are varied slightly. For 
E — E\ < Eq, k\ is reduced and sin k\a has not turned down enough to match expi—kia). 
The joining conditions, Eq. (10.17), require A > 0 and the wave function goes to +oo ex¬ 
ponentially. For E = Et> Eq, k\ is larger, sin A: i a peaks sooner and has descended more 
rapidly at r = a. The joining conditions demand A < 0, and the wave function goes to —oo 
exponentially. Only for E — Eq, an eigenvalue, will the wave function have the required 
negative exponential asymptotic behavior (see Fig. 10.1). ■ 


Boundary Conditions 

In the foregoing definition of eigenfunction, it was noted that the eigenfunction u,(x) was 
required to satisfy certain imposed boundary conditions. The term boundary conditions 
includes as a special case the concept of initial conditions. For instance, specifying the 
initial position vp and the initial velocity i>o in some dynamical problem would correspond 
to the Cauchy boundary conditions. The only difference in the present usage of boundary 
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conditions in these one-dimensional problems is that we are going to apply the conditions 
on both ends of the allowed range of the variable. 

Usually the form of the differential equation or the boundary conditions on the solutions 
will guarantee that at the ends of our interval (that is, at the boundary, as suggested by 
Eq. (10.3)) the following products will vanish: 


p(x)v*(x) 


du(x) 


dx 


= 0 


and 


p(x)v*(x) 


du(x) 


dx 


— 0 . 


(10.19) 


x=b 


Here u(x) and v(x) are solutions of the particular ODE (Eq. (10.8)) being considered. 
A reason for this particular form of Eq. (10.19) is suggested shortly. If we recall the radial 
wave function u of the hydrogen atom with u( 0) = 0 and du/dr ~ e~ kr —»• 0 as r —> oo, 
then both boundary conditions are satisfied. Similarly in the deuteron Example 10.1.2, 
sin k\r -> 0 as r —> 0 and d{e~ kv )/dr —> 0 as r —> oo, both boundary conditions are 
obeyed. We can, however, work with a somewhat less restrictive set of boundary condi¬ 
tions. 


v*pu \ x _ a — v*pu'\ x _ b , (10.20) 

in which u(x) and v(x) are solutions of the differential equation corresponding to the same 
or to different eigenvalues. Equation (10.20) might well be satisfied if we were dealing with 
a periodic physical system, such as a crystal lattice. 

Equations (10.19) and (10.20) are written in terms of v*, complex conjugate. When the 
solutions are real, v = v* and the asterisk may be ignored. However, in Fourier exponential 
expansions and in quantum mechanics the functions will be complex and the complex 
conjugate will be needed. 


Example 10.1.3 Integration Interval [ a , b ] 


For C — d^/dx-, a possible eigenvalue equation is 


2 w(x) + n~u(x ) = 0, 


( 10 . 21 ) 


with eigenfunctions 


U„ = COS tlX, V m — Sin OTA'. 


Equation (10.20) becomes 

—n sinmx sinnxl* = 0, or m cosota cosha I* = 0, 

interchanging u n and v m . Since sin mx and cos nx are periodic with period 2it (for n and 
m integral), Eq. (10.20) is clearly satisfied i f a = xq and b = aq + 2n. If a problem pre¬ 
scribes a different interval, the eigenfunctions and eigenvalues will change along with the 
boundary conditions. The functions must always be chosen so that the boundary condi¬ 
tions (Eq. (10.20) etc.) are satisfied. For this case (Fourier series) the usual choices are 
Ao = 0 leading to (0, 2 tt) and xo = —it leading to (— n, n). Here and throughout the fol¬ 
lowing several chapters the orthogonality interval is so that the boundary conditions 
(Eq. (10.20)) will be satisfied. The interval [a, b] and the weighting factor w(x) for the 
most commonly encountered second-order differential equations are listed in Table 10.2. ■ 
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Table 10.2 


Equation 

a 

b 

w(x) 

Legendre 

-i 

1 

1 

Shifted Legendre 

0 

1 

1 

Associated Legendre 

-1 

1 

1 

Chebyshev I 

-1 

1 

(l-X 2 )-'/2 

Shifted Chebyshev I 

0 

1 

[x(\-x)r x/1 

Chebyshev II 

-1 

1 

(l-X 2 )'/2 

Laguerre 

0 

oo 

e-* 

Associated Laguerre 

0 

oo 

x k e~ x 

Hermite 

— 00 

00 

— 

e x 

Simple harmonic oscillator 

0 

2ji 

1 


— 7Z 

7T 

1 


1. The orthogonality interval [a, b) is determined by the boundary condi¬ 
tions of Section 10.1. 

2. The weighting function is established by putting the ODE in self- 
adjoint form. 


Hermitian Operators 


We now prove an important property of the self-adjoint, second-order differential operator 
(Eq. (10.8)), in conjunction with solutions u(x) and v(x) that satisfy boundary conditions 
given by Eq. (10.20). This is motivated by applications in quantum mechanics. 

By integrating v* (complex conjugate) times the second-order self-adjoint differential 
operator £ (operating on u) over the range a <x <b, we obtain 


nb nb nb 

I v*Cudx = I v*(pu')' dx + / v *qudx 

J a J a Ja 

using Eq. (10.6). Integrating by parts, we have 

[ v*(pu')'dx = v*pu'\ b — [ v*'pu'dx. 

Ja Ja 


( 10 . 22 ) 


(10.23) 


The integrated part vanishes on application of the boundary conditions (Eq. (10.20)). Inte¬ 
grating the remaining integral by parts a second time, we have 



/ / j . 

pu dx = —v pu + 



(10.24) 


Again, the integrated part vanishes in an application of Eq. (10.20). A combination of 
Eqs. (10.22) to (10.24) gives us 

pb pb 

I v*Cudx= I u(Cv)*dx. (10.25) 

J a J a 

This property, given by Eq. (10.25), is expressed by saying that the operator £ is Her¬ 
mitian with respect to the functions u(x) and u(f), which satisfy the boundary conditions 
specified by Eq. (10.20). Note that if this Hermitian property follows from self-adjointness 
in a Hilbert space, then it includes that boundary conditions are imposed on all functions 
of that space. 
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Hermitian Operators in Quantum Mechanics 


The proceeding development in this section has focused on the classical second-order dif¬ 
ferential operators of mathematical physics. Generalizing our Hermitian operator theory 
as required in quantum mechanics, we have an extension: The operators need be neither 
second-order differential operators nor real. p x = —it) id/dx) will be a Hermitian operator. 
We simply assume (as is customary in quantum mechanics) that the wave functions satisfy 
appropriate boundary conditions: vanishing sufficiently strongly at infinity or having peri¬ 
odic behavior (as in a crystal lattice, or unit intensity for scattering problems). The operator 
£ is called Hermitian if 



(10.26) 


Apart from the simple extension to complex quantities, this definition is identical with 
Eq. (10.25). 

The adjoint A r of an operator A is defined by 



A^ij/Tdr = 


I 


(. A\jf])*\jf2dr. 


(10.27) 


This generalizes our classical, second-derivative-operator-oriented definition, Eq. (10.5). 
Here the adjoint is defined in terms of the resultant integral, with the A ' as part of the 
integrand. Clearly, if A — A ' (self-adjoint) and satisfies the aforementioned boundary 
conditions, then A is Hermitian. 

The expectation value of an operator £ is defined as 



\l/*Cxl/ dr. 


(10.28a) 


In the framework of quantum mechanics (£) corresponds to the result of a measurement 
of the physical quantity represented by £ when the physical system is in a state described 
by the wave function i fr. If we require £ to be Hermitian, it is easy to show that (£) is 
real (as would be expected from a measurement in a physical theory). Taking the complex 
conjugate of Eq. (10.28a), we obtain 


<£>* = 




dr. 


Rearranging the factors in the integrand, we have 


(£}* = J {Cffifdr. 

Then, applying our definition of Hermitian operator, Eq. (10.26), we get 

(£>* = J f*C^dr = {£), 


or (£) is real. It is worth noting that i/r is not necessarily an eigenfunction of £. 


(10.28b) 
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Exercises 

10 . 1.1 

10.1.2 

10.1.3 

10.1.4 


10.1.5 


10.1.6 


Show that Laguerre’s ODE, Eq. (13.52), may be put into self-adjoint form by multiply¬ 
ing by e~ x and that w(x) — e~ x is the weighting function. 

Show that the Hermite ODE, Eq. (13.10), may be put into self-adjoint form by multi- 

_ 2 . . _ 2 

plying hv e x and that this gives vu(x) = e x as the appropriate density function. 

Show that the Chebyshev (type I) ODE, Eq. (13.100), may be put into self-adjoint form 
by multiplying by (1 — x 2 ) -1 / 2 and that this gives w(x ) = (1 — x 2 ) -1 / 2 as the appro¬ 
priate density function. 

Show the following when the linear second-order differential equation is expressed in 
self-adjoint form: 


(a) The Wronskian is equal to a constant divided by the initial coefficient p: 

C 

W(x) = 


p(x) 


(b) A second solution is given by 

y 2 (x) = Cy\ (x) 


r 


dt 


P(f)l>l(0] 2 ’ 

U„(x ), the Chebyshev polynomial (type II), satisfies the ODE, Eq. (13.101), 
(l — x 2 )f/"(x) — 3xU' n (x) + n(n + 2 )U n (x) — 0. 


(a) Locate the singular points that appear in the finite plane, and show whether they 
are regular or irregular. 

(b) Put this equation in self-adjoint form. 

(c) Identify the complete eigenvalue. 

(d) Identify the weighting function. 


For the very special case A. = 0 and q(x) — 0 the self-adjoint eigenvalue equation be¬ 
comes 


d 

dx 


p(x) 


du(x ) 
dx 


— 0 , 


satisfied by 


du 1 
dx p(x) 

Use this to obtain a “second” solution of the following: 


(a) Legendre’s equation, 

(b) Laguerre’s equation, 

(c) Hermite’s equation. 
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1 1 + x 

ANS. (a)« 2 W = -ln-, 

2 1 — x 


t dt 

(b) u 2 (x) - U 2 (xo) = I e 


-f 

Jxo 


(c) u 2 (x) = 




dt. 


These second solutions illustrate the divergent behavior usually found in a second solu¬ 
tion. 

Note. In all three cases u\(x) = 1. 


10.1.7 Given that Cu = 0 and gCu is self-adjoint, show that for the adjoint operator 
£, C(gu ) = 0. 

10.1.8 For a second-order differential operator £ that is self-adjoint show that 


/ \yiCyi - Vi £v 2 ] dx = p(y\y 2 - >'i y 2 ) 

J a 


b 
a' 


10.1.9 Show that if a function i// is required to satisfy Laplace’s equation in a finite region 
of space and to satisfy Dirichlet boundary conditions over the entire closed bounding 
surface, then i// is unique. 

Hint. One of the forms of Green’s theorem. Section 1.11, will be helpful. 

10.1.10 Consider the solutions of the Legendre, Chebyshev, Hermite, and Laguerre equations to 
be polynomials. Show that the ranges of integration that guarantee that the Hermitian 
operator boundary conditions will be satisfied are 


(a) Legendre [—1, 1], (b) Chebyshev [—1, 1], 

(c) Hermite (—oo, oo), (d) Laguerre [0, oo). 

10 . 1.11 Within the framework of quantum mechanics (Eqs. (10.26) and following), show that 
the following are Hermitian operators: 

h 

(a) momentum p = — ih V = —i — V 

2n 

(b) angular momentum L = — i hr x V = —iJ^ r x V. 

Hint. In Cartesian form L is a linear combination of noncommuting Hermitian opera¬ 
tors. 

10 . 1.12 (a) A is a non-Hermitian operator. In the sense of Eqs. (10.26) and (10.27), show that 

A + A f and i(A — A f ) 


are Hermitian operators. 

(b) Using the preceding result, show that every non-Hermitian operator may be written 
as a linear combination of two Hermitian operators. 
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10 . 1.13 U and V are two arbitrary operators, not necessarily Hermitian. In the sense of 
Eq. (10.27), show that 

(UV) f = V f U f . 

Note the resemblance to Hermitian adjoint matrices. 

Hint. Apply the definition of adjoint operator, Eq. (10.27). 

10 . 1.14 Prove that the product of two Hermitian operators is Hermitian (Eq. (10.26)) if and only 
if the two operators commute. 

10 . 1.15 A and B are noncommuting quantum mechanical operators: 

AB - BA — iC. 


10 . 1.16 

10 . 1.17 


10 . 1.18 


Show that C is Hermitian. Assume that appropriate boundary conditions are satisfied. 
The operator C is Hermitian. Show that {C 2 ) > 0. 


A quantum mechanical expectation value is defined by 


(A) = 


I 


x[r*(x)Axlr(x ) dx, 


where A is a linear operator. Show that demanding that (A) be real means that A must 
be Hermitian — with respect to i/r (x). 

From the definition of adjoint, Eq. (10.27), show that A'* — A in the sense that 
f i/r * A E 1/^2 dr — f \/f* A\j /2 dr. The adjoint of the adjoint is the original operator. 

Hint. The functions i/q and iJ/j of Eq. (10.27) represent a class of functions. The sub¬ 
scripts 1 and 2 may be interchanged or replaced by other subscripts. 


10 . 1.19 


The Schrodinger wave equation for the deuteron (with a Woods-Saxon potential) is 


h 2 
2 M 


V 2 i/f + 


Eo 

1 + exp[(r - r 0 )/a] 


\Jr = Etjr. 


Here E — —2.224 MeV, a is a “thickness parameter,” 0.4 x 10 -13 cm. Expressing 
lengths in fermis (10 -13 cm) and energies in million electron volts (MeV), we may 
rewrite the wave equation as 


d 2 
dr 2 


(rx[r) + 


1 

41.47 



Eq 

1 + exp((r - r Q )/a) 


(n/f) = 0. 


E is assumed known from experiment. The goal is to find Vo for a specified value of 
ro (say, ro = 2.1). If we let y(r) = n/f(r), then v(0) = 0 and we take y'(0) = 1. Find 
Vo such that y(20.0) = 0. (This should be y(oo), but r = 20 is far enough beyond the 
range of nuclear forces to approximate infinity.) 


ANS. For a = 0.4 and r 0 = 2.1 fm, V 0 = -34.159 MeV. 


10 . 1.20 Determine the nuclear potential well parameter Vo of Exercise 10.1.19 as a function of 
/■ o for r — 2.00(0.05)2.25 fermis. Express your results as a power law 

Wo\rZ = k. 

Determine the exponent v and the constant k. This power-law formulation is useful for 
accurate interpolation. 
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10.1.21 In Exercise 10.1.19 it was assumed that 20 fermis was a good approximation to infinity. 
Check on this by calculating Vo for ri/r(r) — 0 at (a) r = 15, (b) r — 20, (c) r — 25, and 
(d) r — 30. Sketch your results. Take ro = 2.10 and a = 0.4 (fermis). 

10.1.22 For a quantum particle moving in a potential well, V(x) — \marx 2 , the Schrodinger 
wave equation is 


or 


h 2 d 2 \jj(x) 1 


+ = E\l/(x), 


2m dx 2 


d 2 ir(z) 

dz 2 


-z 2 f{z) = - 


2 E 
hw 


ir(z), 


where z = {mco/hy' 2 x. Since this operator is even, we expect solutions of definite 
parity. For the initial conditions that follow, integrate out from the origin and determine 
the minimum constant 2 E/hco that will lead to i/r(oo) = 0 in each case. (You may take 
7 = 6 as an approximation of infinity.) 


(a) For an even eigenfunction, 

i/r(0) = 1, i//(0) = 0. 

(b) For an odd eigenfunction, 

V'-(O) = 0, i//(0)=l. 


Note. Analytical solutions appear in Section 13.1. 


10.2 Hermitian Operators 

Hermitian, or self-adjoint, operators with appropriate boundary conditions have three prop¬ 
erties that are of extreme importance in physics, both classical and quantum. 

1. The eigenvalues of a Hermitian operator are real. 

2. A Hermitian operator possesses an orthogonal set of eigenfunctions. 

3. The eigenfunctions of a Hermitian operator form a complete set . 6 

Real Eigenvalues 

We proceed to prove the first two of these three properties. Let 

Ciij + XjWUi — 0. (10.29) 


®This third property is not universal. It does hold for our linear, second-order differential operators in Sturm-Liouville (self- 
adjoint) form. Completeness is defined and discussed in Section 10.4. A proof that the eigenfunctions of our linear, second-order, 
self-adjoint, differential equations form a complete set may be developed from the calculus of variations of Section 17.8. 
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Assuming the existence of a second eigenvalue and eigenfunction, 

Cuj+Xjwuj— 0. (10.30) 

Then, taking the complex conjugate, we obtain 

£*u* + X*wu* = 0. (10.31) 

Here w(x ) > 0 is a real function. But we permit the eigenvalues, and n&, the eigen¬ 
functions, to be complex. Multiplying Eq. (10.29) by u* and Eq. (10.31) by «, and then 
subtracting, we have 

u*Cui - UiC*u* = (A.* - Xi)wuiii*. (10.32) 

We integrate over the range a <x <b: 

nb nb pb 

/ u*Cuidx— / UjC*u* dx = (X* — Xi) / iiju*wdx. (10.33) 

J a Ja J a 

Since C is Hermitian, the left-hand side vanishes by Eq. (10.26) and 

(A*-A,)f UjU*w dx — 0. (10.34) 

J a 

If i = j, the integral cannot vanish [m;(a') > 0, apart from isolated points], except in the 
trivial case Uj = 0. Hence the coefficient (X* — X,) must be zero, 

A*=A ; , (10.35) 

which says that the eigenvalue is real. Since A, can represent any one of the eigenvalues, 
this proves the first property. This is an exact analog of the nature of the eigenvalues of real 
symmetric (and of Hermitian) matrices (compare Section 3.5). 

The analog of the spectral decomposition of a real symmetric matrix in Section 3.5 for 
a Hermitian operator C with a discrete set of eigenvalues A/ takes the form 

C = A; I ui) (m |, /(£) = f (*») I«/) («/1 

i i 

with eigenvectors |m;> and any infinitely differentiable function /. 

Real eigenvalues of Hermitian operators have a fundamental significance in quantum 
mechanics. In quantum mechanics the eigenvalues correspond to precisely measurable 
quantities, such as energy and angular momentum. With the theory formulated in terms 
of Hermitian operators, this proof of real eigenvalues guarantees that the theory will pre¬ 
dict real numbers for these measurable physical quantities. In Section 17.8 it will be seen 
that the set of real eigenvalues has a lower bound (for nonrelativistic problems). 
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Orthogonal Eigenfunctions 

If we now take i ^ j and if A.,- ^ Xj in Eq. (10.34), the integral of the product of the two 
different eigenfunctions must vanish: 

[ UjU*wdx = 0. (10.36) 

Ja 

This condition, called orthogonality, is the continuum analog of the vanishing of a scalar 
product of two vectors. 7 We say that the eigenfunctions iv, (x) and uj(x) are orthogonal 
with respect to the weighting function u>(x) over the interval [a. b]. Equation (10.36) con¬ 
stitutes a partial proof of the second property of our Hermitian operators. Again, the precise 
analogy with matrix analysis should be noted. Indeed, we can establish a one-to-one corre¬ 
spondence between this Sturm-Liouville theory of differential equations and the treatment 
of Hermitian matrices. Historically, this correspondence has been significant in establishing 
the mathematical equivalence of matrix mechanics developed by Heisenberg and wave me¬ 
chanics developed by Schrodinger. Today, the two diverse approaches are merged into the 
theory of quantum mechanics, and the mathematical formulation that is more convenient 
for a particular problem is used for that problem. Actually the mathematical alternatives do 
not end here. Integral equations. Chapter 16, form a third equivalent and sometimes more 
convenient or more powerful approach. 

This proof of orthogonality is not quite complete. There is a loophole, because we may 
have iij ^ uj but still have A; = A,-. Such a case is labeled degenerate. Illustrations of 
degeneracy are given at the end of this section. If A, = A j, the integral in Eq. (10.34) need 
not vanish. This means that linearly independent eigenfunctions corresponding to the same 
eigenvalue are not automatically orthogonal and that some other method must be sought 
to obtain an orthogonal set. Although the eigenfunctions in this degenerate case may not 
be orthogonal, they can always be made orthogonal. One method is developed in the next 
section. See also Eq. (4.21) for degeneracy due to symmetry. 

We shall see in succeeding chapters that it is just as desirable to have a given set of 
functions orthogonal as it is to have an orthogonal coordinate system. We can work with 
nonorthogonal functions, but they are likely to prove as messy as an oblique coordinate 
system. 


Example 10.2.1 


Fourier Series — Orthogonality 


To continue Example 10.1.3, the eigenvalue equation, Eq. (10.21), 


d^y(x) + n z y(x) = 0, 


'From the definition of Riemann integral, 


/' 


f(x)g(x) dx = lim 

N—y(X 


^2f(xi)g(xi)Ax 


where xq = a, xjj = b, and jc/ — = Ax. If we interpret /(jtj) and g(x{) as the ith components of an iV-component vector, 

then this sum (and therefore this integral) corresponds directly to a scalar product of vectors, Eq. (1.24). The vanishing of the 
scalar product is the condition for orthogonality of the vectors — or functions. 
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may describe a quantum mechanical particle in a box, or perhaps a vibrating violin 
string, a classical harmonic oscillator with degenerate eigenfunctions — cos nx, sin nx — 
and eigenvalues n 2 , n an integer. 

With n real (here taken to be integral), the orthogonality integrals become 


(a) 

(b) 

(c) 


rx 'o 
Jx o 

L 

L 


xo+2n 

xo 

xq+2jt 


sin mx sin nx dx — C n S nm , 
cos mx cos nx dx = D n S nm , 

sin mx cos nx dx — 0. 


For an interval of 2n the preceding analysis guarantees the Kronecker delta in (a) and 
(b) but not the zero in (c) because (c) may involve degenerate eigenfunctions. However, 
inspection shows that (c) always vanishes for all integral m and n. 

Our Sturm-Liouville theory says nothing about the values of C n and D n because homo¬ 
geneous ODEs have solutions whose scaling is arbitrary. Actual calculation yields 

1 7r, n xfz 0, f;r, n ^ 0, 

D„ = { 

0, n — 0, [ 2tx, n — 0. 

These orthogonality integrals form the basis of the Fourier series developed in Chap¬ 
ter 14. ■ 


Example 10.2.2 Expansion in Orthogonal Eigenfunctions—Square Wave 


The property of completeness (see Eq. (1.190) and Section 10.4) means that certain classes 
of functions (for example, sectionally or piecewise continuous) may be represented by a 
series of orthogonal eigenfunctions. Consider the square-wave shape 


f h 


/(*) = 


2’ 

h 

~ 2 ’ 


0 < X < 7T, 

—7T < X < 0. 


(10.37) 


This function may be expanded in any of a variety of eigenfunctions — Legendre, Hermite, 
Chebyshev, and so on. The choice of eigenfunction is made on the basis of convenience or 
an application. To illustrate the expansion technique, let us choose the eigenfunctions of 
Example 10.2.1, cos nx and sin nx. 

The eigenfunction series is conveniently (and conventionally) written as 


/(*) = 


a 0 

2 


OO 

+ (a m cos mx + b m sin mx). 

m= 1 


Upon multiplying /(f) by cos nt or sinnf and integrating, only the nth term survives, by 
the orthogonality integrals of Example 10.2.1, thus yielding the coefficients 


- r 

— — I /(f)cosnf dt, 

T J-TT 


b n — 

T J — 7J 


/: 


/(f) sin nt dt, 


a i 


b, 


n = 0, 1,2.... 
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Direct substitution of ±/;/2 for fit) yields 

a n — 0, 

which is expected here because of the antisymmetry, f(—x) — — fix), and 


h 

b n — —(1 — cos nit) — 
mr 


r o. 


n even, 


2 h 

—, n odd. 
mr 


Hence the eigenfunction (Fourier) expansion of the square wave is 


2 h sin(2n + \)x 

fix) = — > —-——-■ 

7r z —' 2n + 1 

«=0 


(10.38) 


Additional examples, using other eigenfunctions, appear in Chapters 11 and 12. 


Degeneracy 

The concept of degeneracy was introduced earlier. If N linearly independent eigenfunc¬ 
tions correspond to the same eigenvalue, the eigenvalue is said to be IV-fold degenerate. 
A particularly simple illustration is provided by the eigenvalues and eigenfunctions of the 
classical harmonic oscillator equation. Example 10.2.1. For each eigenvalue n 2 , there are 
two possible solutions: sin nx and cos nx (and any linear combination, n an integer). We 
say the eigenfunctions are degenerate or the eigenvalue is degenerate. 

A more involved example is furnished by the physical system of an electron in an atom 
(nonrelativistic treatment, spin neglected). From the Schrodinger equation, Eq. (13.84) for 
hydrogen, the total energy of the electron is our eigenvalue. We may label it E„lm by using 
the quantum numbers n , L, and M as subscripts. For each distinct set of quantum numbers 
in, L, M) there is a distinct, linearly independent eigenfunction V'hZ.mO', 0, <p). For hydro¬ 
gen, the energy E u lm is independent of L and M, reflecting the spherical (and SO(4)) 
symmetry of the Coulomb potential. With 0 < L < n — 1 and —L<M<L, the eigen¬ 
value is n -fold degenerate (including the electron spin would raise this to 2 n 2 ). In atoms 
with more than one electron, the electrostatic potential is no longer a simple r~ l potential. 
The energy depends on L as well as on n, although not on M\ E„lm is still (2 L + l)-fold 
degenerate. This degeneracy — due to rotational invariance of the potential — may be re¬ 
moved by applying an external magnetic field, breaking spherical symmetry and giving rise 
to the Zeeman effect. As a rule, the eigenfunctions form a Hilbert space, that is, a complete 
vector space of functions with a metric defined by the inner product (see Section 10.4 for 
more details and examples). 

Often an underlying symmetry, such as rotational invariance, is causing the degenera¬ 
cies. States belonging to the same energy eigenvalue then will form a multiplet or repre¬ 
sentation of the symmetry group. The powerful group-theoretical methods are treated in 
Chapter 4 in some detail. 
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Exercises 


10.2.1 The functions ui(x ) and uj(x) are eigenfunctions of the same Hermitian operator but 
for distinct eigenvalues X i and a 2 . Prove that u\ (x) and iii(x) are linearly independent. 

10.2.2 (a) The vectors e„ are orthogonal to each other: e„ • e m = 0 for n ^ m. Show that they 

are linearly independent. 

(b) The functions i//„ (x ) are orthogonal to each other over the interval [a, /)] and with 
respect to the weighting function u>(x). Show that the ir n (x) are linearly indepen¬ 
dent. 

10.2.3 Given that 


P\{x)—x and 


Qo(x) = In 


\+ x 

\ — X 


are solutions of Legendre’s differential equation corresponding to different eigenval¬ 
ues: 


(a) Evaluate their orthogonality integral 



(b) Explain why these two functions are not orthogonal, that is, why the proof of 
orthogonality does not apply. 


10.2.4 7o (x) — 1 and Vj (x) — (1 — x 2 ) 1 ? 2 are solutions of the Chebyshev differential equation 
corresponding to different eigenvalues. Explain, in terms of the boundary conditions, 
why these two functions are not orthogonal. 


10.2.5 (a) Show that the first derivatives of the Legendre polynomials satisfy a self-adjoint 

differential equation with eigenvalue X — n{n + 1) — 2. 

(b) Show that these Legendre polynomial derivatives satisfy an orthogonality relation 



P' m (x)P' n (x)(\ 


x 2 ) clx — 0, 


m 7 ^ n . 


Note. In Section 12.5, (1 — x 2 y' 2 P' n {x) will be labeled an associated Legendre polyno¬ 
mial, P\ (x ). 

10.2.6 A set of functions u n (x) satisfies the Sturm-Liouville equation 


d 

dx 


p(x) 


— ll n (x) 
dx 


+ X n w{x)u n {x) — 0. 


The functions u m {x) and u„(x) satisfy boundary conditions that lead to orthogonality. 
The corresponding eigenvalues X m and X n are distinct. Prove that for appropriate bound¬ 
ary conditions, u' m {x) and u' n (x) are orthogonal with p(x) as a weighting function. 
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10.2.7 A linear operator A has n distinct eigenvalues and n corresponding eigenfunctions: 

Aijfi — /., i//,. Show that the n eigenfunctions are linearly independent. A is not neces¬ 
sarily Hermitian. 

Hint. Assume linear dependence — that i//„ = Yl'iZi a i x h • Use this relation and the 
operator-eigenfunction equation first in one order and then in the reverse order. Show 
that a contradiction results. 


10.2.8 (a) Show that the Liouville substitution 

u(x) = v(%)[p(x)w(x)] l/4 , 


f 

~w(tY 

L 

.pit). 


1/2 


dt 


transforms 


into 


where 


d 

dx 


p(.x')~—u 

dx 


+ [Aui(x) — q{x)]u(x) — 0 


d 2 v 

dH 


^ + [A-Q(?)]t:(£) = 0, 


d 2 


(b) If tq (£) and i> 2 (f) are obtained from u \ (x) and U 2 (x), respectively, by a Liouville 
substitution, show that w{x)u\U 2 dx is transformed into i>i(£)t>2(§)£§ with 
c = f a b [p 1 / 2 dx. 

10.2.9 The ultraspherical polynomials C„ u> (x) are solutions of the differential equation 

d 2 .... d . _ 


(1 - * - (2a + + 2 “) = 0 . 


dx 


(a) Transform this differential equation into self-adjoint form. 

(b) Show that the C„ (x) are orthogonal for different n. Specify the interval of inte¬ 
gration and the weighting factor. 

Note. Assume that your solutions are polynomials. 

10.2.10 With £ not self-adjoint. 


Cut + A iWUj = 0 


and 


Cvj + ^jWVj — 0. 
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(a) Show that 


provided 


and 



VjCui dx 



UjCvj dx. 


r |b /i b 

u iP0Vj\ a = VjP0 u i\ a 

UiiP\ ~ p'o)vj\ b a = 0 . 


(b) 


Show that the orthogonality integral for the eigenfunctions w; and vj becomes 



UiVjW dx — 0 


(^; i L ^j)- 


10.2.11 In Exercise 9.5.8 the series solution of the Chebyshev equation is found to be convergent 
for all eigenvalues n. Therefore n is not quantized by the argument used for Legendre’s 
(Exercise 9.5.5). Calculate the sum of the indicial equation k — 0 Chebyshev series for 
n — v = 0.8, 0.9, and 1.0 and for x = 0.0(0.1)0.9. 

Note. The Chebyshev series recurrence relation is given in Exercise 5.2.16. 

10.2.12 (a) Evaluate the n = v = 0.9, indicial equation k = 0 Chebyshev series for x — 

0.98, 0.99, and 1.00. The series converges very slowly at x = 1.00. You may wish 
to use double precision. Upper bounds to the error in your calculation can be set 
by comparison with the v = 1.0 case, which corresponds to (1 — At 2 ) 1 / 2 . 

(b) These series solutions for eigenvalue v = 0.9 and for v = 1.0 are obviously not 
orthogonal, despite the fact that they satisfy a self-adjoint eigenvalue equation with 
different eigenvalues. From the behavior of the solutions in the vicinity of x — 1.00 
try to formulate a hypothesis as to why the proof of orthogonality does not apply. 

10.2.13 The Fourier expansion of the (asymmetric) square wave is given by Eq. (10.38). With 
h — 2, evaluate this series for x = 0(7r/18)7r/2, using the first (a) 10 terms, (b) 100 terms 
of the series. 

Note. For 10 terms and x — n/ 18, or 10°, your Fourier representation has a sharp hump. 
This is the Gibbs phenomenon of Section 14.5. For 100 terms this hump has been shifted 
over to about 1 °. 


10.2.14 The symmetric square wave 

/(*) = 

has a Fourier expansion 


Tt 

1, | At | < — 

2 

TT 

— 1, — < IjC I < TT 

2 


/w ^£ ( -ir c °f ,, + 1)J . 

7i ^ 2n + 1 

n =0 

Evaluate this series for x = 0(jr/18)7r/2 using the first 



642 ChapterlO Sturm-Liouville Theory — Orthogonal Functions 


(a) 10 terms, (b) 100 terms of the series. 

Note. As in Exercise 10.2.13, the Gibbs phenomenon appears at the discontinuity. This 
means that a Fourier series is not suitable for precise numerical work in the vicinity of 
a discontinuity. 


10.3 Gram-Schmidt Orthogonalization 


The Gram-Schmidt orthogonalization is a method that takes a nonorthogonal set of lin¬ 
early independent vectors (see Section 3.1) or functions 8 and constructs an orthogonal set 
of vectors or functions over an arbitrary interval and with respect to an arbitrary weight 
or density factor. In the language of linear algebra, the process is equivalent to a matrix 
transformation relating an orthogonal set of basis vectors (functions) to a nonorthogonal 
set. A specific example of this matrix transformation appears in Exercise 12.2.1. 

Next we apply the Gram-Schmidt procedure to a set of functions. The functions in¬ 
volved may be real or complex. Here for convenience they are assumed to be real. The 
generalization to the complex case offers no difficulty. 

Before taking up orthogonalization, we should consider normalization of functions. So 
far no normalization has been specified. This means that 


/' 


cpfwdx — Nf, 


but no attention has been paid to the value of A/. Since our basic equation (Eq. (10.8)) is 
linear and homogeneous, we may multiply our solution by any constant and it will still be 
a solution. We now demand that each solution (p t (x ) be multiplied by AT 1 so that the new 
(normalized) tpj will satisfy 


and 



( pf(x)w(x)dx = 1 


(10.39) 


f 

J a 


q>i ( x)<pj (x)w(x) dx — Sij . 


(10.40) 


Equation (10.39) says that we have normalized to unity. Including the property of orthog¬ 
onality, we have Eq. (10.40). Functions satisfying this equation are said to be orthonor¬ 
mal (orthogonal plus unit normalization). Other normalizations are certainly possible, and 
indeed, by historical convention, each of the special functions of mathematical physics 
treated in Chapters 12 and 13 will be normalized differently. 

We consider three sets of functions: an original, linearly independent given set 
Unix.), n = 0, 1,2,...; an orthogonalized set xj.'r n (x ) to be constructed; and a final set 


8 Such a set of functions might well arise from the solutions of a PDE in which the eigenvalue was independent of one or more 
of the constants of separation. As an example, we have the hydrogen atom problem (Sections 10.2 and 13.2). The eigenvalue 
(energy) is independent of both the electron orbital angular momentum and its projection on the .--axis, m. Note, however, that 
the origin of the set of functions is irrelevant to the Gram-Schmidt orthogonalization procedure. 
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of functions ip n (x ), which are the normalized \l/„. The original u n may be degenerate 
eigenfunctions, but this is not necessary. We shall have the following properties: 


Unix) 

tnix) 

<Pn(x) 

Linearly independent 

Linearly independent 

Linearly independent 

Nonorthogonal 

Orthogonal 

Orthogonal 

Unnormalized 

Unnormalized 

Normalized (orthonormal) 


The Gram-Schmidt procedure takes the nth i Jr function (i//„) to be u n (x) plus an un¬ 
known linear combination of the previous ip. The presence of the new u n (x ) will guarantee 
linear independence. The requirement that i jr n (x) be orthogonal to each of the previous 
ip yields just enough constraints to determine each of the unknown coefficients. Then the 
fully determined i fr n will be normalized to unity, yielding <p n (x ). Then the sequence of 
steps is repeated for Vg+i (•*)• 

We start with n — 0, letting 


foix) — uq(x), 

with no “previous” ip to worry about. Then we normalize 

foix) 


<Po{x) = 


[f l//yUJ dx] 1 / 2 


For n — 1, let 


fi(x) = u\(x) + a\fi<pQ(x). 


(10.41) 


(10.42) 


(10.43) 


We demand that tjr\(x) be orthogonal to ^o^)- (At this stage the normalization of i/qC*) 
is irrelevant.) This orthogonality leads to 

I f m wdx = J umwdx + ai,o / ipQwdx = 0. (10.44) 

Since ipo is normalized to unity (Eq. (10.42)), we have 

fli.o = — J unpowdx, 

fixing the value of «i o. Normalizing, we define 

fi(x) 


(10.45) 


V\(x) = 


Finally, we generalize so that 


iPi(x) = 


(/ \j/ 2 w dx) x ! 2 

_ t/h- (x) _ 

(/ 1 jff(x)w(x)dx) x l 2 


(10.46) 


(10.47) 


where 


fi (x) — Ui + cii,oipo + dijipi H-h ai i—\ipi— i. 

The coefficients a;j are given by 

a jj — — J Ujipj iv dx. 


(10.48) 


(10.49) 
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Equation (10.49) holds for unit normalization. If some other normalization is selected. 



w(x)dx — Nj, 


then Eq. (10.47) is replaced by 


<Pi(x) = Nj 


(/ x/ffwdx) 1 / 2 


(10.47a) 


and ajj becomes 


*i,j 


f Uj<pjW dx 



(10.49a) 


Equations (10.48) and (10.49) may be rewritten in terms of projection operators, Pj. If 
we consider the <p n (x) to form a linear vector space, then the integral in Eq. (10.49) may 
be interpreted as the projection of Uj into the <ipj “coordinate,” or the / th component of Uj. 
With 


PjUj(x) 


J Uj(t)<pj(t)w(t)dt 


<Pj(x), 


Eq. (10.48) becomes 


fi(x) = 



(10.48a) 


Subtracting off the components, j = I to i — 1, leaves i//,- (x ) orthogonal to all the (pj(x). 

It will be noticed that although this Gram-Schmidt procedure is one possible way of 
constructing an orthogonal or orthonormal set, the functions < Pi(x) are not unique. There 
is an infinite number of possible orthonormal sets for a given interval and a given density 
function. 

As an illustration of the freedom involved, consider two (nonparallel) vectors A and B 
in the xv-plane. We may normalize A to unit magnitude and then form B' = a A + B so 
that B' is perpendicular to A. By normalizing B' we have completed the Gram-Schmidt 
orthogonalization for two vectors. But any two perpendicular unit vectors, such as x and y, 
could have been chosen as our orthonormal set. Again, with an infinite number of possible 
rotations of x and y about the z-axis, we have an infinite number of possible orthonormal 
sets. 


Example 10.3.1 Legendre Polynomials by Gram-Schmidt Orthogonalization 

Let us form an orthonormal set from the set of functions u„ (x) = x n , n — 0,1, 2_The 

interval is — 1 < x < 1 and the density function is w(x) = 1. 

In accordance with the Gram-Schmidt orthogonalization process described. 


mo = 1- 


hence 


1 

<A)= -t= 


(10.50) 
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Then 


VaO) = x + a 1 , 0 —p 

V2 


and 


aio — —J —— dx = 0 


x 


by symmetry. We normalize i//] to obtain 

9tW = y' 2 X - 

Then we continue the Gram-Schmidt procedure with 

1 /3 


where 


f 2 (x)=x +a 2 ' 0 —^+a 2 ,u-x. 




V2 


x 2 \/2 

—=ax = — 

-l V2 3 


again by symmetry. Therefore 


-x dx — 0, 


1 


f 2 (x)=x - 


and, on normalizing to unity, we have 


<P2(x) = yj^' \ - !)• 


The next function, (p 2 (x), becomes 


<P3(x) = ^- ^(5x 3 -3x). 


Reference to Chapter 12 will show that 


2n + \ 

<Pn(x) = J --- P n (x), 


(10.51) 

(10.52) 

(10.53) 

(10.54) 

(10.55) 

(10.56) 

(10.57) 

(10.58) 

(10.59) 

(10.60) 


where P„(x) is the nth-order Legendre polynomial. Our Gram-Schmidt process provides 
a possible but very cumbersome method of generating the Legendre polynomials. It il¬ 
lustrates how a power-series expansion in u n (x) = x n , which is not orthogonal, can be 
converted into an orthogonal series. ■ 



646 ChapterlO Sturm-Liouville Theory — Orthogonal Functions 


The equations for Gram-Schmidt orthogonalization tend to be ill-conditioned because 
of the subtractions, Eqs. (10.48) and (10.49). A technique for avoiding this difficulty using 
the polynomial recurrence relation is discussed by Hamming. 9 

In Example 10.3.1 we have specified an orthogonality interval [—1, 1], a unit weighting 
function, and a set of functions x" to be taken one at a time in increasing order. Given 
all these specifications, the Gram-Schmidt procedure is unique (to within a normaliza¬ 
tion factor and an overall sign, as discussed subsequently). Our resulting orthogonal set, 
the Legendre polynomials, Pq up through P n , form a complete set for the description of 
polynomials of order < n over [—1, 1], This concept of completeness is taken up in detail 
in Section 10.4. Expansions of functions in series of Legendre polynomials are found in 
Section 12.3. 


Orthogonal Polynomials 

Example 10.3.1 has been chosen strictly to illustrate the Gram-Schmidt procedure. Al¬ 
though it has the advantage of introducing the Legendre polynomials, the initial functions 
u n — x" are not degenerate eigenfunctions and are not solutions of Legendre’s equation. 
They are simply a set of functions that we have here rearranged to create an orthonor¬ 
mal set for the given interval and given weighting function. The fact that we obtained the 
Legendre polynomials is not quite black magic but a direct consequence of the choice of in¬ 
terval and weighting function. The use of u n (x) = x" but with other choices of interval and 


Table 1 0.3 Orthogonal Polynomials Generated by Gram-Schmidt Orthogonalization 
of u n (x) = x n , n = 0, 1, 2,... 


Polynomials Interval 


Legendre 

— 1<*<1 

Shifted Legendre 

0<x < 1 

Chebyshev I 

-1<X< 1 

Shifted Chebyshev I 

0<x < 1 

Chebyshev II 

— 1 < x < 1 

Laguerre 

0 < x < oo 

Associated Laguerre 

0 < x < oo 

Hermite 

— OO < X < 00 


Weighting 

function w{x) Standard normalization 


1 

1 

(i-* 2 )- 
[x(l -X)] 


/: 

i: 


\p n (x)pdx = 


[P*(x)] 2 dx = 


2n + 1 
1 

2n + 1 


-1/2 

[' [Tn(x)]2 dx=\ 

7112, 

71^0 


J- 1(1-* 2 )l/2 | 

71, 

n = 0 

-1/2 

C lT » iX)] ] n dx = 

Jw/2, 

n > 0 


Jo [X(l-X)] 1 / 2 

L- 

n = 0 


(1 -* 2 ) 1 / 2 f X \U n (x)f(l- X 2 ) l l 2 dx = 


poo 

/ [L n (x)] 2 e~ x dx = 1 
Jo 


\L k n ( x)] 2 x k e~ x dx = {n+k) ' 
n\ 


r 

Jo 

/ oo 2 

[H n (x)] 2 e~ x dx = 2 M 7r 1 / 2 n! 
-oo 


^R. W. Hamming, Numerical Methods for Scientists and Engineers, 2nd ed., New York: McGraw-Hill (1973). See Section 27.2 
and references given there. 
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weighting function leads to other sets of orthogonal polynomials, as shown in Table 10.3. 
We consider these polynomials in detail in Chapters 12 and 13 as solutions of particular 
differential equations. 

An examination of this orthogonalization process will reveal two arbitrary features. First, 
as emphasized before, it is not necessary to normalize the functions to unity. In the example 
just given we could have required 

2 

/ (p n (x)<p m (x)dx — - — —8 nm , (10.61) 

J -1 2n + 1 

and the resulting set would have been the actual Legendre polynomials. Second, the sign of 
(p n is always indeterminate. In the example we chose the sign by requiring the coefficient 
of the highest power of x in the polynomial to be positive. For the Laguerre polynomials, 
on the other hand, we would require the coefficient of the highest power to be (—!)"/«! 


Exercises 


10.3.1 Rework Example 10.3.1 by replacing (p n (x ) by the conventional Legendre polynomial, 
P„(x): 

fjr„(x)] 2 dx = jA-p 

Using Eqs. (10.47a), and (10.49a), construct Pq , P\{x), and P 2 (x). 

ANS. Pq = 1, P\=x, P 2 = \x 2 -\. 

10.3.2 Following the Gram-Schmidt procedure, construct a set of polynomials P* (x) orthog¬ 
onal (unit weighting factor) over the range [0, 1] from the set [1, jc]. Normalize so that 

Pn( D=l. 

ANS. P*(x)= 1, 

P*(x) = 2x - 1, 

P* (x) — 6.r 2 — 6x + 1, 

P}(x) = 20.r 3 - 30.r 2 + I2x - 1. 

These are the first four shifted Legendre polynomials. 

Note. The “*”isthe standard notation for “shifted”: [0, 1] instead of [—1, 1]. It does not 
mean complex conjugate. 

10.3.3 Apply the Gram-Schmidt procedure to form the first three Laguerre polynomials 

u n (x)=x n , n — 0,1,2,..., 0<x<oo, w(x) — e~ x . 


The conventional normalization is 



Pm (x)L n (x)e dx — 8mn- 


ANS. Lq — 1, L ! = (1 — JC), 


Li — 


2 — 4x + x 2 


2 
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10.3.4 


10.3.5 


10.3.6 


10.3.7 


You are given 


(a) a set of functions u n (x) = x n ,n — 0, 1,2,..., 

(b) an interval (0, oo), 

(c) a weighting function w(x) = xe~ x . Use the Gram-Schmidt procedure to construct 
the first three orthonormal functions from the set u„(x ) for this interval and this 
weighting function. 

ANS. (po(x) — 1, q>\[x) — (x — (p 2 (x) — (x 2 — 6x + 6)/2v / 3- 

Using the Gram-Schmidt orthogonalization procedure, construct the lowest three Her- 
mite polynomials: 

_ 2 

u n (x) = x n , n— 0,1,2,..., —oo<x<oo, w(x)=e~ x . 

For this set of polynomials the usual normalization is 

H m {x)H n (x)w(x) dx — 8 mn 2 m m\jt 1 / 2 . 


£ 


ANS. 7/o=l, H\ — 2x, H 2 = 4x 2 - 2. 

Use the Gram-Schmidt orthogonalization scheme to construct the first three Chebyshev 
polynomials (type I): 

u n (x)—x n , n = 0,1,2,..., — 1<x<1, w(x) — (1 — x 2 ) *^ 2 . 

Take the normalization 


L 


T m (x)T n (x)w(x)dx — 8„ 


7T, 

It 


m = n — 0, 
m = n > 1. 


Hint. The needed integrals are given in Exercise 8.4.3. 

ANS. To =1, Ti=x, T 2 — 2x 2 — 1 (Tj= 4x 3 -3x). 

Use the Gram-Schmidt orthogonalization scheme to construct the first three Chebyshev 
polynomials (type II): 

u n (x)—x n , n = 0,1,2,..., —1<x<1, w(x) — (1 — x 2 ) +l ^. 

Take the normalization to be 

-I 


7r 


Hint. 


£ 


J U m (x)U n (x)w(x)dx=8 mn — 


(1 -x 2 f 2 x 2 "dx=*x l - 3 - 5 -- i2n - l) 


2 4 • 6 • 8 • • • (2 n + 2) 

n 
2 ’ 


n = 1,2,3,... 


n — 0. 


ANS. Uo = 1, U\ — 2x, U 2 — 4x 2 — 1. 
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10.3.8 As a modification of Exercise 10.3.5, apply the Gram-Schmidt orthogonalization pro¬ 
cedure to the set u n (x) — x n , n = 0,1,2,..., 0 < x < oo. Take w(x) to be exp[— x 2 ]. 
Find the first two nonvanishing polynomials. Normalize so that the coefficient of the 
highest power of .r is unity. In Exercise 10.3.5 the interval (—oo, oo) led to the Hermite 
polynomials. These are certainly not the Hermite polynomials. 

ANS.<po=l, <pi — x — 7t -1 / 2 . 

10.3.9 Form an orthogonal set over the interval 0 < x < oo, using u„(x) — e~ nx ,n — 
1,2, 3,... . Take the weighting factor, w(x), to be unity. These functions are solutions 
of m" — n 2 u„ — 0, which is clearly already in Sturm-Liouville (self-adjoint) form. Why 
doesn’t the Sturm-Liouville theory guarantee the orthogonality of these functions? 


10.4 Completeness of Eigenfunctions 


The third important property of an Hermitian operator is that its eigenfunctions form a 
complete set. This completeness means that any well-behaved (at least piecewise continu¬ 
ous) function F(x) can be approximated by a series 

OO 

F(x) = Ya n <p„(x) (10.62) 

n =0 


to any desired degree of accuracy. 10 More precisely, the set q> n (x) is called complete 1 1 if 
the limit of the mean square error vanishes: 


lim 

m—>oo 



m 

F(x) - y^a n (p n (x) 

n =0 


2 


vo{x) dx — 0. 


(10.63) 


Technically, the integral here is a Lebesgue integral. We have not required that the error 
vanish identically in [a, b] but only that the integral of the error squared go to zero. 

This convergence in the mean, Eq. (10.63), should be compared with uniform conver¬ 
gence (Section 5.5, Eq. (5.67)). Clearly, uniform convergence implies convergence in the 
mean, but the converse does not hold; convergence in the mean is less restrictive. Specifi¬ 
cally, Eq. (10.63) is not upset by piecewise continuous functions with only a finite number 
of finite discontinuities. A relevant example is the Gibbs phenomenon of discontinuous 
Fourier series discussed in Section 14.5, which occurs for other eigenfunction series as 
well. 

Equation (10.63) is perfectly adequate for our purposes and is far more convenient than 
Eq. (5.67). Indeed, since we frequently use eigenfunctions to describe discontinuous func¬ 
tions, convergence in the mean is all we can expect. 

In Eq. (10.62) the expansion coefficients a m may be determined by 

a m = f F(x)(p* n (x)w(x)dx. (10.64) 

J a 


10 If we have a finite set, as with vectors, the summation is over the number of linearly independent members of the set. 
11 Many authors use the term closed here. 
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This follows from multiplying Eq. (10.62) by <pf n (x)w(x) and integrating. From the or¬ 
thogonality of the eigenfunctions (p„ (x), only the with term survives. Here we see the value 
of orthogonality. Equation (10.64) may be compared with the dot or inner product of vec¬ 
tors, Section 1.3, and a m interpreted as the mth projection of the function F(x). Often the 
coefficient a m is called a generalized Fourier coefficient. 

For a known function F(x ), Eq. (10.64) gives a m as a definite integral that can always 
be evaluated, by computer if not analytically. 

In the language of linear algebra, we have a linear space, a function vector space. 
The linearly independent, orthonormal functions (p n (x ) form the basis for this (infinite¬ 
dimensional) space. Equation (10.62) is a statement that the functions (p n {x ) span this 
linear space. With an inner product defined by Eq. (10.64), our linear space is a Hilbert 
space. 

Setting the weight function w (x) — 1 for simplicity, completeness in operator form for 
a discrete set of eigenfunctions \q>j) becomes 


Y \ ( Pi)(<Pi\ = 1- 


Multiplying the completeness relation by F) we obtain the eigenfunction expansion 


\F) = Y\<Pi)(<Pi\F) 


with the generalized Fourier coefficient a, = {(p t \ F) . Equivalently in coordinate represen¬ 
tation. 


Y $ O'M (x) = S(x- y) 


implies 

F(x) = J F(y)8(x - y)dy = Y<PiW J <P*(y) F (y)dy■ 

i 

Without proof, we state that the spectrum of a linear operator A that maps a Hilbert 
space FI into itself may be divided into a discrete (or point) spectrum with eigenvectors of 
finite length, a continuous spectrum so that the eigenvalue equation An = /, v with v in FI 
does not have a unique bounded inverse (A — A ) -1 in a dense domain of H and a residual 
spectrum where (A — A) -1 is unbounded in a domain not dense in FI. 

The question of completeness of a set of functions is often determined by comparison 
with a Laurent series. Section 6.5. In Section 14.1 this is done for Fourier series, thus 
establishing the completeness of Fourier series. For all orthogonal polynomials mentioned 
in Section 10.3 it is possible to find a polynomial expansion of each power of z, 

n 

z" =^fl/P,(z), 

i =0 


(10.65) 
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where P, (z) is the /th polynomial. Exercises 12.4.6, 13.1.6, 13.2.5, and 13.3.22 are specific 
examples of Eq. (10.65). Using Eq. (10.65), we may reexpress the Laurent expansion of 
f(z) in terms of the polynomials, showing that the polynomial expansion exists (when it 
exists, it is unique. Exercise 10.4.1). The limitation of this Laurent series development is 
that it requires the function to be analytic. Equations (10.62) and (10.63) are more general. 
F(x) may be only piecewise continuous. Numerous examples of the representation of such 
piecewise continuous functions appear in Chapter 14 (Fourier series). A proof that our 
Sturm-Liouville eigenfunctions form complete sets appears in Courant and Hilbert. 12 

For examples of particular eigenfunction expansions, see the following: Fourier series. 
Section 10.2 and Chapter 14; Bessel and Fourier-Bessel expansions. Section 11.2; Legen¬ 
dre series. Section 12.3; Laplace series. Section 12.6; Hermite series. Section 13.1; La- 
guerre series. Section 13.2; and Chebyshev series. Section 13.3. 

It may also happen that the eigenfunction expansion, Eq. (10.62), is the expansion of an 
unknown F(x ) in a series of known eigenfunctions (p„(x ) with unknown coefficients a n . 
An example would be the quantum chemist’s attempt to describe an (unknown) mole¬ 
cular wave function as a linear combination of known atomic wave functions. The un¬ 
known coefficients a n would be determined by a variational technique — Rayleigh-Ritz, 
Section 17.8. 


Bessel’s inequality 

If the set of functions q> n (x.) does not form a complete set, possibly because we simply 
have not included the required infinite number of members of an infinite set, we are led 
to Bessel’s inequality. First, consider the finite case from vector analysis. Let A be an n 
component vector, 

A = ejai + e 2<?2 H-+ e„a„, (10.66) 

in which e, is a unit vector and a, is the corresponding component (projection) of A; that 
is. 


cii — A • e,-. 


(10.67) 


Then 



( 10 . 68 ) 


If we sum over all n components, the summation clearly, equals A by Eq. (10.66) and 
the equality holds. If, however, the summation does not include all n components, the 
inequality results. By expanding Eq. (10.68) and choosing the unit vectors so as to satisfy 
an orthogonality relation, 


e ; - • e j — 8jj , 


(10.69) 


'-R. Courant and D. Hilbert, Methods of Mathematical Physics (English translation), Vol. 1, New York: Interscience (1953), 
reprinted, Wiley (1989). Chapter 6, Section 3. 
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we have 


a 2 >E< 


This is Bessel’s inequality. 

For real functions we consider the integral 


rb r 

/ /<t) - 

J a L 


w ( x ) dx > 0. 


(10.70) 


(10.71) 


This is the continuum analog of Eq. (10.68), letting n —>■ oo and replacing the summation 
by an integration. Again, with the weighting factor w ( x ) > 0, the integrand is nonnegative. 
The integral vanishes by Eq. (10.62) if we have a complete set. Otherwise it is positive. 
Expanding the squared term, we obtain 

rb _ rb 

/ [/(*)] ~ w { x)dx — 2 E a i I f ( x )( pi ( x ) w ( x)dx + E af> 0. (10.72) 

J a . J a ■ 


Applying Eq. (10.64), we have 


rb 

/ [/(*)] w { x)dx > E a ?- 

J a 


(10.73) 


Hence the sum of the squares of the expansion coefficients a, is less than or equal to the 
weighted integral of [/(x)] 2 , the equality holding if and only if the expansion is exact, that 
is, if the set of functions ( p n ( x ) is a complete set. 

In later chapters, when we consider eigenfunctions that form complete sets (such as 
Legendre polynomials), Eq. (10.73) with the equal sign holding will be called a Parseval 
relation. 

Bessel’s inequality has a variety of uses, including proof of convergence of the Fourier 
series. 


Schwarz Inequality 

The frequently used Schwarz inequality is similar to the Bessel inequality. Consider the 
quadratic equation with unknown x : 

Y' ( a iX + bi) 2 = Y a ?( x + — I =0 (10.74) 

with real a,-, . If h, /cij = constant, c, that is, independent of the index i. then the solution 

is x = —c. If bj/ai is not a constant in i, all terms cannot vanish simultaneously for real x. 
So the solution must be complex. Expanding, we find that 

x 2 Y] a f + 2x E a ibi + E 

i i i 


(10.75) 



10.4 Completeness of Eigenfunctions 


653 


and since x is complex (or = —/a,), the quadratic formula 13 for .r leads to 

(10 - 76) 

\=1 / 'i=l ' \'=1 7 

the equality holding when /?, /a, equals a constant, independent of i. 

Once more, in terms of vectors, we have 

(a • b) 2 = a 2 b 2 cos 2 9 < ci 2 b 2 , (10.77) 


where 6 is the angle included between a and b. 

The analogous Schwarz inequality for complex functions has the form 


f 


f*(x)g(x)dx 


f f*(x)f{x)dx f g*(x)g(x)dx, 
J a J a 


(10.78) 


the equality holding if and only if g(x) — af(x ), a being a constant. To prove this function 
form of the Schwarz inequality, 14 consider a complex function ir(x) — f(x) + Xg(x) with 
X a complex constant, where / (x) and g(x) are any two square integrable functions (for 
which the integrals on the right-hand side exist). Multiplying by the complex conjugate 
and integrating, we obtain 


r*b nb rb rb 

/ i //*irdx= / f*fdx + X / f*gdx + X* / g*f dx 
Ja Ja Ja Ja 

■f 


(*b 

+ XX* I g*gdx > 0. 


(10.79) 


The > 0 appears since i jf*^r is nonnegative, the equal (=) sign holding only if \//(x) is iden¬ 
tically zero. Noting that X and X* are linearly independent, we differentiate with respect to 
one of them and set the derivative equal to zero to minimize \lr*\[r dx: 


j ^*irdx = J g* f dx + X J g*g dx — 0. 

This yields 

Iq8*fdx 

fa 8*8 dx 

Taking the complex conjugate, we obtain 

Iaf*8dx 

fa 8*8 dx 


(10.80a) 


(10.80b) 


Substituting these values of X and X * back into Eq. (10.79), we obtain Eq. (10.78), the 
Schwarz inequality. 


13 With negative (or zero) discriminant. 

14 An alternate derivation is provided by the inequality ff [/(-r)g(y) — /(y)g(-*)]*[/OOgCy) — fty)g(x)]dx dy > 0. 
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In quantum mechanics fix.) and g(x) might each represent a state or configuration of 
a physical system, that is, a linear combination of wave functions. Then the Schwarz in¬ 
equality gives an upper limit for the absolute value of the inner product j b f*(x)g(x) dx. 
In some texts the Schwarz inequality is a key step in the derivation of the Heisenberg 
uncertainty principle. 

The function notation of Eqs. (10.78) and (10.79) is relatively cumbersome. In advanced 
mathematical physics and especially in quantum mechanics it is common to use the Dirac 
bra-ket notation. Using this notation, we simply understand the range of integration, (a , b), 
and the presence of the weighting function w(x) > 0. In this notation the Schwarz inequal¬ 
ity takes the elegant form 

|(/lg>| 2 <(/l/>(g|g>- (78a) 

If g(x) is a normalized eigenfunction, <pj{x ), Eq. (10.78) yields (here w(x) = 1) 

a* a, < f f*(x)f(x) dx, (10.81) 

J a 

a result that also follows from Eq. (10.73). 

For useful representations of Dirac’s delta function in terms of orthogonal sets of func¬ 
tions and the relation between closure and completeness we refer to the relevant subsection 
of Section 1.15, including Exercise 1.15.16, and for coordinate versus momentum repre¬ 
sentations in quantum mechanics to Section 15.6. 

Summary—Vector Spaces, Completeness 

Here we summarize some properties of vector spaces, first with the vectors taken to be 
the familiar real vectors of Chapter 1 and then with the vectors taken to be ordinary func¬ 
tions. The concept of completeness has been developed for finite vector spaces (Chapter 1, 
Eq. (1.5)) and carries over into infinite vector spaces. For example, in three-dimensional 
Euclidean space every vector can be written in terms of a linear combination of the three 
coordinate unit vectors (representing a basis) involving the vector’s Cartesian components 
as the expansion coefficients. Or a periodic function of an infinite vector space can be ex¬ 
panded in terms of the set of periodic functions sinn;r, cos nx, n — 0,1,2,..., that form a 
basis of this space. Since any periodic function with reasonable properties (spelled out in 
Chapter 14) can be expanded in terms of these sine and cosine functions, they are complete 
and form a basis of such a linear function space. 

lv. We shall describe our vector space with a set of /? linearly independent vectors e,, 
i = 1,2,..., n. If n — 3, then ei = x, e 2 = y, and e 3 = z. The ne, span the linear vector 
space. 

If. We shall describe our vector (function) space with a set of n linearly independent 
functions, cp, (x), i = 0, 1,..., n — 1. The index i starts with 0 to agree with the labeling 
of the classical polynomials. Here (pi (x) is assumed to be a polynomial of degree i. The 
n<pi{x ) span the linear vector (function) space. 

2v. The vectors in our vector space satisfy the following relations (Section 1.2; the vector 
components are numbers); 
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a. Vector addition is commutative 

b. Vector addition is associative 

c. There is a null vector 

d. Multiplication by a scalar 
Distributive 
Distributive 
Associative 

e. Multiplication 
By unit scalar 
By zero 

f. Negative vector 


u + V = V + u 

[u + v] + w = u + [v + w] 

0 + v = v 

a[u + v] = flu + av 
(a + Z?)u = flu + Z?u 
a[bu] = (ab) u 

lu = u 

Ou = 0 
(-l)u =-u. 


21. The functions in our linear function space satisfy the properties listed for vectors 
(substitute “function” for “vector”): 


f(x) + g(x) = g(x) + f(x) 

[fix) + g(x)] + h(x) = f(x ) + [g(x) + h(x)] 
0 + fix) = fix) 
a[fix) + g(*)] = afix) + ag(x) 

(« + b)fix) = afix) + bfix) 
a[bfix)\ = (ab)f(x) 


1 • fix) = fix) 


0 - fix) = 0 


(-1 )■ fix) = -fix). 

3v. In n -dimensional vector space an arbitrary vector c is described by its n components 
(ci,c 2 ,...,c„).or 

n 

c =E^- 

i= 1 

When ntj (1) are linearly independent and (2) span the «-dimensional vector space, then 
the e, form a basis and constitute a complete set. 

3f. In n -dimensional function space a polynomial of degree m <n — 1 is described by 

n— 1 

fix) = £r, wW . 

<=0 

When the mpj(x) (1) are linearly independent and (2) span the «-dimensional function 
space, then the q>j (x) form a basis and constitute a complete set (for describing polynomi¬ 
als of degree m <n— 1). 

4v. An inner product (scalar, dot product) of a vector space is defined by 

n 

c-d= J^Cidi- 

i= 1 
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If c and d have complex components in an orthogonal coordinate system, the inner product 
is defined as ^" =1 c*dj . The inner product has the properties of 

a. Distributive law of addition c • (d + e) = cd + ce 

b. Scalar multiplication c • ad = ac ■ d 

c. Complex conjugation c • d = (d • c)*. 

4f. An inner product of a linear space of functions is defined by 
(f\g)= [ f*(x)g(x)w(x)dx. 

J a 

The choice of the weighting function w(x) and the interval ( a,b ) follows from the dif¬ 
ferential equation satisfied by (pt(x) and the boundary conditions — Section 10.1. In ma¬ 
trix terminology. Section 3.2, |g) is a column vector and (/1 is a row vector, the adjoint 
of |/}, where both may have infinitely many components. For example, if we expand 
g(x) = gi(pi(x ), then |g) has the / th component gj in a column vector and |/} has f* 
as its /th component in a row vector. 

The inner product has the properties listed for vectors: 


a. </ls + A> = (/ls> + </|A> 

b. if\ag} = a(f\g) 

c- (/|g> = («!/>*. 


5v. Orthogonality: 

e/ • tj =0, i j. 

If the ue, are not already orthogonal, the Gram-Schmidt process may be used to create 
an orthogonal set. 

5f. Orthogonality: 

( <Pi\<Pj)= <p*(x)<pj(x)w(x)dx = 0 , i^j. 

J a 

If the mpi (x) are not already orthogonal, the Gram-Schmidt process (Section 10.3) may be 
used to create an orthogonal set. 

6v. Definition of norm: 

/ n \ 1/2 

|C| = (c-c) 1/2 = (j2 c f) ■ 

'/=1 ' 

The basis vectors e, are taken to have unit norm (length) e, • e, = 1. The components of c 
are given by 

Ci = e, • c, / = 1,2,..., n. 


6f. Definition of norm: 

ll/ll = (/l /> 1/2 = 


r b 

/ i/wr 

.J a 


w(x) dx 


1/2 r ' 1-1 


-n — i 

Ei 

L f '=0 


1/2 
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Parseval’s identity. ||/|| >0 unless / (x ) is identically zero. The basis functions (pi (x) 
may be taken to have unit norm (unit normalization), 

M = i- 

The expansion coefficients of our polynomial fix) are given by 
Ci = {<Pi\f)> i =0,1, ...,n - 1. 

7v. Bessel’s inequality: 

c-c>£cf. 

i 

If the equals sign holds for all c, it indicates that the e,- span the vector space; that is, they 
are complete. 

7f. Bessel’s inequality: 

rb 

</!/}= / \f(x)\w(x)dx>Y^\ci\ 2 - 

Ja 

If the equals sign holds for all allowable /, it indicates that the cpj (x ) span the function 
space; that is, they are complete. 

8v. Schwarz’ inequality: 

|c • d| < |c| • |d|. 

The equals sign holds when c is a multiple of d. If the angle included between c and d is 
9, then | cos0| < 1. 

8f. Schwarz’ inequality: 

\(f\g)\<(f\f) l/2 (g\g) l/2 = 11/11 - 11 * 11 . 

The equals sign holds when f(x) and g(x ) are linearly dependent, that is, when f(pc) is a 
multiple of g(x). 

Now, let n -» oo, forming an infinite-dimensional linear vector space, I 2 . 

9v. In an infinite-dimensional space our vector c is 

OO 

c =£ c ' e '- 

i =1 

We require that 

OO 

£ c « 2 <°°- 

i=t 

The components of c are given by 

Ci = e, ■ c, i = 1,2,..., oo, 

exactly as in a finite-dimensional vector space. 

Then let n —> oo, forming an infinite-dimensional vector (function) space L 2 . Then L 
stands for Lebesgue, the superscript 2 for the quadratic norm, that is, the 2 in \f(x)\ 2 . Our 
functions need no longer be polynomials, but we do require that f(x) be at least piecewise 
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continuous (Dirichlet conditions for Fourier series) and that (f\f) = fj’ \f(x)\ 2 w(x)dx 
exist. This latter condition is often stated as a requirement that f(x) be square integrable. 

9f. Cauchy sequence (generalized Fourier expansion): Expand fix) = fi<Pi(x) 
and let 


n 

fn(x) = Yji<Pi(x). 

i=0 


If 


| f(x) - fn (a-) I —*■ 0 as n -* oo 


or 


lim 

n— >oo 


r n 
J f(x) - Y,fm(x) 

i =0 


2 

w(x) dx — 0, 


then we have convergence in the mean. This is analogous to the partial sum-Cauchy se¬ 
quence criterion for the convergence of an infinite series. Section 5.1. 

If every Cauchy sequence of allowable vectors (square integrable, piecewise continuous 
functions) converges to a limit vector in our linear space, the space is said to be complete. 
Then 


OO 

/(*) = E Ci (pi (x) (almost everywhere) 

i=0 

in the sense of convergence in the mean. As noted before, this is a weaker requirement than 
pointwise convergence (fixed value of x) or uniform convergence. 


Expansion Coefficients 

For a function / its expansion coefficients are defined as 

Ci — {<Pi\f), i— 0,1,..., oo, 
exactly as in a finite-dimensional vector space. Hence 

fix) = X>|/>,(*). 

i 

A linear space (finite- or infinite-dimensional) that (1) has an inner product defined 
i(f\g }) and (2) is complete is a Hilbert space. 

Infinite-dimensional Hilbert space provides a natural mathematical frame-work for mod¬ 
ern quantum mechanics. Away from quantum mechanics, Hilbert space retains its abstract 
mathematical power and beauty and has many uses. 
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Exercises 

10.4.1 


10.4.2 


10.4.3 


10.4.4 


A function fix) is expanded in a series of orthonormal eigenfunctions 

OO 

fix) = y ^a n <Pnix). 

n =0 

Show that the series expansion is unique for a given set of (p„(x ). The functions (p n {x ) 
are being taken here as the basis vectors in an infinite-dimensional Hilbert space. 

A function fix) is represented by a finite set of basis functions (piix), 

N 

fix) = Y,Ci<Pi(x). 

i= 1 

Show that the components c, are unique, that no different set c'- exists. 

Note. Your basis functions are automatically linearly independent. They are not neces¬ 
sarily orthogonal. 

A function fix) is approximated by a power series YIZo c ‘ x ' over ^ le interval [0, 1], 
Show that minimizing the mean square error leads to a set of linear equations 

Ac = b, 


where 


and 


Ajj — f x l+ i dx — 

Jo 


i + j + 1 


i, j = 0,1,2,..., n — 1 




bj = / x'f(x)dx, i = 0, 1, 2,..., n — 1. 


Note. The Ajj are the elements of the Hilbert matrix of order n. The determinant of this 
Hilbert matrix is a rapidly decreasing function of n. For n — 5, det A = 3.7 x 10“ 12 and 
the set of equations Ac = b is becoming ill-conditioned and unstable. 


In place of the expansion of a function Fix) given by 


OO 

Fix) = y ]a n <Pnix), 

n =0 


with 

f h 

a n = I F(x)(p n (x)w(x) dx, 

Ja 

take the finite series approximation 


m 

Fix) ^y^CnCPnjx). 
12=0 
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Show that the mean square error 



m 2 

F(x) - Y.CnVn jx) 

n =0 


w(x) dx 


is minimized by taking c n = a n . 

Note. The values of the coefficients are independent of the number of terms in the finite 
series. This independence is a consequence of orthogonality and would not hold for a 
least-squares fit using powers of x. 


10.4.5 


From Example 10.2.2, 


r h 


fix) = 


2 ’ 

h 

_ 2 ’ 


0 < x < it 
— 7 X < X < 0 


2/z sin(2n + \)x 

jt 2n + 1 

n =0 


(a) Show that 

f n r -,2 jt , 4/z 2 _ 9 

/ [fix)] dx = —h 2 — -^(2m + 1) 2 . 

J ~ n z n n=o 

For a finite upper limit this would be Bessel’s inequality. For the upper limit oo, 
this is Parseval’s identity. 

(b) Verify that 



4/z 2 ~ 

-V(2n + 1) 

ix 

n =0 


-2 


by evaluating the series. 


10.4.6 


10.4.7 


10.4.8 


Hint. The series can be expressed as the Riemann zeta function. 
Differentiate Eq. (10.79), 

{M) = {f\f)+Mf\8)+X*{g\f)+M*{g\8), 


with respect to X* and show that you get the Schwarz inequality, Eq. (10.78). 


Derive the Schwarz inequality from the identity 


f 

y a 


fix)gix)dx 


f [fix)fdx f [g(.x)]" 
J a J a 


dx 


-If f [f ix)giy) - f iy)gix )] 2 dx dy. 

^ Ja Ja 


If the functions f(x) and g(x) of the Schwarz inequality, Eq. (10.78), may be expanded 
in a series of eigenfunctions xp\(x ), show that Eq. (10.78) reduces to Eq. (10.76) (with 
n possibly infinite). 
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Note the description of f(pc ) as a vector in a function space in which tp/ (x) corresponds 
to the unit vector ei. 

10 . 4.9 The operator H is Hermitian and positive definite; that is, for all /: 

rb 


J a 


f*Hf dx > 0. 


Prove the generalized Schwarz inequality; 


f b f*Hgdx < f b f*Hfdx f g* Hg dx. 
J a J a J a 


10 . 4.10 A normalized wave function ir(x) — a n<Pn (-v ) . The expansion coefficients a„ are 
known as probability amplitudes. We may define a density matrix p with elements p\j — 
a;a*,. Show that 

j 

(■ P 2 )ij = PiJ • 


or 


P 


2 


= p. 


This result, by definition, makes p a projection operator. 
Hint: Use 


J ijf* i/r d x — 1. 


10 . 4.11 Show that 


(a) the operator 

\(Pi(x)){(pi(t)\ 


operating on 


j 


yields 


Ci\<Pi(x)). 


(t>) = l 

i 

This operator is a projection operator projecting f(x) onto the / th coordinate, 
selectively picking out the /th component (x)> of f(x). 


Hint. The operator operates via the well-defined inner product. 
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10.5 Green’s Function—Eigenfunction Expansion 


A series somewhat similar to that representing S(x — t) results when we expand the Green’s 
function in the eigenfunctions of the corresponding homogeneous equation. In the inhomo¬ 
geneous Helmholtz equation we have 

(10.82) 

The homogeneous Helmholtz equation is satisfied by its orthonormal eigenfunctions (p n , 

V 2 ftW + 4(r) = 0. (10.83) 

As outlined in Section 9.7, the Green’s function G(ri, r 2 ) satisfies the point source equa¬ 
tion 

(10.84) 

and the boundary conditions imposed on the solutions of the homogeneous equation. Be¬ 
cause G is real, we expand the Green’s function in a series of real eigenfunctions of the 
homogeneous equation (10.83); that is, 

OO 

G(rt,r 2 ) = ^^(rzMArj), (10.85) 

n =0 

and by substituting into Eq. (10.84) we obtain 

OO OO OO 

- '^a n (r 1 )k 2 l (p n {r\) + k 2 ^fl„(r 2 )p„(ri) = - ^ <p„(ri)<p„(r 2 ). (10.86) 

n =0 n =0 n =0 

Here <5(ri — r 2 ) has been replaced by its eigenfunction expansion, Eq. (1.190). When we 
employ the orthogonality of (p n ( ri) to isolate «„. this yields 

OO , OO , 

a m (r 2 )(k 2 - k 2 m ) / (p n (ri)(p m (ri)d 3 n = - ^y m (r 2 ) / <p„(ri)<p m (ri)d 3 ri, 

m =0 J m =0 J 

or 

a„(r 2 )(k 2 -k 2 ) = -<p„( r 2 ). 




Then substituting this into Eq. (10.85), the Green’s function becomes 

E °° cMri)c£>„(r 2 ) 

. (10.87) 

„=o k "~ k ~ 

a bilinear expansion, symmetric with respect to ri and r 2 , as expected. Finally, i// (r i), the 
desired solution of the inhomogeneous equation, is given by 

( 10 . 88 ) 
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If we generalize our inhomogeneous differential equation to 

Cxjf + Xx[r — — p, (10.89) 

where £ is a Hermitian operator, we find that 


G(ri,r 2 ) = V yn(ri) ^ (r2) , (10.90) 

X n — X 

n =0 

where X n is the nth eigenvalue and <p n is the corresponding orthonormal eigenfunction of 
the homogeneous differential equation 

£t/r + kt/r = 0. (10.91) 


The eigenfunction expansion of the Green’s function in Eq. (10.90) makes the symmetry 
property G(ri, r 2 ) = G(r 2 , ri) explicit and is often useful when comparing with solutions 
obtained by other means. 


Green’s Functions — One-Dimensional 


The development of the Green’s function for two- and three-dimensional systems was the 
topic discussed in the preceding material and in Section 9.7. Here, for simplicity, we restrict 
ourselves to one-dimensional cases and follow a somewhat different approach. 

Defining Properties 

In our one-dimensional analysis we consider first the inhomogeneous equation 

Cy{x) + fix) = 0, (10.92) 

in which £ is the self-adjoint differential operator 

d ( d \ 

£= -j-( PW-j- ) + <?(•*)• (10.93) 

Cl JC \ Cl JC J 

As in Section 10.1, y (x) is required to satisfy certain boundary conditions at the endpoints 
a and b of our interval [«, /;]. 

We now proceed to define a rather strange and arbitrary function G over the interval 
[a,b]. At this stage the most that can be said in defense of G is that the defining prop¬ 
erties are legitimate, or mathematically acceptable. Later, G will appear as a reasonable 
tool for obtaining solutions of the inhomogeneous ODE, Eq. (10.92); this role dictates its 
properties. 


1. The interval a < x < b is divided by a parameter t. We label G (x) = G \ (x ) for a < 
x < t and G(x) = G 2 (x) for t < x < b. 

2. The functions G\ (x) and G 2 (x) each satisfy the homogeneous 15 equation; that is. 


£Gj(x) = 0, a<x<t, 
£G 2 (x) = 0, t<x<b. 


(10.94) 


1 ^ Homogeneous with respect to the unknown function. The function fix) in Eq. (10.92) is set equal to zero. 
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3. At x = a , G i (x) satisfies the boundary conditions we impose on _y (x ). a solution of 
the inhomogeneous ODE, Eq. (10.92). At x — b, GTCr) satisfies the boundary condi¬ 
tions imposed on y (x ) at this endpoint of the interval. For convenience, the boundary 
conditions are taken to be homogeneous; that is, at x — a, 

y(a ) = 0, or y\a) = 0, or ay (a) + fiy'(a) — 0 

and similarly at x — b. 

4. We demand that G(x) be continuous , 16 


lim Gi(x)= lim Go(x). 

x-s-r_ .r-s-4 


(10.95) 


5. We require that G'(x) be discontinuous, specifically that 15 


(10.96) 


where p(t) comes from the self-adjoint operator, Eq. (10.93). Note that with the first 
derivative discontinuous, the second derivative does not exist. 


These requirements, in effect, make G a function of two variables, G(x,t). Also, we 
note that G(x,t) depends on both the form of the differential operator £ and the boundary 
conditions that y(x) must satisfy. Note that we have described the properties of Green’s 
functions for second-order differential equations. Note that for Green’s functions for first- 
order differential equations, the discontinuities arise in G itself. 

Now, assuming that we can find a function G(x,t) that has these properties, we label it 
a Green’s function and proceed to show that a solution of Eq. (10.92) is 

y(x)= [ G(x,t)f(t)dt. (10.97) 

J a 

To do this we first construct the Green’s function G(x, t). Let u(x) be a solution of the 
homogeneous equation that satisfies the boundary conditions at x — a, and let v(x) be a 
solution that satisfies the boundary conditions at x—b. Then we may take 17 

I ciw(x), a <x < t, 

(10.98) 

C'2V(x), t < X < b. 

Continuity at x — t (Eq. (10.95)) requires 

civit) — c\u(t) — 0. (10.99) 

Finally, the discontinuity in the first derivative (Eq. (10.96)) becomes 

, . 1 

c 2 v (t) - c x u(t) = -. (10.100) 

Pit) 


16 Strictly speaking, this is the limit as x —> t. 

17 The “constants” c\ and C 2 are independent of x, but they may (and do) depend on the other variable, t. 
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There will be a unique solution for our unknown coefficients ci and c 2 if the Wronskian 
determinant 


u(t) 

u'(t) 


v(t) 

v'(t) 


= u(t)v'(t) — v(t)u'(t) 


does not vanish. We have seen in Section 9.6 that the nonvanishing of this determinant is 
a necessary condition for linear independence. Let us assume u(x) and v(x ) to be inde¬ 
pendent. (If u(x) and v(x) are linearly dependent, the situation becomes more complicated 
and is not considered here. See Courant and Hilbert in Additional Readings of Chapter 9.) 
For independent it(x) and v(x) we have the Wronskian (again from Section 9.6 or Exer¬ 
cise 10.1.4) 

. , A 

u(t)v'(t) - v(t)u(t) =-, (10.101) 

Pit) 

in which A is a constant. Equation (10.101) is sometimes called Abel’s formula. Numerous 
examples have appeared in connection with Bessel and Legendre functions. Now, from 
Eq. (10.100), we identify 


v(t ) u(t) 

Cl =-—, C2 — 


( 10 . 102 ) 


A - A 

Equation (10.99) is clearly satisfied. Substitution into Eq. (10.98) yields our Green’s func¬ 
tion 


G(x,t) = 


1 

— u(x)v (t), 
A 

1 

— u(t) v(x), 
A 


a <x < t, 
t <x < b. 


(10.103) 


Note that G(x , t) — G(t, x). This is the symmetry property that was proved earlier in Sec¬ 
tion 9.7. Its physical interpretation is given by the reciprocity principle (via our propagator 
function) — a cause at t yields the same effect at x as a cause at x produces at t. In terms 
of our electrostatic analogy this is obvious, the propagator function depending only on the 
magnitude of the distance between the two points: 


l*T -r 2 | = |r 2 — ri|. 


Green’s Function Integral — Differential Equation 

We have constructed G{x, t), but there still remains the task of showing that the integral 
(Eq. (10.97)) with our new Green’s function is indeed a solution of the original differential 
equation (10.92). This we do by direct substitution. With G (x, t) given by Eq. (10.103), 18 
Eq. (10.97) becomes 

1 r x 1 C h 

v(x) =-/ v(x)u(t)f(t)dt -/ u(x)v(t)f(t)dt. (10.104) 

A J a A J x 


18 In the first integral, a <t <x. Hence G(x, t ) = G 2 (x, t ) = —(1 /A)u(t)v(x). Similarly, the second integral requires G = G\. 
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Differentiating, we obtain 

1 r x 1 r b 

y (x) =-/ v\x)u(t) f (t) dt -/ u\x)v{t)f(t)dt , (10.105) 

A J a A J x 

the derivatives of the limits canceling. A second differentiation yields 

1 r x „ 1 r b 

y"(x) — -/ v (x)u(t)f(t)dt -/ u"(x)v(t)f(t)dt 

A J a A J x 

- [u(x) v\x) — v(x)u'(x)\f(x). (10.106) 

A 

By Eqs. (10.100) and (10.102) this may be rewritten as 

y"(x) = —— 7 — f u{t)f{t)dt- U -^~ f v(t) f (?) dt ~~ 7 ~T‘ (10.107) 

A Ja A J x p(x) 

Now, by substituting into Eq. (10.93), we have 

Cy(x) = - —I u(t)f(t)dt - —I v(t)f(t)dt-f(x). (10.108) 


Since u(x) and tTv) were chosen to satisfy the homogeneous equation, the £-factors are 
zero and the integral terms vanish, and we see that Eq. (10.92) is satisfied. 

We must also check that y (x) satisfies the required boundary conditions. At point x — a. 


u(a ) f b 

y(a) — - -A v(t)f(t)dt = cu(a ), (10.109) 

A J a 

u '( a ) r b 

y'(a) = -/ v(t)f(t)dt = cu'(a), (10.110) 

A J a 

since the definite integral is a constant. We chose nix) to satisfy 

au(a) + f}u'(a) — 0. (10.111) 


Multiplying by the constant c, we verify that y(x) also satisfies Eq. (10.111). This illus¬ 
trates the utility of the homogeneous boundary conditions: The normalization does not 
matter. In quantum mechanical problems the boundary condition on the wave function is 
often expressed in terms of the ratio 


i /r (x) d d , a 

- = —lni/r(.r), compared to — lnt<(x) _ =- 

i jf{x) dx dx x ~ a 

Eq. (10.111). The advantage is that the wave function need not be normalized 
Summarizing, we have Eq. (10.97), 


yet. 


y(A-)= f G(x,t)f(t)dt, 


which satisfies the differential equation (Eq. (10.92)), 

Cy(x) + f(x) = 0, 
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and the boundary conditions, these boundary conditions having been built into the Green’s 
function, G(x,t). 

Basically, what we have done is to use the solutions of the homogeneous equation 
Eq. (10.94) to construct a solution of the inhomogeneous equation. Again, Poisson’s equa¬ 
tion is an illustration. The solution (Eq. (9.148)) represents a weighted \p(xi)] combination 
of solutions of the corresponding homogeneous Laplace’s equation. (We followed these 
same steps early in this section.) 

It should be noted that our y(x), Eq. (10.97), is actually the particular solution of the 
differential equation, Eq. (10.92). Our boundary conditions exclude the addition of so¬ 
lutions of the homogeneous equation. In an actual physical problem we may well have 
both types of solutions. In electrostatics, for instance (compare Section 9.7), the Green’s 
function solution of Poisson’s equation gives the potential created by the given charge dis¬ 
tribution. In addition, there may be external fields superimposed. These would be described 
by solutions of the homogeneous equation, Laplace’s equation. 


Eigenfunction, Eigenvalue Equation 

The preceding analysis placed no special restrictions on our f(x). Let us now assume that 
f(x) — Ap(x)y(x). ] ‘ > Then we have 

y(x) — X f G{x,t)p(t)y(t)dt (10.112) 

J a 

as a solution of 

Cy(x) + kp(x)y(x) = 0 (10.113) 

and its boundary conditions. Equation (10.112) is a homogeneous Fredholm integral equa¬ 
tion of the second kind, and Eq. (10.113) is the homogeneous eigenvalue equation (with 
the weighting function w(x ) replaced by p(x)). 

There is a change in the interpretation of our Green’s function. It started as a propagator 
function, a weighting function giving the importance of the charge p(r 2 ) in producing 
the potential ^(iq). The charge p was the inhomogeneous term in the inhomogeneous 
differential equation (10.92). Now the differential equation and the integral equation are 
both homogeneous. G(x, t ) has become a link relating the two equations, differential and 
integral. 

To complete the discussion of this differential equation-integral equation equivalence, 
let us now show that Eq. (10.113) implies Eq. (10.112), that is, that a solution of our 
differential equation (10.113) with its boundary conditions satisfies the integral equa¬ 
tion (10.112). We multiply Eq. (10.113) by G(x, /), the appropriate Green’s function, and 
integrate from x — a to x — b to obtain 

nb pb 

/ G(x, t)Cy{x) dx + A. / G(x,t)p(x)y(x)dx — 0. (10.114) 

J a J a 


^The function p(x) is some weighting function, not a charge density. 
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The first integral is split in two (x < t,x > t ), according to the construction of our Green’s 
function, giving 


/' 


G\(x, t)Cy(x)dx • 


r 


w 


G 2 (x, t)Cy(x) dx = X I G(x, t)p(x)y(x) dx. (10.115) 


Note that t is the upper limit for the G i integrals and the lower limit for the G 2 integrals. 
We are going to reduce the left-hand side of Eq. (10.115) to y(t). Then, with G(x, t) — 
G(t, x ), we have Eq. (10.112) (with x and t interchanged). 

Applying Green’s theorem to the left-hand side or, equivalently, integrating by parts, we 
obtain 


-S' 


G\{t, x) 


d 

dx 




+ q(x)y(x) 


dx 


= -[Giix,t)p(x)y , (x)]\*J a + j (-^Gi(x.t)\p(x)y'(x)dx 


/' 


G\{x,t)q(x)y{x)dx , (10.116) 

with an equivalent expression for the second integral. A second integration by parts yields 


■/' 


Gi(x, t)Cy(x)dx — 


-S' 


y{x)CG\{x, t ) dx 


- [Gi(x,t)p(x)y'(x)]\ x x J a 
+ [G\{x,t)p{x)y{xj\\ x x Z‘ a . (10.117) 


The integral on the right vanishes because CG\ — 0. By combining the integrated terms 
with those from integrating G 2 , we have 


-Pit) 


d 9 

G l {t,t)y\t)-y{t) — G l {x,t)\ x=t -G 2 {t,t)y'{t) + y{t) — G 1 {x,t)\ x=t 


dx 


+ p(a ) 
- p(b) 


9 


y'(a)Gi(a, t ) - y(a) — G\{x, t)\ x=a 
G 2 (b,t)y'(b) - y(b)^-G 2 (x,t)\ x=b 


(10.118) 


Each of the last two expressions vanishes, for G(x, t ) and y (x) satisfy the same boundary 
conditions. The first expression, with the help of Eqs. (10.95) and (10.96), reduces to y(t). 
Substituting into Eq. (10.115), we have Eq. (10.112), thus completing the demonstration 
of the equivalence of the integral equation and the differential equation plus boundary 
conditions. 


Example 10.5.1 Linear Oscillator 

As a simple example, consider the linear oscillator equation (for a vibrating string): 

y"{x) + A ,y(x) — 0. 


(10.119) 
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We impose the conditions 37 ( 0 ) = y(l) = 0, which correspond to a string clamped at both 
ends. Now, to construct our Green’s function, we need solutions of the homogeneous equa¬ 
tion Cy(x ) = 0, which is y" (x ) = 0. To satisfy the boundary conditions, we must have one 
solution vanish at x — 0, the other at x — 1. Such solutions (unnormalized) are 

u(x) — x, v(x) = l—x. (10.120) 


We find that 


uv' — vu' — — 1 

or, by Eq. (10.101) with p(x) = 1, A = — 1. Our Green’s function becomes 

I x (1 — t), 0 < x < t, 

t (1 — x), t < x < 1. 

Hence by Eq. (10.112) our clamped vibrating string satisfies 


y(x) 


-*/' 


G(v, t)y(t) dt. 


( 10 . 121 ) 


( 10 . 122 ) 


(10.123) 


You may show that the known solutions of Eq. (10.119), 

y — siniurx, X — n 2 n 2 , 

do indeed satisfy Eq. (10.123). Note that our eigenvalue X is not the wavelength. 


Green’s Function and the Dirac Delta Function 


One more approach to the Green’s function may shed additional light on our formulation 
and particularly on its relation to physical problems. Let us refer once more to Poisson’s 
equation, this time for a point charge: 

V 2 <p(r) = — Ppoint (10.124) 

£ o 

The Green’s function solution of this equation was developed in Section 9.7. This time let 
us take a one-dimensional analog 


£y(x) + /(x)point = 0. 


(10.125) 


Here /(v)p 0m t refers to a unit point “charge,” or a point force. We may represent it by a 
number of forms, but perhaps the most convenient is 


f (X (point : 


1 

2 e ’ 

0 , 


t — E < X < t + S, 

elsewhere. 


(10.126) 


which is essentially the same as Eq. (1.172). Then, integrating Eq. (10.125), we have 


Pt-\-S /*/+£ 

/ Cy(x)dx = - I f (x)point dx — (10.127) 

Jt—s Jt—e 
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from the definition of f(x). Let us examine Cy{x) more closely. We have 

(*t-\-s j rt-\-s 


t d r » f t+£ 

/ — \p{x)y (x)\dx + / q(x)y(x)dx 

J r-e dx L ' 

/*?+£ 

= + / q(x)y{x)dx = -1. 

«/ r—£ 


(10.128) 


In the limit e —>■ 0 we may satisfy this relation by permitting y'(x) to have a discontinu¬ 
ity of —1 / p(x) at x = t, y(x) itself remaining continuous. 20 These, however, are just the 
properties used to define our Green’s function, G(x, t). In addition, we note that in the 
limit e —> 0, 


/« P oint = S(x-f), (10.129) 

in which <5(x — f) is our Dirac delta function, defined in this manner in Section 1.15. Hence 
Eq. (10.125) has become 

CG(x,t) = -8(x -t). (10.130) 

This is a one-dimensional version of Eq. (9.159), which we exploit for the development of 
Green’s functions in two and three dimensions — Section 9.7. It will be recalled that we 
used this relation in Section 9.7 to determine our Green’s functions. 

Equation (10.130) could have been expected since it is actually a consequence of our 
differential equation, Eq. (10.92), and Green’s function integral solution, Eq. (10.97). If 
we let C x (subscript to emphasize that it operates on the x-dependence) operate on both 
sides of Eq. (10.97), then 

C x y{x) = C x f G(x, t)f (?) dt. 

Ja 

By Eq. (10.92) the left-hand side is just —f(x). On the right C x , is independent of the 
variable of integration t, so we may write 

f h 

-/(*)= / {C x G{x,t)}f{t)dt. 

J a 

By definition of Dirac’s delta function, Eqs. (1.171b) and (1.183), we have Eq. (10.130). 


Exercises 


10 . 5.1 


Show that 

I x, 0 < x < t, 

t, t < x < 1, 

is the Green’s function for the operator C = dr /dx 2 and the boundary conditions 

v (0) = 0, /(l) = 0. 


-°The functions p(x) and q(x) appearing in the operator C are continuous functions. With y(x) remaining continuous, 
f q(x)y(x) dx is certainly continuous. Hence this integral over an interval 2 s (Eq. (10.128)) vanishes as s vanishes. 
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10 . 5.2 Find the Green’s function for 


(a) 

(b) 


Cy(x) = 
Cy(x) = 


d 2 y(x) 
dx 2 
d 2 y(x) 
dx 2 


+ y(x), 
- y(x), 


| y(0) = o, 

1/(1) = o. 

y(x) finite for —oo < x < oo. 


10 . 5.3 Find the Green’s function for the operators 


(a) 


Cy(x) = 


d / dy{x)\ 
dx \ dx ) 


ANS. G(x,t) = 


— lnr, 

— lnx, 


0 <x < t, 
t < x < 1. 


(b) 


Cy(x) 


d / dy(x)\ 
dx V dx ) 


n 

— v(x), with y(0) finite and y(l) = 0. 
x 


ANS. G(x,t) = 



0 <x <t, 
t < x < 1. 


The combination of operator and interval specified in Exercise 10.5.3(a) is pathological, 
in that one of the endpoints of the interval (zero) is a singular point of the operator. As 
a consequence, the integrated part (the surface integral of Green’s theorem) does not 
vanish. The next four exercises explore this situation. 

10 . 5.4 (a) Show that the particular solution of 

d 

dx 


yp(x) — —x^ f G(x,t)(—\)dt, 

Jo 

where G(x, t) is the Green’s function of Exercise 10.5.3(a). 


x-^-y(x) 

dx 




is yp(x) — —x. 
(b) Show that 


10 . 5.5 


Show that Green’s theorem, Eq. (1.104) in one dimension with a Sturm-Liouville-type 
operator (d/dt)p(t)(d/dt) replacing V • V, may be rewritten as 


A 


u(t) — [ p(t) 
at 


dv(t) 




dt ) 


t s d 

m 7t 


P(t) 


du(t)\ 
dt 




dt 


nit) pit) 


dvit) 

dt 


- v (t)p{t) 


duit) 

dt 


b 

a 
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10 . 5.6 


10 . 5.7 


10 . 5.8 


10 . 5.9 


10 . 5.10 


10 . 5.11 


Using the one-dimensional form of Green’s theorem of Exercise 10.5.5, let 


v(t) = y(t) 


u(t) — G(x,t ) 


and 




dt 


dt ) 


and — pit) 
dt 


dG(x,t) 
dt 


fit). 


= —S(x — t ). 


Show that Green’s theorem yields 
r b 


y(x) 


- 

J a 


G(x, t)f{t)dt + 


dy{t) 3 

G(x, t)p(t)— - y(t)p(t)—G(x, t) 


G(x, t) — 


For p(t) = t, y(t) = —t, 

— In t, 
— In.r, 

verify that the integrated part does not vanish. 
Construct the Green’s function for 

2 d 2 y dy 


dt 

0 < x < t 
t < x < 1, 


dt 


t=b 


^ + ,g + ( *V-,),=o. 


subject to the boundary conditions 

v(0) = 0, 

Given that 


y(i) = o. 




d~ d 
dx 2 "" dx 


and 


G(±l, t) remains finite, 

show that no Green’s function can be constructed by the techniques of this section. (u(x) 
and v(x) are linearly dependent.) 

Construct the one-dimensional Green’s function for the Helmholtz equation 

(^2 + = <?(•*) • 

The boundary conditions are those for a wave advancing in the positive x-direction — 
assuming a time dependence e~' wt . 

ANS. G(x\, xf) = — exp(/A:|.ri — X 2 I). 

Construct the one-dimensional Green’s function for the modified Helmholtz equation 

(-j ~2 ~ k 2 ^Jf(x) = fix). 
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The boundary conditions are that the Green’s function must vanish for x -* oo and 


x —> —oo. 


ANS. G(x i,*2) = — exp(— k\x\ — X 2 \). 


10 . 5.12 From the eigenfunction expansion of the Green’s function show that 


2 sin rmx sin mzt [ x(l — t), 0 <x <t, 

(a) — -2-= 1 

^ n 11 ( 1 -*), *<*< 1 . 


2 ^ sin(n + )f)nx sin(n + ^)nt [ x, 0 <x<t, 
<b) 1 \2 = I . ___ 


(n + k¥ 


t, t < x < 1. 


Note. In Section 10.4 the Green’s function of C + X is expanded in eigenfunctions. The 
X there is an adjustable parameter, not an eigenvalue. 


10 . 5.13 In the Fredholm equation, 


f(x) — X~ / G(x,t)<p(t)dt, 


G(x,t) is a Green’s function given by 


G(x,t) = J2 


<Pn(x)<p n (t) 

x 2 -x 2 ■ 


Show that the solution is 


00 X 2 — X 2 c D 

<p(x) = ^ - <Pn(x) j f(t)(p„(t)dt. 


10 . 5.14 Show that the Green’s function integral transform operator 


G(x, f)[ ] dt 


is equal to —C 1 , in the sense that 


(a) C x / G(x,t)y(t)dt = -y(x), 


(b) / G(x,t)£ t y(t)dt = —y(x). 


Note. Take Cy(x) + fix) — 0, Eq. (10.92). 

10 . 5.15 Substitute Eq. (10.87), the eigenfunction expansion of Green’s function, into Eq. (10.88) 
and then show that Eq. (10.88) is indeed a solution of the inhomogeneous Helmholtz 
equation (10.82). 
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10.5.16 


(a) 


Starting with a one-dimensional inhomogeneous differential equation (Eq. (10.89)), 
assume that i j/(x) and p{x) may be represented by eigenfunction expansions. 
Without any use of the Dirac delta function or its representations, show that 


if(x) = ^ 

n =0 


fa p(t)<p„(t)dt 

hfl A 


<Pn(x). 


Note that (1) if p — 0, no solution exists unless X — X„ and (2) if X — no 
solution exists unless p is orthogonal to (p n . This same behavior will reappear with 
integral equations in Section 16.4. 

(b) Interchanging summation and integration, show that you have constructed the 
Green’s function corresponding to Eq. (10.90). 


10.5.17 The eigenfunctions of the Schrodinger equation are often complex. In this case the 
orthogonality integral, Eq. (10.40), is replaced by 

cp* ( x)(pj (x) w(x)clx — S,j. 

Instead of Eq. (1.189), we have 



OO 

<5(ri — r 2 ) = ^<p«(ri)<p*(r 2 ). 

n =0 


Show that the Green’s function, Eq. (10.87), becomes 


C(r|.r 2 ) = 

n =0 


<P„(ri)(p*(r 2 ) 

k'n - k 2 


G*(r 2 ,n). 


Additional Readings 


Byron, F. W., Jr., and R. W. Fuller, Mathematics of Classical and Quantum Physics. Reading, MA: Addison- 
Wesley (1969). 

Dennery, R, and A. Krzywicki, Mathematics for Physicists. Reprinted. New York: Dover (1996). 

Hirsch, M., Differential Equations, Dynamical Systems, and Linear Algebra. San Diego: Academic Press (1974). 
Miller, K. S., Linear Differential Equations in the Real Domain. New York: Norton (1963). 

Titchmarsh, E. C., Eigenfunction Expansions Associated with Second-Order Differential Equations, 2nd ed., 
Vol. 1. London: Oxford University Press (1962), Vol. II (1958). 



Chapter 11 


Bessel Functions 


11.1 Bessel Functions of the First Kind, J v (x) 

Bessel functions appear in a wide variety of physical problems. In Section 9.3, separa¬ 
tion of the Helmholtz, or wave, equation in circular cylindrical coordinates led to Bessel’s 
equation. In Section 11.7 we will see that the Helmholtz equation in spherical polar co¬ 
ordinates also leads to a form of Bessel’s equation. Bessel functions may also appear in 
integral form — integral representations. This may result from integral transforms (Chap¬ 
ter 15) or from the mathematical elegance of starting the study of Bessel functions with 
Hankel functions. Section 11.4. 

Bessel functions and closely related functions form a rich area of mathematical analysis 
with many representations, many interesting and useful properties, and many interrela¬ 
tions. Some of the major interrelations are developed in Section 11.1 and in succeeding 
sections. Note that Bessel functions are not restricted to Chapter 11. The asymptotic forms 
are developed in Section 7.3 as well as in Section 11.6. The confluent hypergeometric 
representations appear in Section 13.5. 

Generating Function for Integral Order 

Although Bessel functions are of interest primarily as solutions of differential equations, it 
is instructive and convenient to develop them from a completely different approach, that of 
the generating function. 1 This approach also has the advantage of focusing on the functions 
themselves rather than on the differential equations they satisfy. Let us introduce a function 
of two variables, 

g(x,f) = e (x/2)(? “ 1/0 . (11.1) 

1 Generating functions have already been used in Chapter 5. In Section 5.6 the generating function (1 + x) n was used to derive 
the binomial coefficients. In Section 5.9 the generating function x(e x — 1) —1 was used to derive the Bernoulli numbers. 
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Expanding this function in a Laurent series (Section 6.5), we obtain 


oo 

e (*/2)(f-l/r) = j n{x)t \ 

72——OO 


( 11 . 2 ) 


It is instructive to compare Eq. (11.2) with the equivalent Eqs. (11.23) and (11.25). 

The coefficient of t n , J„ (x), is defined to be a Bessel function of the first kind, of integral 
order n. Expanding the exponentials, we have a product of Maclaurin series in xt/2 and 
—x/2t, respectively. 


e xt /2 . e -x/2 1 



(11.3) 


Here, the summation index r is changed to n , with n = r — s and summation limits n — —s 
to oo, and the order of the summations is interchanged, which is justified by absolute 
convergence. The range of the summation over n becomes —oo to oo, while the summation 
over s extends from max(— n, 0) to oo. For a given s we get t"(n > 0) from r — n + s: 


x\" +s t n+s 

2/ (n + .s)!' 


(-l)'U -r- 


(11-4) 


The coefficient of t n is then 2 


00 t— IV 5 / Y \' l+2s y 11 r n+2 

y„(x) = V-(-) =2--+ .... 

“ s\(n + s)l\2 J 2 n n\ 2 n + 2 (n + 1)! 


This series form exhibits is behavior of the Bessel function (v) for small x and permits 
numerical evaluation of J n (x). The results for Jq, J i, and Ji are shown in Fig. 11.1. From 
Section 5.3 the error in using only a finite number of terms of this alternating series in 
numerical evaluation is less than the first term omitted. For instance, if we want J n (x) 



Figure 11.1 Bessel functions, /o(.r), J\ (x), and .h (x ). 


2 From the steps leading to this series and from its convergence characteristics it should be clear that this series may be used with 
x replaced by z and with z any point in the finite complex plane. 
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to ±1% accuracy, the first term alone of Eq. (11.5) will suffice, provided the ratio of the 
second term to the first is less than 1% (in magnitude) or x < 0.2 (n + l) 1 / 2 . The Bessel 
functions oscillate but are not periodic — except in the limit as x -> oo (Section 11.6). The 
amplitude of J n (x) is not constant but decreases asymptotically as x -1 / 2 . (See Eq.( 11.137) 
for this envelope.) 

For n < 0, Eq. (11.5) gives 


J-n(x) = Y, 


.5=0 


(-!)* 
s!(i — n)! 


2 s—n 


( 11 . 6 ) 


Since n is an integer (here), (s — n)\ -> oo for s = 0,..., (n — 1). Hence the series may be 
considered to start with s — n. Replacing s by s + n, we obtain 


OO 

J-n(x) = Y. 

j=0 


(-1)*+" /.r\" +2s 
s\(s + n)\ V2J 


(11.7) 


showing immediately that J n (x) and J~ n (x) are not independent but are related by 


J- n (x) = (— l) n J„(x) (integral n). (11.8) 


These series expressions (Eqs. (11.5) and (11.6)) may be used with n replaced by v to 
define J v (x) and J~ v {x) for nonintegral v (compare Exercise 11.1.7). 


Recurrence Relations 

The recurrence relations for J„(x) and its derivatives may all be obtained by operating 
on the series, Eq. (11.5), although this requires a bit of clairvoyance (or a lot of trial and 
error). Verification of the known recurrence relations is straightforward. Exercise 11.1.7. 
Here it is convenient to obtain them from the generating function, g(x, t). Differentiating 
both sides of Eq. (11.1) with respect to f, we find that 

00 

= Y nJ n (x)t n -\ (11.9) 

n =—00 

and substituting Eq. (11.2) for the exponential and equating the coefficients of like powers 
of f, 3 we obtain 

2 n 

Jn- lM + Jn+\(x) = J„(x). (11.10) 

X 

This is a three-term recurrence relation. Given Jo and J\ , for example, J 2 (and any other 
integral order ./„) may be computed. 


'This depends on the fact that the power-series representation is unique (Sections 5.7 and 6.5). 
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Differentiating Eq. (11.1) with respect to x, we have 


^ x gix,t)=Ut- l X*nw» = jr j' n (x) t n . (mi) 

' ' n =—oo 

Again, substituting in Eq. (11.2) and equating the coefficients of like powers of t, we obtain 
the result 


J n -\(x) - J n +\(x) = 2 J' n {x). 

As a special case of this general recurrence relation, 

J()(X) = -J] (x). 

Adding Eqs. (11.10) and (11.12) and dividing by 2, we have 

Jn-\{* ) = -Jn(x) + J n (x). 

X 

Multiplying by x n and rearranging terms produces 

^-[x n J n (x)\=x n J n -i(x). 
ax 1 - 

Subtracting Eq. (11.12) from Eq. (11.10) and dividing by 2 yields 

n r 

J,i+\(x) — -J n (x) - J n (x). 

X 

Multiplying by x~ n and rearranging terms, we obtain 


( 11 . 12 ) 


(11.13) 


(11.14) 


(11.15) 


(11.16) 


— [x n J n (x)] = -x n J n+ ](x). 


(11.17) 


Bessel’s Differential Equation 

Suppose we consider a set of functions Z v (x) that satisfies the basic recurrence relations 
(Eqs. (11.10) and (11.12)), but with v not necessarily an integer and Z v not necessarily 


given by the series (Eq. (11.5)). Equation (11.14) may be rewritten (n —> v) as 

xZ' v (x) = xZ v -i(x) — vZ v (x). (11.18) 

On differentiating with respect to x, we have 

xZ”{x) + (v + l)Z' v — xZ' v _ x — Z v _! = 0. (11.19) 

Multiplying by x and then subtracting Eq. (11.18) multiplied by v gives us 

x 1 Z" v +xZ' v - v 2 Z v + (v - l)xZ v _ l -x 2 Z' v _ 1 =0. (11.20) 

Now we rewrite Eq. (11.16) and replace n by v — 1: 

xZ' v _\ — (v — l)Z y _! — xZ v . (11.21) 

Using Eq. (11.21) to eliminate Z v _i and Z* j from Eq. (11.20), we finally get 

x 2 Z” + xZ' v + (x 2 - v 2 )Z v = 0, (11.22) 
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which is Bessel’s ODE. Hence any functions Z v (x) that satisfy the recurrence relations 
(Eqs. (11.10) and (11.12), (11.14) and (11.16), or (11.15) and (11.17)) satisfy Bessel’s 
equation; that is, the unknown Z v are Bessel functions. In particular, we have shown that 
the functions J n (x), defined by our generating function, satisfy Bessel’s ODE. If the argu¬ 
ment is kp rather than x, Eq. (11.22) becomes 


p 2 ^_Z v {kp) + p^-Z v {kp) + ( k 2 p 2 - v 2 )Z v (kp) = 0. 


(11.22a) 


Integral Representation 


A particularly useful and powerful way of treating Bessel functions employs integral rep¬ 
resentations. If we return to the generating function (Eq. (11.2)), and substitute t — e' e , we 
get 


e‘ X sm0 _ -p 2 [/ 2 (*)cos 20 + /4(jc)cos40 H-] 

+ 2 1 [/i (x ) sin 9 + J 3 ( 4 :) sin 30 H-], 

in which we have used the relations 

Ji(x)e ,e + J- i(x)e~‘ e = J\(x){e ,e —e~ ,e ) 

= 2iJi(x)sin9, 
J 2 (x)e 2,e + J- 2 (x)e ~ 2 ' 9 = 2/2(^) cos 20, 

and so on. 

In summation notation. 


(11.23) 


(11.24) 


cos(.rsin0) = Jp(x) + 2^ J 2 n (x)cos(2n0), 


n= 1 


sinfr sin0) = 2 y^7 2 «-i(v)sin[(2n - 1)0], 


n =1 


equating real and imaginary parts of Eq. (11.23). 

By employing the orthogonality properties of cosine and sine, 4 


cos «0 cos mO d 0 — —S nm , 
/ 0 2 


L 

jT- 


sin 7i0 sin mO d9 = — 8 nm , 


(11.25) 


(11.26a) 

(11.26b) 


4 They are eigenfunctions of a self-adjoint equation (linear oscillator equation) and satisfy appropriate boundary conditions 
(compare Sections 10.2 and 14.1). 
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in which n and m are positive integers (zero is excluded), we obtain 

1 r 

— I cos (v sin 0) cos nO dO = 

n Jo 


J n (x), n even, 

0 , n odd. 


1 r 

— I sin(x sin0) sin770 dO — 

* Jo 


0 , 

Jn(x), 


n even, 
/? odd. 


(11.27) 

(11.28) 


(11.29) 


If these two equations are added together, 

i r r , 

J n (x) — — I cos(x sin 0) cos nd + sin(x sin 0) sin n0 1 dO 

x Jo 
i r 

= — I cos(770 — x sin 0) dO, 77 = 0,1,2,3,_ 

x Jo 

As a special case (integrate Eq. (11.25) over (0, it) to get) 

(11.30) 

Noting that cos(.t sin 0) repeats itself in all four quadrants, we may write Eq. (11.30) 


1 

Jo(x) — — I cos(vsin0)t/0. 
n Jo 


as 


1 


r»27T 


J 0 (x )=— / cos(jcsin0)t/0. 
2tr J o 


(11.30a) 


On the other hand, sin(v sin0) reverses its sign in the third and fourth quadrants, so 

J 7-2 71 


/ sin(xsin0)(70 = 0. 
2 n Jo 


(11.30b) 


Adding Eq. (11.30a) and i times Eq. (11.30b), we obtain the complex exponential repre¬ 
sentation 


i n2ir i r2n 

J 0 ( X ) = — / e Lxsm6 d0 = — 1 Jxcosd 
ATT J o 27 T 


r2 n 

7 ^ 

Jo 


dO. 


(11.30c) 


This integral representation (Eq. (11.29)) may be obtained somewhat more directly by 
employing contour integration (compare Exercise 11.1.16). 6 Many other integral repre¬ 
sentations exist (compare Exercise 11.1.18). 


Example 11.1.1 Fraunhofer Diffraction, Circular Aperture 

In the theory of diffraction through a circular aperture we encounter the integral 

pa p 2 7T 

/ rdr I e ibrcose d9 (11.31) 

Jo Jo 


Equations (11.26a) and (11.26b) hold for either m or n = 0. If both m and n = 0, the constant in (11.26a) becomes n; the 
constant in Eq. (11.26b) becomes 0. 

6 For n = 0 a simple integration over 6 from 0 to 2 n will convert Eq. (11.23) into Eq. (11.30c). 
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Figure 11.2 Fraunhofer diffraction, circular aperture. 


for <t>, the amplitude of the diffracted wave. 7 Here 0 is an azimuth angle in the plane of the 
circular aperture of radius a , and a is the angle defined by a point on a screen below the 
circular aperture relative to the normal through the center point. The parameter b is given 
by 

b — —— sina, (11.32) 

A. 

with X the wavelength of the incident wave. The other symbols are defined by Fig. 11.2. 
From Eq. (11.30c) we get 8 

cD~2tt [ J 0 (br)rdr. (11.33) 

Jo 

Equation (11.15) enables us to integrate Eq. (11.33) immediately to obtain 


2irab Xa 

<!> ~ —rrr- /1 ( ab ) ~ —- J\ 


b 2 


sin a 


2l TCI 


sin a 


(11.34) 


Note here that /i (0) = 0. The intensity of the light in the diffraction pattern is proportional 
to <l> 2 and 

9 Ji[(27ta/X) sinal 

tj>~ ~ -- - - 

sina 


(11.35) 


7 The exponent ibr cos 9 gives the phase of the wave on the distant screen at angle a relative to the phase of the wave incident on 
the aperture at the point if. 8). The imaginary exponential form of this integrand means that the integral is technically a Fourier 
transform. Chapter 15. In general, the Fraunhofer diffraction pattern is given by the Fourier transform of the aperture. 

8 We could also refer to Exercise 11.1.16(b). 
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Table 11.1 Zeros of the Bessel Functions and Their First Derivatives 


Number of zero 

J 0 (x) 

h(x) 

Jl(x) 

h(x) 

Mx) 

J 5 W 

i 

2.4048 

3.8317 

5.1356 

6.3802 

7.5883 

8.7715 

2 

5.5201 

7.0156 

8.4172 

9.7610 

11.0647 

12.3386 

3 

8.6537 

10.1735 

11.6198 

13.0152 

14.3725 

15.7002 

4 

11.7915 

13.3237 

14.7960 

16.2235 

17.6160 

18.9801 

5 

14.9309 

16.4706 

17.9598 

19.4094 

20.8269 

22.2178 


Jo(xf 

J[(x) 

Ajx) 

J^x) 



1 

3.8317 

1.8412 

3.0542 

4.2012 



2 

7.0156 

5.3314 

6.7061 

8.0152 



3 

10.1735 

8.5363 

9.9695 

11.3459 






From Table 11.1, which lists the zeros of the Bessel functions and their first derivatives, 9 
Eq. (11.35) will have a zero at 

r ~~ sina = 3.8317 ..., (11.36) 

or 

3.8317A 

sin a =-. 

2 na 

For green light, X — 5.5 x 10 -5 cm. Hence, if a = 0.5 cm, 

a & sin a = 6.7 x 10 -5 (radian) ~ 14 seconds of arc, 

which shows that the bending or spreading of the light ray is extremely small. If this analy¬ 
sis had been known in the seventeenth century, the arguments against the wave theory of 
light would have collapsed. In mid-twentieth century this same diffraction pattern appears 
in the scattering of nuclear particles by atomic nuclei — a striking demonstration of the 
wave properties of the nuclear particles. ■ 

A further example of the use of Bessel functions and their roots is provided by the 
electromagnetic resonant cavity (Example 11.1.2) and the example and exercises of Sec¬ 
tion 11.2. 


(11.37) 

(11.38) 


Example 11.1.2 Cylindrical Resonant Cavity 

The propagation of electromagnetic waves in hollow metallic cylinders is important in 
many practical devices. If the cylinder has end surfaces, it is called a cavity. Resonant 
cavities play a crucial role in many particle accelerators. 


9 Additional roots of the Bessel functions and their first derivatives may be found in C. L. Beattie, Table of first 700 zeros of 
Bessel functions. Bell Syst. Tech. J. 37: 689 (1958), and Bell Monogr. 3055. Roots may be accessed in Mathematica and other 
symbolic software and are on the Web. 
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Figure 11.3 Cylindrical resonant 
cavity. 


We take the "-axis along the center of the cavity with end surfaces at z = 0 and z — I and 
use cylindrical coordinates suggested by the geometry. Its walls are perfect conductors, so 
the tangential electric field vanishes on them (as in Fig. 11.3): 

E z = 0 = E v for p — a, E p — 0— E v for z = 0.1. 

Inside the cavity we have a vacuum, so so/to = 1/c 2 . In the interior of a resonant cav¬ 
ity, electromagnetic waves oscillate with harmonic time dependence e~ lmt , which follows 
from separating the time from the spatial variables in Maxwell’s equations (Section 1.9), 
so 

1 9 2 E ? co 

VxVxE = —r-—r- = orE, a——. 

c 2 dt 2 c 

With V • E = 0 (vacuum, no charges) and Eq. (1.85), we obtain for the space part of the 
electric field 

V 2 E + a 2 E = 0, 

which is called the vector Helmholtz PDE. The "-component ( E z , space part only) satis¬ 
fies the scalar Helmholtz equation, 

V 2 £- + a 2 E z — 0. (11.39) 

The transverse electric field components Ex = (E p , E v ) obey the same PDE but different 
boundary conditions, given earlier. Once E z is known. Maxwell’s equations determine E v 
fully. See Jackson, Electrodynamics in Additional Readings for details. 


684 


Chapter 11 Bessel Functions 


o 2 

We separate the z variable from p and ip, because there are no mixed derivatives ^, 
etc. The product solution, E z = v(p, (p)w(z ), is substituted into the Helmholtz PDE for E- 
using Eq. (2.35) for V 2 in cylindrical coordinates, and then we divide by vw , yielding 


1 d 2 w 
w(z) dz 2 



/ d 2 v 1 dv 1 d 2 v 2 \ 
\3p 2 p dp p 2 d(p 2 / 


v(p, <p) — 0. 


This implies 

1 d 2 w 1 / d 2 V 1 3l> 1 d 2 V 2 \ i2 

w(z) dz 2 v(p, ip) \3p 2 p 3p p 2 dip 2 / 


Here, k 2 is a separation constant, because the left- and right-hand sides depend on different 
variables. For w(z ) we find the harmonic oscillator ODE with standing wave solution (not 
transients) that we seek. 


w(z) — AsinA:z + Bcoskz, 


with A, B constants. For v(p,q>) we obtain 

d 2 v 1 dv 1 d 2 v 2 

3 7 2 + ~ P Tp + 7-W 2+rv ’ 


2 1 
y=a~ 


d~v 


In this PDE we can separate the p and ip variables, because there is no mixed term gpg . 
The product form v — u(p)<S>(ip) yields 

~- 2 (d 2 u 1 du t\ 1 d 2, t> 


P 


- 


u(p) \dp- 


1 du 
p dp 


y 2 1 — 


<P(ip ) dip 2 


where the separation constant m 2 must be an integer, because the angular solution <J> = 
e im<p of the ODE 

d 2 <t> 2 

~—^r + 7 ? 7“0 = 0 
dip z 

must be periodic in the azimuthal angle. 

This leaves us with the radial ODE 

dru 1 du ( 9 m 2 \ 

T-T + T-7T+ r 2 --y « = o. 


r = yp and dividing by y~, which yields 

„,2n 


dp 2 ' p dp 

Dimensional arguments suggest rescaling p 

d 2 u 1 du ... 

This is Bessel’s ODE for v = m. We use the regular solution (yp) because the (irregular) 
second independent solution is singular at the origin, which is unacceptable here. The 
complete solution is 


E z — J m (yp)e' m,p (Asinkz + Bcoskz), 


(11.40a) 


where the constant y is determined from the boundary condition E z — 0 on the cavity sur¬ 
face p — a , that is, that ya be a root of the Bessel function J m (see Table 11.1). This gives 
a discrete set of values y — y mn , where n designates the nth root of (see Table 11.1). 
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For the transverse magnetic or TM mode of oscillation with H z = 0 Maxwell’s equations 
imply. (See again Resonant Cavities in J. D. Jackson’s Electrodynamics in Additional 
Readings.) 


Ex' 


„ dE z 
Vj_—-, 
dz 


„ ,919 

V L = | -,- 

^dp p dtp 


The form of this result suggests E- ~ cos kz , that is, setting A — 0 so that Ex ~ sin kz = 0 
at z — 0, l can be satisfied by 

A-=y^, p = 0,1,2,.... (11.41) 

Thus, the tangential electric fields E p and vanish at z = 0 and /. In other words, A = 0 
corresponds to dE z /dz = 0 at z = 0 and z = l for the TM mode. Altogether then, we have 


2 2 2 2 
9 (XT 9 CO p A 7T^ 

r = “ = ^2 “ /2 

with 

Ctmn 

Y = Yimi — 5 

a 

where is the nth zero of ./„,. The general solution 


E7 — ^ ^ ’ Rump ^OS ^ , 

m,n,p 


(11.42) 


(11.43) 


(11.40b) 


with constants B mnp . now follows from the superposition principle. 

The result of the two boundary conditions and the separation constant m 1 2 3 is that the 
angular frequency of our oscillation depends on three discrete parameters: 


tomilp 



m = 0,1,2 ,..., 
n — 1,2,3,..., 

p = 0,1,2.... 


(11.44) 


These are the allowable resonant frequencies for our TM mode. The TE mode of oscillation 
is the topic of Exercise 11.1.26. ■ 


Alternate Approaches 

Bessel functions are introduced here by means of a generating function, Eq. (11.2). Other 
approaches are possible. Listing the various possibilities, we have: 

1. Generating function (magic), Eq. (11.2). 

2. Series solution of Bessel’s differential equation. Section 9.5. 

3. Contour integrals: Some writers prefer to start with contour integral definitions of the 
Hankel functions. Section 7.3 and 11.4, and develop the Bessel function J v (x) from 
the Hankel functions. 
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4. Direct solution of physical problems: Example 11.1.1. Fraunhofer diffraction with a 
circular aperture, illustrates this. Incidentally, Eq. (11.31) can be treated by series ex¬ 
pansion, if desired. Feynman 10 develops Bessel functions from a consideration of cav¬ 
ity resonators. 

In case the generating function seems too arbitrary, it can be derived from a contour inte¬ 
gral, Exercise 11.1.16, or from the Bessel function recurrence relations. Exercise 11.1.6. 
Note that the contour integral is not limited to integer v, thus providing a starting point for 
developing Bessel functions. 

Bessel Functions of Nonintegral Order 

These different approaches are not exactly equivalent. The generating function approach 
is very convenient for deriving two recurrence relations, Bessel’s differential equation, 
integral representations, addition theorems (Exercise 11.1.2), and upper and lower bounds 
(Exercise 11.1.1). However, you will probably have noticed that the generating function 
defined only Bessel functions of integral order, Jo, J \, Ji, and so on. This is a limitation 
of the generating function approach that can be avoided by using the contour integral in 
Exercise 11.1.16 instead, thus leading to foregoing approach (3). But the Bessel function of 
the first kind, J v (x ), may easily be defined for nonintegral v by using the series (Eq. (11.5)) 
as a new definition. 

The recurrence relations may be verified by substituting in the series form of J v (x) (Ex¬ 
ercise 11.1.7). From these relations Bessel’s equation follows. In fact, if v is not an integer, 
there is actually an important simplification. It is found that J v and J- v are independent, 
for no relation of the form of Eq. (11.8) exists. On the other hand, for v — n, an integer, we 
need another solution. The development of this second solution and an investigation of its 
properties form the subject of Section 11.3. 


Exercises 

11.1.1 From the product of the generating functions g{x,t) ■ g(x , —t) show that 

1 = [,/o(*)] 2 + 2[./i (x)] 2 + 2[/ 2 (x)] 2 + • • • 

and therefore that |/o(x)| < 1 and \J n (x)\ < l/\/2, n= 1,2, 3,_ 

Hint. Use uniqueness of power series. Section 5.7. 

11 . 1.2 Using a generating function g(x, t) — g(u + v, t) = g(u, t) ■ g(v, t), show that 

OO 

(a) J„{u + u)= ^2 J s (u) ■ J n - S (v), 

s=—o o 

OO 

(b) Jq(u + v) = Jq(u)Jq(v) + 2Y.J s (u)J- s (v). 

S= 1 


10 R. P. Feynman, R. B. Leighton, and M. Sands, The Feynman Lectures on Physics, Vol. II. Reading, MA: Addison-Wesley 
(1964), Chapter 23. 
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11 . 1.3 


11 . 1.4 


11 . 1.5 


These are addition theorems for the Bessel functions. 
Using only the generating function 


e (x/2)(/—1/0 


oo 

J « (x > tn 

n=—oo 


and not the explicit series form of J n (x), show that J n (x) has odd or even parity accord¬ 
ing to whether n is odd or even, that is, 11 

Derive the Jacobi-Anger expansion 

OO 

e lzcos9 = J2 i m Jm(z)e ime . 

m=—o o 


This is an expansion of a plane wave in a series of cylindrical waves. 
Show that 


OO 

(a) cos x = Jq(x) +2^(—1)”4W, 

n =1 
oo 

(b) sin.t = 2^(-l)"72„+iU). 

n =0 


11 . 1.6 To help remove the generating function from the realm of magic, show that it can be 
derived from the recurrence relation, Eq. (11.10). 

Hint. 


(a) Assume a generating function of the form 

OO 

g(.r,/)= ^2 Jm(x)t m . 

m =—oo 


(b) Multiply Eq. (11.10) by t" and sum over n. 

(c) Rewrite the preceding result as 


t + - )g(x,t) 


21 3 g(x, t) 
x 3 1 


(d) Integrate and adjust the “constant” of integration (a function of x) so that the 
coefficient of the zeroth power, t°, is Jq(x), as given by Eq. (11.5). 


11 . 1.7 


Show, by direct differentiation, that 


OO 

j v (x) = Y2 

s =0 


(~l)- ; 

s\(s + v)! 



v+2 s 


11 This is easily seen from the series form (Eq. (11.5)). 



688 


Chapter 11 Bessel Functions 


satisfies the two recurrence relations 


2v 


Jv-i(x) + J v +\{x) = —4(a), 

X 

Jv-i(x) - J v +i(x) = 2 /'(a), 
and Bessel’s differential equation 

x 2 J"{x) + xJ' v (x) + (x 2 - V 2 )j v (x) = 0. 

11 . 1.8 Prove that 

1 — cos A C 71 ! 2 


sin a 


j.TT/2 

Jo 


Jo(xcos9)cos9 cl&. 




J i (a cos 9)d9. 


Hint. The definite integral 


L 


n ' 2 9 , 4.1 2 • 4 • 6 • • • (2s) 

cos 2s+l 9d9 = 


1 • 3 • 5 • • • (2s + 1) 


may be useful. 
11 . 1.9 Show that 


Jq(x) = - 


2 f l COS A 1 

n Jo Vl -f 


dt. 


This integral is a Fourier cosine transform (compare Section 15.3). The corresponding 
Fourier sine transform. 


/o(a) = — 


L 


sin xt 


x J i Vr 2 - 1 


dt. 


is established in Section 11.4 (Exercise 11.4.6) using a Hankel function integral repre¬ 
sentation. 


11 . 1.10 Derive 

( 1 d \ n 

) Jo(x). 
x dx J 

Hint. Try mathematical induction. 

11.1.11 Show that between any two consecutive zeros of ./„(a) there is one and only one zero 
of /„+i(a). 

Hint. Equations (11.15) and (11.17) may be useful. 


11 . 1.12 


An analysis of antenna radiation patterns for a system with a circular aperture involves 
the equation 


g(u) = 



f (r)Jo(ur)r dr. 


g(u) 


2 

U A 


If f{r) = 1 — r 2 , show that 
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11 . 1.13 


11 . 1.14 


The differential cross section in a nuclear scattering experiment is given by da/d^i — 
\f(9)\ 2 . An approximate treatment leads to 

—ik f 27T f R 

f(0) = —— / / exp[ikpsin9sm(p]pdpd(p. 

2tr Jo Jo 

Here 6 is an angle through which the scattered particle is scattered. R is the nuclear 
radius. Show that 


da , n. 1 


J i (kR sin$) 
sin0 


A set of functions C„ (x) satisfies the recturence relations 

2 n 

C„- lO) - C„+l(x) = - C n (x), 

X 


Cn-lW + c n +\(x) = 2C' n (x). 


(a) What linear second-order ODE does the C„ (x ) satisfy? 

(b) By a change of variable transform your ODE into Bessel’s equation. This sug¬ 
gests that C„(x) may be expressed in terms of Bessel functions of transformed 
argument. 

11 . 1.15 A particle (mass m) is contained in a right circular cylinder (pillbox) of radius R and 
height H. The particle is described by a wave function satisfying the Schrodinger wave 
equation 

h 2 9 

—V \/f(p,(p, Z ) = E\lr(p,<p, Z ) 

1m 

and the condition that the wave function go to zero over the surface of the pillbox. Find 
the lowest (zero point) permitted energy. 



where z pq is the c/th zero of J p and the index p is fixed by the azimuthal dependence. 
11 . 1.16 (a) Show by direct differentiation and substitution that 

/„(*) = — f e^‘- l ^r v - l dt 

27 xi J c 

or that the equivalent equation, 

satisfies Bessel’s equation. C is the contour shown in Fig. 11.4. The negative real 
axis is the cut line. 
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Hint. Show that the total integrand (after substituting in Bessel’s differential equa¬ 
tion) may be written as a total derivative: 


d 

dt 


exp 


1 

-It- 


1 

v + — I 1 H— 


(b) Show that the first integral (with n an integer) may be transformed into 


i p2n :—n r2n 

J n (x) = — / e dxsm9-ne) dQ = - / i 

2n Jo 2n Jo 


(jccos 0+n0) 


dd. 


11 . 1.17 The contour C in Exercise 11.1.16 is deformed to the path —oo to —1, unit circle e 171 
to e l7T , and finally —1 to —oo. Show that 

J v (x)—— f cos(v6 — xsin9)d6 — —- f e~ ve ~ xsinhe d6. 

n Jo tt Jo 

This is Bessel’s integral. 

Hint. The negative values of the variable of integration u may be handled by using 


u — te 


±ix 


11 . 1.18 (a) Show that 


J v (x) = 


jrl/2 (v _ 1)1 


1 r */2 

Jo ‘ 


cos(jc sinO) cos 2lJ 9 dQ, 


where v > — 

Hint. Here is a chance to use series expansion and term-by-term integration. The 
formulas of Section 8.4 will prove useful. 
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11 . 1.19 


11.1.20 


11 . 1.21 


11.1.22 


11 . 1.23 


(b) Transform the integral in part (a) into 


Jv(x) = 


1 


? r 1 / 2 (v — i)! \2 


f 

7 ' 


cos(.r cos 9) sin 21 ’ 9 d9 


e ±ixco&0 gin 21 ’ 9 d9 


7 r 1 / 2 (y — j)! \ 2 , 

f e* px ( 1 - P 2 y~ X ' 2 dp. 

v-x)\\ 2 J J—i 


tz x ! 2 (v — ^ 

These are alternate integral representations of J,, (x ). 
(a) From 


J v (x) = — (-) f t~ v ~ l e , ~ x2/4t dt 
2ni \ 2 J J 


derive the recurrence relation 


(b) From 


J'OO = ~Jv(x) - J v + t(x). 


Mx) = — [ r v-i e (xm-i/t)dt 

2 ni J 


derive the recurrence relation 

K(x) = \[J V -lix) - Jv+t(x)]. 
Show that the recurrence relation 

J' n (x) = j[j„_iU) - J„+i (x)] 
follows directly from differentiation of 


J n (x) = — f 
n Jo 


J n (x)=— / cos(n0 — xsin9)d9. 


Evaluate 


f 


e ax Jo(bx) dx , a, b > 0. 


Actually the results hold for a > 0, —oo < b < oo. This is a Laplace transform of Jo- 
Hint. Either an integral representation of Jq or a series expansion will be helpful. 


Using trigonometric forms, verify that 

Jo(br) = 7- 

2tc 


p2n 

/ ^ 

JO 


br sin 6 


d9. 


(a) Plot the intensity (O 2 of Eq. (11.35)) as a function of (sin«//.) along a diameter 
of the circular diffraction pattern. Locate the first two minima. 
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(b) What fraction of the total light intensity falls within the central maximum? 

Hint. [J\(x)~\ 2 /x may be written as a derivative and the area integral of the intensity 
integrated by inspection. 

11 . 1.24 The fraction of light incident on a circular aperture (normal incidence) that is transmitted 
is given by 

r 2ka dx i r 2ka 

T — 2 I J 2 (x) -— / J 2 {x)dx. 

Jo x 2 ka Jo 

Here a is the radius of the aperture and k is the wave number, 2 tt/a. Show that 

1 °° 1 p2ka 

(a) T = 1 - — V J ln+X (2ka), (b) T = 1 — — / J 0 {x)dx. 
ka z —' Ika Jo 

n= 0 

11 . 1.25 The amplitude U (p, (p. t) of a vibrating circular membrane of radius a satisfies the wave 
equation 


V 2 f/- 


i d 2 u 

v 2 3 1 2 


Here v is the phase velocity of the wave fixed by the elastic constants and whatever 
damping is imposed. 


(a) Show that a solution is 

U(p, <p, t) = J m (kp)(a\e imqj + a 2 e-‘ m,p )(b l e i0J ' + b 2 e~ iwt ). 

(b) From the Dirichlet boundary condition, J m (ka ) = 0, find the allowable values of 
the wavelength X(k = 2n/X). 


Note. There are other Bessel functions besides J m , but they all diverge at p = 0. 
This is shown explicitly in Section 11.3. The divergent behavior is actually implicit 
inEq. (11.6). 

11 . 1.26 Example 11.1.2 describes the TM modes of electromagnetic cavity oscillation. The 
transverse electric (TE) modes differ, in that we work from the z component of the 
magnetic induction B: 

V 2 £. +a 2 B z =0 

with boundary conditions 

fi„(0) = B„(l) = 0 and — =0. 

d P P = o 

Show that the TE resonant frequencies are given by 

p — 1,2,3,.... 
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11 . 1.27 Plot the three lowest TM and the three lowest TE angular resonant frequencies, co mnp , 
as a function of the radius/length (a/1) ratio for 0 <a/l < 1.5. 

Hint. Try plotting co 2 (in units of c 2 /a 2 ) versus (a/1) 2 . Why this choice? 

11 . 1.28 A thin conducting disk of radius a carries a charge q. Show that the potential is de¬ 
scribed by 

q f°° sin ka 

p(r,z) = - - / e kUl Jo(kr )—-— dk. 

A-ic £qci J o k 

where Jq is the usual Bessel function and r and z are the familiar cylindrical coordi¬ 
nates. 

Note. This is a difficult problem. One approach is through Fourier transforms such as 
Exercise 15.3.11. For a discussion of the physical problem see Jackson (Classical Elec¬ 
trodynamics in Additional Readings). 

11 . 1.29 Show that 

x m J n (x)dx, m>n> 0, 



(a) is integrable in terms of Bessel functions and powers of x (such as a p J q (a)) for 
m + n odd; 

(b) may be reduced to integrated terms plus Jo(x)dx for m + n even. 


11 . 1.30 Show that 


P"(\-—)jo(y)ydy = 

Jo \ « 0 n) 


1 

aon 



Jo (y)dy. 


Here ao n is the nth root of Jo(y). This relation is useful (see Exercise 11.2.11): The 
expression on the right is easier and quicker to evaluate — and much more accurate. 
Taking the difference of two terms in the expression on the left leads to a large relative 
error. 


11 . 1.31 The circular aperature diffraction amplitude <l> of Eq. (17.35) is proportional to f(z) = 
Ji(z)/z ■ The corresponding single slit diffraction amplitude is proportional to g(z) = 
sin z/z. 


(a) Calculate and plot f(z) and g(z) for z — 0.0(0.2)12.0. 

(b) Locate the two lowest values of z(z > 0) for which f(z.) takes on an extreme value. 
Calculate the corresponding values of f(z). 

(c) Locate the two lowest values of ;(z > 0) for which g(z.) takes on an extreme value. 
Calculate the corresponding values of g(z). 


11 . 1.32 Calculate the electrostatic potential of a charged disk <p(r,z) from the integral 
form of Exercise 11.1.28. Calculate the potential for r/a — 0.0(0.5)2.0 and z/a — 
0.25(0.25)1.25. Why is z/a = 0 omitted? Exercise 12.3.17 is a spherical harmonic 
version of this same problem. 
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11.2 Orthogonality 


If Bessel’s equation, Eq. (11,22a), is divided by p, we see that it becomes self-adjoint, and 
therefore, by the Sturm-Liouville theory. Section 10.2, the solutions are expected to be 
orthogonal — if we can arrange to have appropriate boundary conditions satisfied. To take 
care of the boundary conditions for a finite interval [0, a], we introduce parameters a and 
a vm into the argument of to get J v (a vm p/a). Here a is the upper limit of the cylindrical 
radial coordinate p. From Eq. (11.22a), 


dp 2 


Jv\ &vm I H“ j Jv \ & vm ) H" 

dp 


almP V 2 


I Jv I &vm I — 0. 


Changing the parameter a vm to a vn , we find that J v (a vn p/a ) satisfies 


i dp 2 


*A> ( Oivn 1 T . -A ! Oivn 
dp 


1 ^ 
a- n p v- 


- a vn - = 0. 


(11.45) 


(11.45a) 


Proceeding as in Section 10.2, we multiply Eq. (11.45) by J v (a vn p/a ) and Eq. (11.45a) 
by J v (a vm p/a) and subtract, obtaining 


a 


pV 

a J dp 


d , , 

P Jv I (X\‘in 
dp 


a 


P\^_ 

a J dp 


p J v I Oivn 
dp 


2 2 

oi — a 
vn vm 


P 


pJv\ & vm | Jv | &vn 


(11.46) 


Integrating from p = 0 to p = a, we obtain 


/; 


j i P\ d 
Jv I Mvn , 
a J dp 


P j I 

dp 


dp 


-r 

Jo 


a 


P\^_ 

a J dp \_ r dp 


p J v I Oi vn 


2 2 

0 / — 0 / 
vn vm 


f 


p 


Jv I &vm I Jv I U vn I P dp . 


dp 
(11.47) 


Upon integrating by parts, we see that the left-hand side of Eq. (11.47) becomes 


(11.48) 

o 

For v > 0 the factor p guarantees a zero at the lower limit, p = 0. Actually the lower 
limit on the index v may be extended down to v > — 1, Exercise 11.2.4. 12 At p — a, each 
expression vanishes if we choose the parameters and a vm to be zeros, or roots of J v \ 
that is, J v (a vm ) = 0. The subscripts now become meaningful: a vm is the /nth zero of J v . 

With this choice of parameters, the left-hand side vanishes (the Sturm-Liouville bound¬ 
ary conditions are satisfied) and for m ^ n, 

f J v (a vm -)j v (a vn -)pdp = 0. (11.49) 

Jo \ a) V «/ 

This gives us orthogonality over the interval [0, a]. 


, I P\d ( p 
pJv I &vn I j Jv I ^vm 

a J dp \ a 


j I P \ d ( P 
pJ v I &vm I j Am &vn 
a J dp \ a 


12 The case v = — 1 reverts to v = +1, Eq. (11.8). 
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Normalization 


The normalization integral may be developed by returning to Eq. (11.48), setting a vn = 
a vm + £, and taking the limit s —> 0 (compare Exercise 11.2.2). With the aid of the recur¬ 
rence relation, Eq. (11.16), the result may be written as 



[>Aj+ 1 (ttym)] 


2 


(11.50) 


Bessel Series 


If we assume that the set of Bessel functions J v (a vm p/a))(v fixed, m — 1,2,3,...) is 
complete, then any well-behaved but otherwise arbitrary function f(p) may be expanded 
in a Bessel series (Bessel-Fourier or Fourier-Bessel) 

OO 

f (p) — ^ ' Cvm Jv 

m= 1 


0 < p <a, 


v > — 1. 


(11.51) 


The coefficients c vm are determined by using Eq. (11.50), 



(11.52) 


A similar series expansion involving J v (ji vm p/a ) with (d/dp)J v (P vm p/a)\ p=a — 0 is 
included in Exercises 11.2.3 and 11.2.6(b). 


Example 11 . 2.1 Electrostatic Potential in a Hollow Cylinder 

From Table 9.3 of Section 9.3 (with a replaced by k ), our solution of Laplace’s equation 
in circular cylindrical coordinates is a linear combination of 

km(p , <jo, z) = J m (kp)[a m sin imp + b m cosmcp][c\e kz + C 2 e~ kz \ (11.53) 

The particular linear combination is determined by the boundary conditions to be satisfied. 
Our cylinder here has a radius a and a height l. The top end section has a potential distrib¬ 
ution x// (p, (p). Elsewhere on the surface the potential is zero. 13 The problem is to find the 
electrostatic potential 

xlf(p,<p,z) = Y^ x l'k m (P,<P,z) (11.54) 

k,m 

everywhere in the interior. 

For convenience, the circular cylindrical coordinates are placed as shown in Fig. 11.3. 
Since x[f(p, q >, 0) = 0, we take c\ — —C 2 = The z dependence becomes sinhAz, vanish¬ 
ing at z = 0. The requirement that \l/ — 0 on the cylindrical sides is met by requiring the 
separation constant k to be 

. _ . _ &mn 

K - - 5 

a 

13 If yfr = 0 at z = 0, /, but \J/ ^ 0 for p = a, the modified Bessel functions, Section 11.5, are involved. 


(11.55) 
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where the first subscript, m, gives the index of the Bessel function, whereas the second 
subscript identifies the particular zero of ./,„. 

The electrostatic potential becomes 

oo oo , 

4 r(p,<p, Z) = '^2'^2 Jm ( «mn - 
m =0 n =1 


• [a mn sin imp + b nm cos imp] ■ sinh) a mn — J. 

V a 


(11.56) 


Equation (11.56) is a double series: a Bessel series in p and a Fourier series in cp. 
At z — l, 4? — ir(p, (p), a known function of p and ip. Therefore 


oo oo 

'/'(p,<p) = '22'22 J m 

m=0 n= 1 



[a mn sin imp + b mn cos m<p] ■ sinh 




(11.57) 


The constants a mn and b mn are evaluated by using Eqs. (11.49) and (11.50) and the corre¬ 
sponding equations for sin<p and cos <p (Example 10.2.1 and Eqs. (14.2), (14.3), (14.15) to 
(14.17)). We find 14 


&mn 

bmn 


= 2 


na 


sinh 





n a 


i {r(p,(p)J m [ &mn 


sin nup 
cos m<p 


pdpdup. 


(11.58) 


These are definite integrals, that is, numbers. Substituting back into Eq. (11.56), the series 
is specified and the potential \[r(p, <p, z ) is determined. ■ 


Continuum Form 

The Bessel series, Eq. (11.51), and Exercise 11.2.6 apply to expansions over the finite 
interval [0, a]. If a —> oo, then the series forms may be expected to go over into integrals. 
The discrete roots a vm become a continuous variable a. A similar situation is encountered 
in the Fourier series. Section 15.2. The development of the Bessel integral from the Bessel 
series is left as Exercise 11.2.8. 

For operations with a continuum of Bessel functions, J v (ap), a key relation is the Bessel 
function closure equation, 

1 1 

/ J v (ap)J v {a'p)pdp — — S(a — a'), v >—. (11.59) 

Jo a 2 

This may be proved by the use of Hankel transforms. Section 15.1. An alternate approach, 
starting from a relation similar to Eq. (10.82), is given by Morse and Feshbach, Section 6.3. 
A second kind of orthogonality (varying the index) is developed for spherical Bessel func¬ 
tions in Section 11.7. 

l4 If m = 0. the factor 2 is omitted (compare Eq. (14.16)). 



11.2 Orthogonality 


697 


Exercises 

11 . 2.1 


11.2.2 

11 . 2.3 

11 . 2.4 

11 . 2.5 

11.2.6 


Show that 


rP 

(a 2 — b 2 ) / J v (ax)J v (bx)xdx = P\bJ v (aP)J f v (bP) — aJ' v (aP)J v {bP)\, 

Jo 


with 




r< 2 p 1 

/ [7 y (flx)] xclx — — 

Jo 2 




V > - 1 . 


These two integrals are usually called the first and second Lommel integrals. 

Hint. We have the development of the orthogonality of the Bessel functions as an anal¬ 
ogy- 


Show that 

ci 2 r ,T 

pap = —yj v +\{ci vm )\ , r > —1- 

Here a vm is the mth zero of J v . 

Hint. With ot vn = a vm + s, expand J v [{a vm + e)p/a\ about a vm p/a by a Taylor expan¬ 
sion. 



(a) If p vm is the mth zero of (d/dp)J v (p vm p/a), show that the Bessel functions are 
orthogonal over the interval [0, a] with an orthogonality integral 

/ Jv\ fivm ) Jv (Pvn ) P dp — 0, ni n. V > 1. 

Jo \ a) V a) 

(b) Derive the corresponding normalization integral (m = n). 

a 2 ( v 2 \ r 

ANS. — (1--2- )\J v (P vm )] , v>-l. 

^ V Pvm / 

Verify that the orthogonality equation, Eq. (11.49), and the normalization equation, 
Eq. (11.50), hold for v > -1. 

Hint. Using power-series expansions, examine the behavior of Eq. (11.48) as p -> 0. 

From Eq. (11.49) develop a proof that J v (z), v > —1, has no complex roots (with 
nonzero imaginary part). 

Hint. 


(a) Use the series form of J v (z ) to exclude pure imaginary roots. 

(b) Assume a vm to be complex and take a lm to be a* m . 

(a) In the series expansion 

OO 

f (P) = ^ ^ c vmJv 

m= 1 


0 < p <a, 


v > -1, 
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11.2.7 


11.2.8 


11.2.9 


11.2.10 


with J v (a vm ) — 0, show that the coefficients are given by 


a~[J v+ ] (a 

vm )P Jo 


f 


f (p)Jv \ ot vm ~ )pdp. 
a 


(b) In the series expansion 


OO 

f (p) — y ' d vm J v 

m =1 



0 < p < a, v > — 1, 


with ( d/dp)J v (P vm p/a) \ p=a — 0, show that the coefficients are given by 

dvm — 2/ 1 1 I \r T IQ Vp f f (p) J v \ @ vm ~)pdp- 

a 2 (l - v 2 /p 2 m )[J v (p vm )] 2 Jo \ a ) 

A right circular cylinder has an electrostatic potential of i// (p , (p) on both ends. The po¬ 
tential on the curved cylindrical surface is zero. Find the potential at all interior points. 
Hint. Choose your coordinate system and adjust your z dependence to exploit the sym¬ 
metry of your potential. 

For the continuum case, show that Eqs. (11.51) and (11.52) are replaced by 

POO 

f(p)— / a(a)J v (ap) dot, 

Jo 

P OO 

a (a) = a I f(p)J v (ap)p dp. 

Jo 

Hint. The corresponding case for sines and cosines is worked out in Section 15.2. These 
are Hankel transforms. A derivation for the special case v = 0 is the topic of Exer¬ 
cise 15.1.1. 


A function f(x) is expressed as a Bessel series: 

OO 

f CO = ^ Jm (ptmn x \ 

n= 1 


with a mn the nth root of J m . Prove the Parseval relation, 


/ [/(*)] xdx = - y^an\Jm+\(Umn)\ 
JO L , 

n= 1 


Prove that 


OO 

n =1 


1 

4 (m + 1) 


Hint. Expand x m in a Bessel series and apply the Parseval relation. 
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11 . 2.11 A right circular cylinder of length / has a potential 

♦MW 1 -;)- 


where a is the radius. The potential over the curved surface (side) is zero. Using 
the Bessel series from Exercise 11.2.7, calculate the electrostatic potential for p/a — 
0.0(0.2) 1.0 and z/l = 0.0(0.1)0.5. Take a/1 = 0.5. 

Hint. From Exercise 11.1.30 you have 


)j 0 (y)ydy. 
JO \ “On / 


Show that this equals 


^0 n 

Jo(y)dy. 

Numerical evaluation of this latter form rather than the former is both faster and more 
accurate. 

Note. For p/a = 0.0 and z/l — 0.5 the convergence is slow, 20 terms giving only 98.4 
rather than 100. 


1 

“On 


L 


Check value. For p/a — 0.4 and z/l — 0.3, 
^ = 24.558. 


11.3 Neumann Functions, Bessel Functions 
of the Second Kind 

From the theory of ODEs it is known that Bessel’s equation has two independent solutions. 
Indeed, for nonintegral order v we have already found two solutions and labeled them 
J v (x) and J- V (x). using the infinite series (Eq. (11.5)). The trouble is that when v is 
integral, Eq. (11.8) holds and we have but one independent solution. A second solution 
may be developed by the methods of Section 9.6. This yields a perfectly good second 
solution of Bessel’s equation but is not the standard form. 


Definition and Series Form 


As an alternate approach, we take the particular linear combination of J v (x ) and J~ v (x) 


A,, Or) = 


cosu7r7 y (.*) — J-v(x) 
sin vtt 


(11.60) 


This is the Neumann function (Fig. 11.5). 15 For nonintegral v,N v (x) clearly satisfies 
Bessel’s equation, for it is a linear combination of known solutions J v (x) and J- V (x). 


15 In AMS-55 (see footnote 4 in Chapter 5 or Additional Readings of Chapter 8 p. for this ref. ) and in most mathematics tables, 
this is labeled Y v (x). 
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Figure 11.5 Neumann functions Nq(x), Ni(x), and A^(x). 


Substituting the power-series Eq. (11.6) for n —* v (given in Exercise 11.1.7) yields 


N v {x) = ■ 


(v-l)!/2 


7T 


16 


(11.61) 


for v > 0. However, for integral v, v — n, Eq. (11.8) applies and Eq. (11.60) 16 becomes in¬ 
determinate. The definition of N v (x) was chosen deliberately for this indeterminate prop¬ 
erty. Again substituting the power series and evaluating N v (x) for v —> 0 by l’Hopital’s 
rule for indeterminate forms, we obtain the limiting value 

N q (x) = — (In x + y ~ In2) + 0(x 2 ) (11.62) 

7 X 

for n = 0 and x —> 0, using 

u!(-u)! = — (11.63) 

sinjru 

from Eq. (8.32). The first and third terms in Eq. (11.62) come from using (d/dv)(x/2) v = 
(x/2) v ln(.r/2), while y comes from (d/dv)v\ for v —>■ 0 using Eqs. (8.38) and (8.40). For 
77 > 0 we obtain similarly 

A ,, W = _I ( „- 1)! (l)" + ... + i(|)"i jln (|) + .." ,11.64) 


Equations (11.62) and (11.64) exhibit the logarithmic dependence that was to be expected. 
This, of course, verifies the independence of ./„ and N„. 


16 


Note that this limiting form applies to both integral and nonintegral values of the index v. 
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Other Forms 


As with all the other Bessel functions, N v (x ) has integral representations. For No(x) we 
have 


~-f 

n Jo 


Nq(x) — -/ cos (.r cosh r)t/t =- 


2 f c 

x Ji 


cos (xt) 
(r 2 - 1 )V 2 


dt. 


x > 0. 


These forms can be derived as the imaginary part of the Hankel representations of Exer¬ 
cise 11.4.7. The latter form is a Fourier cosine transform. 

To verify that N v (x), our Neumann function (Fig. 11.5) or Bessel function of the second 
kind, actually does satisfy Bessel’s equation for integral n, we may proceed as follows. 
L’Hopital’s rule applied to Eq. (11.60) yields 


N„(x) — 


(d/dv)[ cos vtzJ v {x) — J- V (x)] 


(d/dv) sin vn 
—n sin mtJ n {x) + [cosmzdJ v /dv — 3/_ v /3v]| v , =)! 


3 J v (x) 


(-D 


7T COSM7T 

„ 3 J-v(x) 


dv 3v 

Differentiating Bessel’s equation for J± v (x) with respect to v, we have 


dr ( dJ± v ^ + x d ( dJ± v 


dx 2 \ dv 


dx V 3v 


’) + (: x 


2\ 


2 ) : 


dv 


=2vJ± v 


(11.65) 


( 11 . 66 ) 


Multiplying the equation for ./_ v , by (—l) y , subtracting from the equation for J v (as sug¬ 
gested by Eq. (11.65)), and taking the limit v —> n, we obtain 

x 2 -^ N „+x^- Nn + (x 2 - h 2 )N„ = J n - (-l)"/_„]. (11.67) 

For v = n, an integer, the right-hand side vanishes by Eq. (11.8) and N„(x) is seen to be a 
solution of Bessel’s equation. The most general solution for any v can therefore be written 
as 


y{x) = AJ v (x) + BN v (x). (11.68) 

It is seen from Eqs. (11.62) and (11.64) that N„ diverges, at least logarithmically. Any 
boundary condition that requires the solution to be finite at the origin (as in our vibrat¬ 
ing circular membrane (Section 11.1)) automatically excludes N„(x). Conversely, in the 
absence of such a requirement, N n (x) must be considered. 

To a certain extent the definition of the Neumann function N n (x) is arbitrary. Equa¬ 
tions (11.62) and (11.64) contain terms of the form a n J n (x). Clearly, any finite value of 
the constant a n would still give us a second solution of Bessel’s equation. Why should a n 
have the particular value implicit in Eqs. (11.62) and (11.64)? The answer involves the as¬ 
ymptotic dependence developed in Section 11.6. If J„ corresponds to a cosine wave, then 
N„ corresponds to a sine wave. This simple and convenient asymptotic phase relationship 
is a consequence of the particular admixture of J n in N „. 
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Recurrence Relations 


Substituting Eq. (11.60) for N v (x) (nonintegral v ) into the recurrence relations (Eqs. (11.10) 
and (11.12) for J n (x), we see immediately that N v (x) satisfies these same recurrence rela¬ 
tions. This actually constitutes another proof that N v is a solution. Note that the converse 
is not necessarily true. All solutions need not satisfy the same recurrence relations. An 
example of this sort of trouble appears in Section 11.5. 


Wronskian Formulas 


From Section 9.6 and Exercise 10.1.4 we have the Wronskian formula 17 for solutions of 
the Bessel equation, 

u v (x)v' v (x) - u' v (x)v v (x) = —, (11.69) 

x 

in which A v is a parameter that depends on the particular Bessel functions u v (x ) and 
v v (x) being considered. A v is a constant in the sense that it is independent of x. Consider 
the special case 


u v (x) — J v (x), v v (x) = J- V (x), 


(11.70) 


J v f_ v -J' v J-v=—. (11.71) 

x 

Since A v is a constant, it may be identified at any convenient point, such as x — 0. Using 
the first terms in the series expansions (Eqs. (11.5) and (11.6)), we obtain 




x 

2U4’ 

vx v ~ l 

2 v v\ 


J-V 


r 


2 v x~ 


(—v)! 

v2 v x~ v ~ l 
(—v)! 


Substitution into Eq. (11.69) yields 

J v (x)J'(x) - J'(x)J- v (x) — 


—2v 


xv!(-r)! 


2 sin V7T 


JtX 


(11.72) 


(11.73) 


using Eq. (8.32). Note that A v vanishes for integral v, as it must, since the nonvanishing of 
the Wronskian is a test of the independence of the two solutions. By Eq. (11.73), J„ and 
J-„ are clearly linearly dependent. 

Using our recurrence relations, we may readily develop a large number of alternate 
forms, among which are 

2 sin vtc 

J v J- v+ i + J- v J v -\ = -, (11.74) 

TCX 


l7 This result depends on Fix) of Section 9.5 being equal to p'(x)/p(x), the corresponding coefficient of the self-adjoint form 
of Section 10.1. 
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Jv J—v —1 “ 1 ” J— yJy-\-\ — ? 

7 XX 

(11.75) 

>- 

i 

II 

3J” 

(11.76) 

2 

JyNy-\- 1 — J V -\-\N V - . 

(11.77) 


IT X 


Many more will be found in the references given at chapter’s end. 

You will recall that in Chapter 9 Wronskians were of great value in two respects: (1) in 
establishing the linear independence or linear dependence of solutions of differential equa¬ 
tions and (2) in developing an integral form of a second solution. Here the specific forms 
of the Wronskians and Wronskian-derived combinations of Bessel functions are useful pri¬ 
marily to illustrate the general behavior of the various Bessel functions. Wronskians are of 
great use in checking tables of Bessel functions. In Section 10.5 Wronskians appeared in 
connection with Green’s functions. 


Example 11 . 3.1 Coaxial Wave Guides 

We are interested in an electromagnetic wave confined between the concentric, conducting 
cylindrical surfaces p = a and p — b. Most of the mathematics is worked out in Section 9.3 
and Example 11.1.2. To go from the standing wave of these examples to the traveling wave 
here, we let A — iB, A — a mn , B — b mn in Eq. (11.40a) and obtain 

E z = J2b m nJ m (YP)e ±im<p e i ^- a>t \ (11.78) 

m,n 

Additional properties of the components of the electromagnetic wave in the simple cylin¬ 
drical wave guide are explored in Exercises 11.3.8 and 11.3.9. For the coaxial wave guide 
one generalization is needed. The origin, p — 0, is now excluded (0 < a < p <b). Hence 
the Neumann function N m (yp) may not be excluded. E z (p, (p, z , t) becomes 

E z = Y\b mn J m (.yp) + c mn N m (yp)]e ±im ^e i{kz - M,) . (11.79) 

m,n 

With the condition 


H z = 0, (11.80) 

we have the basic equations for a TM (transverse magnetic) wave. 

The (tangential) electric field must vanish at the conducting surfaces (Dirichlet boundary 
condition), or 


bmn Jm(y Tl) 4“ C mn N m (y &) — 0, 


(11.81) 


bmn Jm ( K b) c mn N m ( y b) — 0. 


(11.82) 
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These transcendental equations may be solved for y(y mn ) and the ratio c mn /b mn . From 
Example 11.1.2, 

k 2 = co 2 ii 0 eo - y 2 — - y 2 - (11.83) 

c- 

Since k 2 must be positive for a real wave, the minimum frequency that will be propagated 
(in this TM mode) is 

co=yc, (11.84) 

with y fixed by the boundary conditions, Eqs. (11.81) and (11.82). This is the cutoff fre¬ 
quency of the wave guide. 

There is also a TE (transverse electric) mode, with E z = 0 and H- given by Eq. (11.79). 
Then we have Neumann boundary conditions in place of Eqs. (11.81) and (11.82). Finally, 
for the coaxial guide (not for the plain cylindrical guide, a — 0), a TEM (transverse elec¬ 
tromagnetic) mode, E z = H z = 0, is possible. This corresponds to a plane wave, as in free 
space. 

The simpler cases (no Neumann functions, simpler boundary conditions) of a circular 
wave guide are included as Exercises 11.3.8 and 11.3.9. 

To conclude this discussion of Neumann functions, we introduce the Neumann function 
N v (x) for the following reasons: 

1. It is a second, independent solution of Bessel’s equation, which completes the general 
solution. 

2. It is required for specific physical problems such as electromagnetic waves in coaxial 
cables and quantum mechanical scattering theory. 

3. It leads to a Green’s function for the Bessel equation (Sections 9.7 and 10.5). 

4. It leads directly to the two Hankel functions (Section 11.4). j 

Exercises 

11 . 3.1 Prove that the Neumann functions N n (with n an integer) satisfy the recurrence relations 

2 n 

Nn- t(x) + N n+ t(x) = — N„(x), 

X 

N n -i(x ) - N n+ i(x ) = 2 N'„(x). 

Elint. These relations may be proved by differentiating the recurrence relations for J v or 
by using the limit form of N v but not dividing everything by zero. 

11 . 3.2 Show that 

N- n {x) = {-\) n N n {x). 

11 . 3.3 Show that 

Nq(x) = —Ni(x). 
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11.3.4 If Y and Z are any two solutions of Bessel’s equation, show that 

Y v (x)Z' v (x) - Y'(x)Z v (x) = —, 

x 

in which A v may depend on v but is independent of x. This is a special case of Exer¬ 
cise 10.1.4. 


11.3.5 Verify the Wronskian formulas 


11.3.6 


11.3.7 


11.3.8 


J v (x)J- v+ l(x) + J-v(x)J v -l(x) = 


2 sin V7T 


nx 


J v {x)N’{x) 


J v (x)N v (x) = —. 

nx 


As an alternative to letting x approach zero in the evaluation of the Wronskian constant, 
we may invoke uniqueness of power series (Section 5.7). The coefficient of x~ l in the 
series expansion of u v (x)v' v (x) — u[,(x)v v (x) is then A v . Show by series expansion that 
the coefficients of x° and x 1 of J v (x)J'_ v {x) — J' v (x)J- v (x) are each zero. 


(a) 


By differentiating and substituting into Bessel’s ODE, show that 

) 

cos(v cosh?) dt 


f 


is a solution. 

Hint. You can rearrange the final integral as 


L 


00 d , . 

— {.r sin(x cosh r) sinh r] dt. 


dt 


(b) Show that 


Tt Jo 


No(x) — -/ cos(vcosh t)dt 


is linearly independent of Jo(x). 

A cylindrical wave guide has radius ro. Find the nonvanishing components of the elec¬ 
tric and magnetic fields for 


(a) TM 01 , transverse magnetic wave (//- = / 1 ( , = E, P = 0), 

(b) TE 01 , transverse electric wave (E z = E p = H v — 0). 

The subscripts 01 indicate that the longitudinal component (E z or //-) involves Jq and 
the boundary condition is satisfied by the first zero of Jq or . 

Hint. All components of the wave have the same factor: exp i (kz — cot). 

11.3.9 For a given mode of oscillation the minimum frequency that will be passed by a circular 
cylindrical wave guide (radius ro) is 

c 

Anin = T > 

A-c 
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in which X c is fixed by the boundary condition 

J n ( ~^ " j — 0 for TM„ m mode, 

J' n ° j — 0 for TE„ m mode. 

The subscript n denotes the order of the Bessel function and m indicates the zero 
used. Find this cutoff wavelength k c for the three TM and three TE modes with the 
longest cutoff wavelengths. Explain your results in terms of the graph of Jq, J\ , and .h 
(Fig. 11.1). 

11.3.10 Write a program that will compute successive roots of the Neumann function N„(x), 
that is a ns , where N n (a ns ) = 0. Tabulate the first five roots of Nq, A/), and N 2 . Check 
your values for the roots against those listed in AMS-55 (see Additional Readings of 
Chapter 8 for the full ref.). 

Check value, a 12 = 5.42968. 


11.3.11 


For the case m = 0, a = 1, and b — 2, the coaxial wave guide boundary conditions lead 
to 


/(*) = 


Jq(2x) 
Nq( 2x) 


Jq(x) 

No(x) 


(Fig. 11.6). 


(a) Calculate f(x) for x = 0.0(0.1)10.0 and plot / (x) versus x to find the approxi¬ 
mate location of the roots. 



Figure 11.6 f(x) of Exercise 11.3.11. 
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(b) Call a root-finding subroutine to determine the first three roots to higher precision. 

ANS. 3.1230. 6.2734, 9.4182. 

Note. The higher roots can be expected to appear at intervals whose length approaches 
n. Why? AMS-55 (see Additional Readings of Chapter 8 for the reference), gives an 
approximate formula for the roots. The function g(x) = Jq(x)Nq(2x ) — Jq(2x)Nq(x) is 
much better behaved than fix) previously discussed. 

11.4 Hankel Functions 

Many authors prefer to introduce the Hankel functions by means of integral representations 
and then to use them to define the Neumann function N v (z)- An outline of this approach is 
given at the end of this section. 


Definitions 

Because we have already obtained the Neumann function by more elementary (and less 
powerful) techniques, we may use it to define the Hankel functions //,' 11 (x) and Hp(x): 

H^\x) = J v {x) + iN v {x) (11.85) 

and 

Hp(x) = J v (x)-iN v (x). (11.86) 

This is exactly analogous to taking 

e ±ie = cos 6 ± i sin@. (11.87) 

For real arguments, hP and Hp are complex conjugates. The extent of the analogy will 
be seen even better when the asymptotic forms are considered (Section 11.6). Indeed, it is 
their asymptotic behavior that makes the Hankel functions useful. 

Series expansion of Hp(x) and Hp(x) may be obtained by combining Eqs. (11.5) and 
(11.63). Often only the first term is of interest; it is given by 


Hp(x)* 

Z 

' i — \nx + 1 + / 

Z 

~(y - 

In 2) H-, 

(11.88) 

7r 

71 



hPw* 

Xv-\)\(2 

Y+.. 

v > 0, 

(11.89) 


7r \x 

) 



Hpix)^ 

2 

' —i — \nx + l - 

2 

- i—(y 

— In 2) + • • • , 

(11.90) 

71 

71 



Hp(x)* 

71 \X ) 

V 

+ ••• 

v >0. 

(11.91) 
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Since the Hankel functions are linear combinations (with constant coefficients) of J v 
and N v , they satisfy the same recurrence relations (Eqs. (11.10) and (11.12)) 

H v -i(x) + H v+ i(x) = — H v (x), (11.92) 

x 

H v - i(jc) - H v+l (x) = 2H'(x), (11.93) 

for both H^hx) and H X2 \x). 

A variety of Wronskian formulas can be developed: 


tt( 2) w (i) u(i)zr(2) 4 

n v H v+] - H v 

(11.94) 

J v -iH^ - J V H^\ = —, 

17TX 

(11.95) 

J // (2) — J i h {2) — " 

Jv v ~ l Jv ~ X v iirx * 

(11.96) 


Example 11 . 4.1 Cylindrical Traveling Waves 

As an illustration of the use of Hankel functions, consider a two-dimensional wave problem 
similar to the vibrating circular membrane of Exercise 11 . 1 .25. Now imagine that the waves 
are generated at r = 0 and move outward to infinity. We replace our standing waves by 
traveling ones. The differential equation remains the same, but the boundary conditions 
change. We now demand that for large r the wave behave like 

U~ e Hkr-cot) ( 11 . 97 ) 

to describe an outgoing wave. As before, k is the wave number. This assumes, for sim¬ 
plicity, that there is no azimuthal dependence, that is, no angular momentum, or m — 0. In 
Sections 7.3 and 11 . 6 , H^\kr) is shown to have the asymptotic behavior (for r —> oo) 

{kr) ~ e ikr . ( 11 . 98 ) 

This boundary condition at infinity then determines our wave solution as 

U(r, t) — H^\kr)e~ icot . ( 11 . 99 ) 

This solution diverges as r -> 0, which is the behavior to be expected with a source at the 
origin. 

The choice of a two-dimensional wave problem to illustrate the Hankel function H^\z) 
is not accidental. Bessel functions may appear in a variety of ways, such as in the sepa¬ 
ration of conical coordinates. However, they enter most commonly in the radial equations 
from the separation of variables in the Helmholtz equation in cylindrical and in spheri¬ 
cal polar coordinates. We have taken a degenerate form of cylindrical coordinates for this 
illustration. Had we used spherical polar coordinates (spherical waves), we should have 
encountered index v = n + 5 , n an integer. These special values yield the spherical Bessel 
functions to be discussed in Section 11 . 7 . ■ 
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Contour Integral Representation of 
the Hankel Functions 

The integral representation (Schlaefli integral) 

may easily be established as a Cauchy integral for v — n, an integer (by recognizing that 
the numerator is the generating function (Eq. (11.1)) and integrating around the origin). 
If v is not an integer, the integrand is not single-valued and a cut line is needed in our 
complex plane. Choosing the negative real axis as the cut line and using the contour shown 
in Fig. 11.7, we can extend Eq. (11.100) to nonintegral v. Substituting Eq. (11.100) into 
Bessel’s ODE, we can represent the combined integrand by an exact differential that van¬ 
ishes as t -* ooe ±ln (compare Exercise 11.1.16). 

We now deform the contour so that it approaches the origin along the positive real axis, 
as shown in Fig. 11.8. For x > 0, this particular approach guarantees that the exact differ¬ 
ential mentioned will vanish as t —> 0 because of the e~ x ^' —»■ 0 factor. Hence each of the 
separate portions (oo e~ ,7T to 0) and (0 to oo e l7T ) is a solution of Bessel’s equation. We 
define 

1 r°° ellt rlt 

hV\x)=— f e (x/2)(t-l/t)M' ( 11 . 102 ) 

TC i J 0 oe-ix t v+l 

These expressions are particularly convenient because they may be handled by the method 
of steepest descents (Section 7.3). h[ 11 (x) has a saddle point at t — +i, whereas Hy\x) 
has a saddle point at t = —i. 





SR(n 


Figure 11.7 Bessel function contour. 
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3(0 



01(0 


Figure 11.8 Flankel function contours. 

The problem of relating Eqs. (11.101) and (11.102) to our earlier definition of the Hankel 
function (Eqs. (11.85) and (11.86)) remains. Since Eqs. (11.100) to (11.102) combined 
yield 

J v {x) = 1 -[hV\x) + H {2 \x)] (11.103) 

by inspection, we need only show that 

N v (x) = ^ [H?\x) - H™(x)]. (11.104) 

This may be accomplished by the following steps: 

1. With the substitutions t — e l7T /s for H ( v V) and t — e~ ,7T /s for H^\ we obtain 

hI ]) (x) = e~ iv;r H^(x), (11.105) 

H[ 2 \x) = e ,VJT H a l(x). (11.106) 

2. From Eqs. (11.103) (v -> -v), (11.105), and (11.106), 

J- V (.x)= \[e iv7T Hl}\x) + e- ivn Hl 2 \x)]. (11.107) 

3. Finally substitute J v (Eq. (11.103)) and ./_,, (Eq. (11.107)) into the defining equation 
for N v , Eq. (11.60). This leads to Eq. (11.104) and establishes the contour integrals 
Eqs. (11.101) and (11.102) as the Hankel functions. 

Integral representations have appeared before: Eq. (8.35) for IT") and various representa¬ 
tions of J v (z) in Section 11.1. With these integral representations of the Hankel functions, 
it is perhaps appropriate to ask why we are interested in integral representations. There 
are at least four reasons. The first is simply aesthetic appeal. Second, the integral repre¬ 
sentations help to distinguish between two linearly independent solutions. In Fig. 11.6, the 
contours C\ and C 2 cross different saddle points (Section 7.3). For the Legendre functions 
the contour for P n (z) (Fig. 12.11) and that for Q n (z) encircle different singular points. 
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Third, the integral representations facilitate manipulations, analysis, and the develop¬ 
ment of relations among the various special functions. Fourth, and probably most impor¬ 
tant of all, the integral representations are extremely useful in developing asymptotic ex¬ 
pansions. One approach, the method of steepest descents, appears in Section 7.3. A second 
approach, the direct expansion of an integral representation is given in Section 11.6 for the 
modified Bessel function K v (z). This same technique may be used to obtain asymptotic 
expansions of the confluent hypergeometric functions M and U — Exercise 13.5.13. 

In conclusion, the Hankel functions are introduced here for the following reasons: 

• As analogs of e ±lx they are useful for describing traveling waves. 

• They offer an alternate (contour integral) and a rather elegant definition of Bessel func¬ 
tions. 

• h[} ] is used to define the modified Bessel function K v of Section 11.5. 

Exercises 

11.4.1 Verify the Wronskian formulas 

(a) J v (x)H? y (x) - Jttx)H?\x) = 

(b) Mx)H^\x) - J’ v {x)H?\x) = 

(c) N v (x)Hl iy (x) - N' v (x)H?\x) = =£, 

(d) N v (x)H^\x) - N' v (.x)H?\x) = , 

(e) Hi l \x)Hi 2Y (x) - H^\x)H?\x) = , 

(f) Hl 2 \x)H^{x) - H^\x)H^_ x (x) = 

(g) J v - X {x)H?\x) - J v {x)Hl l \{x) = 

11.4.2 Show that the integral forms 

1 nooe in if 

(a) - e (-m-i/0 * =ff (D Wi 

IX JOCi t v+l 

(b) -f° . e (*/2)(r-l/0 * =ff (2 )(jc) 

m J ooe i71 C2 * 

satisfy Bessel’s ODE. The contours C\ and Co are shown in Fig. 11.8. 

11.4.3 Using the integrals and contours given in problem 11.4.2, show that 

^.[H^(x)- H (2 )(x)\ = N v (x). 

11.4.4 Show that the integrals in Exercise 11.4.2 may be transformed to yield 

(a) H^\x)=—( e xsiahy ~ vy dy, (b) H^ 2 \x) = — f e xsinhy ~ vy dy 

Jti Jc 3 Tci Jc 4 
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SK<y) 


Figure 11.9 Flankel function contours. 


(see Fig. 11.9). 

11.4.5 (a) Transform Eq. (11.101), into 

tf n ( 1 ) (x)= — [ e ixcoshs ds, 

m Jc 

where the contour C runs from —oo — in/2 through the origin of the ,v-plane to 
oo + in/2. 

(b) Justify rewriting Hq 1 \x) as 

o poo+in/2 

#«(*)=— / e ixcoshs ds. 

in Jq 

(c) Verify that this integral representation actually satisfies Bessel’s differential equa¬ 
tion. (The in/2 in the upper limit is not essential. It serves as a convergence factor. 
We can replace it by ian/2 and take the limit.) 

11.4.6 From 

? r °o 

H^\x)= — e ixcoshs ds 

m Jo 

show that 

2 2 f°° sin(xf) 

(a) J 0 (x)—— / sin(xcosh5)<ii, (b) / 0 (x) = — / dt. 

n Jo n J\ Vr 2 - 1 

This last result is a Fourier sine transform. 

11.4.7 From (see Exercises 11.4.4 and 11.4.5) 

o roo 

H ( ' ) ( X )=— / e ixcoshs ds 

in Jo 

show that 

2 r°° 

(a) Nq(x) — - / cos(xcosh.s)^5. 

n Jo 
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2 f°° cos (xt) 

(b) N 0 (x) = -/ V dt. 

* J i V/ 2 - 1) 

These are the integral representations in Section 11.3 (Other Forms). 

This last result is a Fourier cosine transform. 

11.5 Modified Bessel Functions, I v (x) and K v (x) 

The Helmholtz equation. 


vV + £ 2 f=o, 

separated in circular cylindrical coordinates, leads to Eq. (11.22a), the Bessel equation. 
Equation (11.22a) is satisfied by the Bessel and Neumann functions J v (kp) and N v (kp ) 
and any linear combination, such as the Hankel functions H^\kp) and il[ 1] (kp). Now, 
the Helmholtz equation describes the space part of wave phenomena. If instead we have a 
diffusion problem, then the Helmholtz equation is replaced by 


vV-£ 2 iA = o. 


(11.108) 


The analog to Eq. (11.22a) is 

d 2 d 

p 2 -Y v (kp) + p — Y v (kp)-{k 2 p 2 + v 2 )Y v (kp) = 0. (11.109) 

dp- dp 

The Helmholtz equation may be transformed into the diffusion equation by the trans¬ 
formation k -* ik. Similarly, k -> ik changes Eq. (11.22a) into Eq. (11.109) and shows 
that 


Y v (kp) — Z v (ikp). 

The solutions of Eq. (11.109) are Bessel functions of imaginary argument. To obtain a 
solution that is regular at the origin, we take Z v as the regular Bessel function J v . It is 
customary (and convenient) to choose the normalization so that 

Y v (x) = I v (x) = i~ v J v (ix). (11.110) 

(Here the variable kp is being replaced by x for simplicity.) The extra i~ v normalization 
cancels the i v from each term and leaves /,, (x) real. Often this is written as 


I v {x) = e- V7ti l 2 J v (xe in l 2 ). 


( 11 . 111 ) 


Iq and 7i are shown in Fig. 11.10. 
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Figure 11.10 Modified Bessel 
functions. 


Series Form 


In terms of infinite series this is equivalent to removing the (—l) s sign in Eq. (11.5) and 
writing 


OO , , \2s+ v oo 

'•W = E s -^TtjiG) ' = E 

s=0 ' \ / s=0 


1 


s =0 

For integral v this yields 


s!(s-v)! V2 


2 s—v 


. ( 11 . 112 ) 


I„(x) = I-n(x). 


(11.113) 


Recurrence Relations 


The recurrence relations satisfied by I v {x) may be developed from the series expansions, 
but it is perhaps easier to work from the existing recurrence relations for J v (x). Let us 
replace x by —ix and rewrite Eq. (11.110) as 

J v (x) = i v I v (—ix). (11.114) 

Then Eq. (11.10) becomes 

i v ~ 1 I v -i(-ix) + i v+l I v +\(—ix) = —i v I v (—ix). 

x 

Replacing x by ix, we have a recurrence relation for l v (x), 

2v 

! v -\ (x) - I v+ i(x) = — I v (x). 

X 


(11.115) 
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Equation (11.12) transforms to 

/„-!(*)+ /„+!(*) = 2/J(jc). (11.116) 


These are the recurrence relations used in Exercise 11.1.14. It is worth emphasizing that al¬ 
though two recurrence relations, Eqs. (11.115) and (11.116) or Exercise 11.5.7, specify the 
second-order ODE, the converse is not true. The ODE does not uniquely fix the recurrence 
relations. Equations (11.115) and (11.116) and Exercise 11.5.7 provide an example. 

From Eq. (11.113) it is seen that we have but one independent solution when v is an 
integer, exactly as in the Bessel functions J v . The choice of a second, independent solution 
of Eq. (11.108) is essentially a matter of convenience. The second solution given here 
is selected on the basis of its asymptotic behavior—as shown in the next section. The 
confusion of choice and notation for this solution is perhaps greater than anywhere else 
in this field. 18 Many authors 19 choose to define a second solution in terms of the Hankel 
function Hl}\x) by 

K v {x) = | i v+l H^\ix) = ^i v+l [J v (ix) + iN v (ix)]. (11.117) 

The factor i v+l makes K v (x) real when x is real. Using Eqs. (11.60) and (11.110), we may 
transform Eq. (11.117) to 20 


KJx) 


7T I- V (X) - I v (x) 
2 sin vtc 


(11.118) 


analogous to Eq. (11.60) for N v {x). The choice of Eq. (11.117) as a definition is somewhat 
unfortunate in that the function K v (x) does not satisfy the same recurrence relations as 
I v (x) (compare Exercises 11.5.7 and 11.5.8). To avoid this annoyance, other authors 21 
have included an additional factor of cos vn. This permits K v to satisfy the same recurrence 
relations as I v , but it has the disadvantage of making K v = 0 for v — _ 

The series expansion of K v (x) follows directly from the series form of H^\ix). The 
lowest-order terms are (cf. Eqs. (11.61) and (11.62)) 


Kq(x) = — ln.r — y + In2 H-, 

K v (x) = 2 v ~\v-iy.x~ v + ■■■ . (11.119) 


Because the modified Bessel function /„ is related to the Bessel function J v , much as sinh 
is related to sine, /„ and the second solution K v are sometimes referred to as hyperbolic 
Bessel functions. Kq and K\ are shown in Fig. 11.10. 

Iq(x) and Kq(x) have the integral representations 

i r 

I Q (x) = — / coshfr cos0)rf@, (11.120) 

n Jo 


Kq(x) = 



cos(xsinhr)<7f 


f°° cos (xt)dt 

Jo {t~ T l) 1 / 21 


x > 0. 


18 A discussion and comparison of notations will be found in Math. Tables Aids Comput. 1: 207-308 (1944). 
19 Watson, Morse and Feshbach, Jeffreys and Jeffreys (without the tt/2). 

20 For integral index n we take the limit as v —> n. 

21 Whittaker and Watson, see Additional Readings of Chapter 13. 


( 11 . 121 ) 
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Equation (11.120) may be derived from Eq. (11.30) for To CO or may be taken as a special 
case of Exercise 11.5.4, v = 0. The integral representation of Kq, Eq. (11.121), is a Fourier 
transform and may best be derived with Fourier transforms. Chapter 15, or with Green’s 
functions Section 9.7. A variety of other forms of integral representations (including v ^ 0) 
appear in the exercises. These integral representations are useful in developing asymptotic 
forms (Section 11.6) and in connection with Fourier transforms. Chapter 15. 

To put the modified Bessel functions 7 v ,(x) and K v (x) in proper perspective, we intro¬ 
duce them here because: 

• These functions are solutions of the frequently encountered modified Bessel equation. 

• They are needed for specific physical problems, such as diffusion problems. 

• K v (x) provides a Green’s function. Section 9.7. 

• K v (x) leads to a convenient determination of asymptotic behavior (Section 11.6). 


Exercises 


11 . 5.1 Show that 

OO 

e (x/2 )(r+l/f) = I„(x)t n , 

n =—oo 

thus generating modified Bessel functions, /„ (x). 

11 . 5.2 Verify the following identities 


OO 

(a) 1 = / 0 (x) + 2^](-1)"/ 2 „(x), 

n= 1 
oo 

(b) e x — Iq(x) + 2 ^2 I n (*), 

n =1 
oo 

(c) e- , = / 0 W+2^(-l)"/ 1 ,W ) 

n= 1 

oo 

(d) cosh.r = /q( x) + 2 ^ I 2n (x), 

n =1 
oo 

(e) sinhx = 2 E ^2n—\ (^)* 

n =1 


11 . 5.3 (a) From the generating function of Exercise 11.5.1 show that 


4(*)= 2 ~lj> exp[(x/2)(f+ 1/0]^-. 
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(b) For n — v, not an integer, show that the preceding integral representation may be 
generalized to 


7 n(-*) = ^f cxpiOc/lKt + l/t)]^. 


The contour C is the same as that for J v (x), Fig. 11.7. 

11 . 5.4 For v > — \ show that l v (z) may be represented by 


I V (z) = 


i)!\2 


f 


e ±zcos9 sin 2v 6 d6 


7T 1 / 2 (V 




V nJt /2 


L 


cosh(z cos 9) sin 2v OdQ. 


nVHv- ^)!\ 2 , 

11 . 5.5 A cylindrical cavity has a radius a and height /, Fig. 11.3. The ends, z = 0 and /, are at 
zero potential. The cylindrical walls, p — a, have a potential V = V((p, z). 

(a) Show that the electrostatic potential <F(p, q>, z) has the functional form 

OO OO 

d>(p, (p, z) = T, T, !,n (knP) sin k n z ■ ( Cl mn sin/77^ + b,nn cos m(p), 
m= 0 n =1 

where k n — null. 

(b) Show that the coefficients a mn and b mn are given by 22 


n l 


bmn J jzll m {k n a) Jq Jo 


V((p,z) sin k n z, ■ 


smnup 
cos nup 


dz d(p. 


Hint. Expand V((p, z.) as a double series and use the orthogonality of the trigonometric 
functions. 


11 . 5.6 Verify that K v (x) is given by 


7r I- V (x) - I v (x) 

Kv (x) = -- : - 

2 sin vrt 


and from this show that 


K v {x) — K- V (x). 

11 . 5.7 Show that K v (x) satisfies the recurrence relations 

2v 

K v -i(x) - K v +i(x) = - K v {x), 


K v _ ] (x) + K v+] (x) = -2K’ v (x). 


““When m = 0, the 2 in the coefficient is replaced by 1. 
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11 . 5.8 

11 . 5.9 


11 . 5.10 


11 . 5.11 


11 . 5.12 


11 . 5.13 


11 . 5.14 


If )C V = e V7TI K v , show that /C y satisfies the same recurrence relations as I v . 
For v > — \ show that K v (z) may be represented by 


K v (z) = 


7r 


1/2 


2 

7T 1 / 2 


v pOO 


L 


e - zcosh? sinh 2v tdt, 


71 


71 


(v-\)\\2/ Jo 


~2 <argZ< 2 


(v- 1 j 

Show that I v (x) and K v (x) satisfy the Wronskian relation 


I v (x)K'(x) - /' (x)K v (x) — 

x 

This result is quoted in Section 9.7 in the development of a Green’s function. 
If r — (x 2 + y 2 ) 1 / 2 . prove that 


_ 2 r 

n Jo 


This is a Fourier cosine transform of Kq. 


cos (xt)Ko(yt)dt. 


(a) Verify that 

1 r n 

I Q (x) = — / cosh(.tcos0)t/0 

Jf Jo 

satisfies the modified Bessel equation, v — 0. 

(b) Show that this integral contains no admixture of Kq(x), the irregular second solu¬ 
tion. 

(c) Verify the normalization factor 1 /n . 

Verify that the integral representations 

1 C 71 

I n (z) — — / e zcosr cos (nt)dt, 
n Jo 

poo 

K v (z) = I e ~ zcosht cosh(vt)dt, JH(z) > 0, 

Jo 

satisfy the modified Bessel equation by direct substitution into that equation. How can 
you show that the first form does not contain an admixture of K n and that the second 
form does not contain an admixture of /„? How can you check the normalization? 

Derive the integral representation 

I n {x) — — [ e xcose cos(n6)d0. 

* Jo 

Hint. Start with the corresponding integral representation of J n (x). Equation (11.120) 
is a special case of this representation. 
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11 . 5.15 Show that 

nOO 

K 0 (z) = / e~ zcosht dt 

Jo 

satisfies the modified Bessel equation. How can you establish that this form is linearly 
independent of /o(z)? 

11 . 5.16 Show that 

OO 

e ax = l()(a)T{)(x) + 2 l n (a)T n (x), -1 <* < 1. 

n =1 

T„(x) is the nth-order Chebyshev polynomial. Section 13.3. 

Hint. Assume a Chebyshev series expansion. Using the orthogonality and normalization 
of the T n (x), solve for the coefficients of the Chebyshev series. 

11 . 5.17 (a) Write a double precision subroutine to calculate I n (x) to 12-decimal-place accu¬ 

racy for n = 0, 1,2, 3,... and 0 < x < 1 . Check your results against the 10-place 
values given in AMS-55, Table 9.11, see Additional Readings of Chapter 8 for the 
reference. 

(b) Referring to Exercise 11.5.16, calculate the coefficients in the Chebyshev expan¬ 
sions of cosh.v and of si nil x. 

11 . 5.18 The cylindrical cavity of Exercise 11.5.5 has a potential along the cylinder walls: 

hoof, 0 < f < i, 

V(z) 

1100(1-1), 

With the radius-height ratio a / / = 0.5, calculate the potential for z/l — 0.1 (0.1)0.5 and 

p/a = 0.0(0.2)1.0. 

Check value. For z/l — 0.3 and p/a — 0.8, V = 26.396. 

11.6 Asymptotic Expansions 

Frequently in physical problems there is a need to know how a given Bessel or modified 
Bessel function behaves for large values of the argument, that is, the asymptotic behavior. 
This is one occasion when computers are not very helpful. One possible approach is to 
develop a power-series solution of the differential equation, as in Section 9.5, but now using 
negative powers. This is Stokes’ method. Exercise 11.6.5. The limitation is that starting 
from some positive value of the argument (for convergence of the series), we do not know 
what mixture of solutions or multiple of a given solution we have. The problem is to relate 
the asymptotic series (useful for large values of the variable) to the power-series or related 
definition (useful for small values of the variable). This relationship can be established by 
introducing a suitable integral representation and then using either the method of steepest 
descent. Section 7.3, or the direct expansion as developed in this section. 
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Expansion of an Integral Representation 

As a direct approach, consider the integral representation (Exercise 11.5.9) 

K v (z) = * (Y) f°° e- zx (x 2 -l) v ~ 1/2 dx, v>-\. (11.122) 

(v-4)!\2/ J i 2 

For the present let us take z to be real, although Eq. (11.122) may be established for 
—7r/2 < argz < 7r/2 (JH(z) > 0). We have three tasks: 

1. To show that K v as given in Eq. (11.122) actually satisfies the modified Bessel equa¬ 
tion (11.109). 

2. To show that the regular solution I v is absent. 

3. To show that Eq. (11.122) has the proper normalization. 


1. The fact that Eq. (11.122) is a solution of the modified Bessel equation may be verified 
by direct substitution. We obtain 

/ oo A 

£[c-v-ir +1/ >=o, 

which transforms the combined integrand into the derivative of a function that vanishes at 
both endpoints. Hence the integral is some linear combination of I v and K v . 

2. The rejection of the possibility that this solution contains I v constitutes Exer¬ 
cise 11.6.1. 


3. The normalization may be verified by showing that, in the limit z 
agreement with Eq. (11.119). By substituting x = 1 + t/z, 

A ' 2 


(v-i)!\2 


V nc 

J 1 


V-l) 


v—1/2 


7r 


1/2 


(V - I)! 


2 6 




dx 


21\ 


v—1/2 


dt 


— H- — 


2 / 


7T 1 / 2 e z 
(v- i)!2V 7 


f 


e-'t 2v ~ l 


1 + ^ 
t 


v—1/2 


dt , 


0, K v (z) is in 


(11.123a) 

(11.123b) 


taking out t 2 /z 2 as a factor. This substitution has changed the limits of integration to a more 
convenient range and has isolated the negative exponential dependence e~ z . The integral 
in Eq. (11.123b) may be evaluated for z = 0 to yield (2v — 1)!. Then, using the duplication 
formula (Section 8.4), we have 


(v- 1)!2 V_1 

Ym\K v {z) = -, v > 0, 

z^o z v 


(11.124) 


in agreement with Eq. (11.119), which thus checks the normalization. 23 


2 ^For v —>• 0 the integral diverges logarithmically, in agreement with the logarithmic divergence of Kq{z) for z —*■ 0 (Sec- 
tion 11.5). 
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Now, to develop an asymptotic series for K v (z), we may rewrite Eq. (11.123a) as 


K v (z) = If £ [ e-'t v - l ' 2 (l + f) 

V2z(y-l)lJo V 2 z) 


v—1/2 


dt 


(11.125) 


(taking out 2 t/z as a factor). 

We expand (1 + f/2z) v_1 / 2 by the binomial theorem to obtain 


K v {z) = 


ix e 




2z 


- l t v+r - l/2 dt. 


(11.126) 


Term-by-term integration (valid for asymptotic series) yields the desired asymptotic ex¬ 
pansion of K v (z ): 


KJz) 



(4r> 2 — 1 2 )(4 u 2 — 3 2 ) 

2!(8z) 2 + 


(11.127) 


Although the integral of Eq. (11.122), integrating along the real axis, was convergent only 
for —tx/2 < arg z < 7r/2, Eq. (11.127) may be extended to —3 jt/ 2 < argz < 3jt/2. Con¬ 
sidered as an infinite series, Eq. (11.127) is actually divergent. 24 However, this series is 
asymptotic, in the sense that for large enough z, K v (z) may be approximated to any fixed 
degree of accuracy with a small number of terms. (Compare Section 5.10 for a definition 
and discussion of asymptotic series.) 

It is convenient to rewrite Eq. (11.127) as 


where 


/Uz)~ 1 


z [ p v(iz) + iQv(iz)], 


(M—1)(M —9) (/r ~ 1)(M ~ 9)(/r — 25) (/x — 49) 

2!(8z) 2 4! (8z) 4 


(11.128) 


(11.129a) 


and 


QAz) 


/x — 1 

l!(8z) 


(/x- l)(/x-9)Qu -25) 
3!(8z) 3 


(11.129b) 


/x = 4v 2 . 

It should be noted that although P v (z) of Eq. (11.129a) and Q v (z) of Eq. (11.129b) have 
alternating signs, the series for P v (iz) and Q v (iz) of Eq. (11.128) have all signs positive. 
Finally, for z large, P v dominates. 

Then with the asymptotic form of K v (z), Eq. (11.128), we can obtain expansions for all 
other Bessel and hyperbolic Bessel functions by defining relations: 


24 Our binomial expansion is valid only for t < 2z and we have integrated t out to infinity. The exponential decrease of the 
integrand prevents a disaster, but the resultant series is still only asymptotic, not convergent. By Table 9.3, z = oo is an essential 
singularity of the Bessel (and modified Bessel) equations. Fuchs’ theorem does not guarantee a convergent series and we do not 
get a convergent series. 
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1. From 


we have 


7r 
2 


i v+1 H^(iz) = K v (z) 


(11.130) 


H, 


(1) (z) = x j — exp 
HZ 


1 \ 7T 


Z ~' V+ 2 2 


[P v (z) + i Q v (z)\, 


-7t < argz < 2tx. 


(11.131) 


2. The second Hankel function is just the complex conjugate of the first (for real argu¬ 
ment). 


Hv 2) (z) = J — exp 


7TZ 

[P v (z)-iQ v (z )] 


1\ 7T 


Z ~' V+ 2 2 


-2ix < argz < 7T. 


(11.132) 


An alternate derivation of the asymptotic behavior of the Hankel functions appears in 
Section 7.3 as an application of the method of steepest descents. 

3. Since J v (z ) is the real part of h[}\z) for real z. 


Jviz) = J — 
TtZ 


P v (z) cos 
- Q v (z) sin 


1\ n 

V — } — 

2 2 


1 \ TX 


Z ~' V+ 2 2 


—7r<argz<7r, (11.133) 


holds for real z, that is, argz = 0, n. Once Eq. (11.133) is established for real z, the 
relation is valid for complex z in the given range of argument. 


4. The Neumann function is the imaginary part of (z) for real z, or 


N v (z) = J — 

TCZ 



( 1 \ zt 

P v (z) sin 

r( v+ 2j2j 


Qv(z) COS 


1 \ 7T 

v H— ) — 

2 2 


-7r<argz<7r. (11.134) 


Initially, this relation is established for real z, but it may be extended to the complex 
domain as shown. 

5. Finally, the regular hyperbolic or modified Bessel function l v (z) is given by 

I viz) — i~ v J v (iz) (11.135) 


or 


Iviz) = 


\j2ztz 


[Pviiz) - iQ v (iz)\. 


7X It 

~2 < argZ < 2 ‘ 


(11.136) 
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Figure 11.11 Asymptotic approximation of Jo(x). 


This completes our determination of the asymptotic expansions. However, it is perhaps 
worth noting the primary characteristics. Apart from the ubiquitous z ~ 1 2 , J v and N v be¬ 
have as cosine and sine, respectively. The zeros are almost evenly spaced at intervals of 
7r; the spacing becomes exactly n in the limit as z —> oo. The Hankel functions have been 
defined to behave like the imaginary exponentials, and the modified Bessel functions /„ 
and K v go into the positive and negative exponentials. This asymptotic behavior may be 
sufficient to eliminate immediately one of these functions as a solution for a physical prob¬ 
lem. We should also note that the asymptotic series P v (z ) and Q v (z), Eqs. (11.129a) and 
(11.129b), terminate for v = ±1/2, ±3/2,... and become polynomials (in negative powers 
of z). For these special values of v the asymptotic approximations become exact solutions. 

It is of some interest to consider the accuracy of the asymptotic forms, taking just the 
first term, for example (Fig. 11.11), 



Clearly, the condition for the validity of Eq. (11.137) is that the sine term be negligible; 
that is, 

8x » 4n 2 — 1. (11.138) 

For n or v > 1 the asymptotic region may be far out. 

As pointed out in Section 11.3, the asymptotic forms may be used to evaluate the various 
Wronskian formulas (compare Exercise 11.6.3). 


Exercises 

11 . 6.1 In checking the normalization of the integral representation of K v (z) (Eq. (11.122)), we 
assumed that I v (z) was not present. How do we know that the integral representation 
(Eq. (11.122)) does not yield K v (z) + sl v (z) with s ^ 0? 
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Figure 11.12 Modified Bessel function contours. 


11 . 6.2 (a) Show that 

y(z) = z v J e~ z, (t 2 - l) v ~ l/2 dt 

satisfies the modified Bessel equation, provided the contour is chosen so that 

e~ z, (t 2 - 1) V+W2 

has the same value at the initial and final points of the contour. 

(b) Verify that the contours shown in Fig. 11.12 are suitable for this problem. 

11 . 6.3 Use the asymptotic expansions to verify the following Wronskian formulas: 

(a) J v (x)J- v -i(x) + J- v (x)J v+ i(.r) = — IsinvTt/ tix, 

(b) J v (x)N v +i(x) - J v+ \(x)N v (x) — -2/nx, 

(c) J v {x)H[ 2 \(x) - J v -i(x)H^ 2 \x) — 2/inx, 

(d) I v (x)K' v (x) - /' (x)K v (x) = -l/x, 

(e) I v (x)K v+ i(x) + I v+ i(x)K v (x) = l/x. 

11 . 6.4 From the asymptotic form of K v (z), Eq. (11.127), derive the asymptotic form of 
Hv l \z), Eq. (11.131). Note particularly the phase, (v + \)n/ 2. 

11 . 6.5 Stokes’ method. 

(a) Replace the Bessel function in Bessel’s equation by x~ l ^ 2 y(x) and show that v (x ) 
satisfies 

y"(x) + ^1-= °- 

(b) Develop a power-series solution with negative powers of x starting with the as¬ 
sumed form 

OO 

y(x) = e lx ^ a n x~ n . 

n =0 

Determine the recurrence relation giving a n+ \ in terms of a„. Check your result 
against the asymptotic series, Eq. (11.131). 

(c) From the results of Section 7.4 determine the initial coefficient, 
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11 . 6.6 Calculate the first 15 partial sums of Pq(x) and Qo(x), Eqs. (11.129a) and (11.129b). 
Let x vary from 4 to 10 in unit steps. Determine the number of terms to be retained 
for maximum accuracy and the accuracy achieved as a function of x. Specifically, how 
small may x be without raising the error above 3 x 10 -6 ? 

ANS. Xmin — 6. 

11 . 6.7 (a) Using the asymptotic series (partial sums) Po(x) and Qq(x) determined in Exer¬ 

cise 11.6.6, write a function subprogram FCT(X) that will calculate Jo(x). x real, 
for X > A’mm. 

(b) Test your function by comparing it with the Jq(x) (tables or computer library 
subroutine) for x — .r m in(10).r m in +10. 

Note. A more accurate and perhaps simpler asymptotic form for Jq(x) is given in AMS- 
55, Eq. (9.4.3), see Additional Readings of Chapter 8 for the reference. 

11.7 Spherical Bessel Functions 

When the Helmholtz equation is separated in spherical coordinates, the radial equation has 
the form 


7 d 2 R dR r 7 7 i 

r 2 — T +2r — + \k 2 r 2 - n(n + 1)1 R = 0. (11.139) 

dr z dr 

This is Eq. (9.65) of Section 9.3. The parameter k enters from the original Helmholtz 
equation, while n(n + 1) is a separation constant. From the behavior of the polar angle 
function (Legendre’s equation. Sections 9.5 and 12.5), the separation constant must have 
this form, with n a nonnegative integer. Equation (11.139) has the virtue of being self- 
adjoint, but clearly it is not Bessel’s equation. However, if we substitute 


R(kr) = 


Z(kr ) 

(kr )U 2 ’ 


Equation (11.139) becomes 


r 


2 


d 2 Z 

dr 2 


dZ 

r - 

dr 




2-1 


Z = 0, 


(11.140) 


which is Bessel’s equation. Z is a Bessel function of order n + \ (n an integer). Because 
of the importance of spherical coordinates, this combination, that is, 

Zn+l /2{kr ) 

(kr) 1 / 2 


occurs quite often. 
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Definitions 


It is convenient to label these functions spherical Bessel functions with the following defin¬ 
ing equations: 


jn(x) = 
n n (x) = 


hn\x ) = 


h ( n\x) = 


^A?„ + 1 / 2 (X) = (“I )" +l ^J-n-l / 2 (x), 


^ H n+ 1/2 M = 2n(-*) + 


= ./«(*) - i«nW- 


25 


(11.141) 


These spherical Bessel functions (Figs. 11.13 and 11.14) can be expressed in series form 
by using the series (Eq. (11.5)) for J„, replacing n with n + 


■hi ) 1 / 2 (■ V .) — ^ ' 


(-1) S 


s=0 s\(s + n + j)! V 2 


2s+n+l/2 


Using the Legendre duplication formula, 

z!(z + j)! = 2 _2z_1 7r 1 / 2 (2z + 1)!, 

we have 

/ir^(-iy2 2s+2n+ \s+ny. hx\ 2s+n+l/2 
U) ~~ V 2x ^ 7t 1 / 2 (2i + 2n + l)!s! \2 

i=0 


(11.142) 


(11.143) 


= 2 n x n 


s =0 


(-1 Y(s + n)\ 2s 
s ! (2s +2n + \)\ X ' 


Now, N„+ 1 / 2 (*) = (—1)" +1 J-„-i/ 2 (x) and from Eq. (11.5) we find that 


j-n- 1/2 CO = y 


(-l) s 


—( sl(s-n - i)! \2 


j=0 


2s—n —1/2 


This yields 


OH-1/2 00 

"»w = (- d" + VE 


(-1 y 


S\(s - n - 2 y-\ 2 


2s 


(11.144) 


(11.145) 


(11.146) 


~ 5 This is possible because cos(/i + j)jt = 0, see Eq. (11.60). 
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The Legendre duplication formula can be used again to give 


_ (-l)* +1 ^ (— iy (s - ny. ^ 

2 n x n +i 2—i s\(2s — 2n)\ 

j=0 


(11.147) 


These series forms, Eqs. (11.144) and (11.147), are useful in three ways: (1) limiting values 
as x -> 0, (2) closed-form representations for n = 0, and, as an extension of this, (3) an 
indication that the spherical Bessel functions are closely related to sine and cosine. 

For the special case n = 0 we find from Eq. (11.144) that 


jo(x) = £ 


s =0 


i-iy 

(2s + 1)! 


2s 


sinx 


(11.148) 


whereas for no, Eq. (11.147) yields 

cos.r 

n 0 (x) = -. (11.149) 

x 

From the definition of the spherical Hankel functions (Eq. (11.141)), 

(l) 1 / 

/z (*) = -(sin* — i cosx) =- e ', 

' x X 

h ( ?(x) — -(sin.t + i cosx) = —e~ lx . (11.150) 

X X 

Equations (11.148) and (11.149) suggest expressing all spherical Bessel functions as 
combinations of sine and cosine. The appropriate combinations can be developed from the 
power-series solutions, Eqs. (11.144) and (11.147), but this approach is awkward. Actually 
the trigonometric forms are already available as the asymptotic expansion of Section 11.6. 
From Eqs. (11.131) and (11.129a), 


h£Hx) = 


— H {1) 

2z "+ 1 / 2 


(z) 


= (-i) n+Xe - r {P n+ l,2(z) + iQn+X/2(z)}. (11.151) 

Now, P/i+i /2 and <2n+i/2 are polynomials. This means that Eq. (11.151) is mathematically 
exact, not simply an asymptotic approximation. We obtain 


h^(z) = (-i) n+r ^Y 


(2n + 2s)l\ 


z ^s'.(8z) s (2n-2s)'.\ 

s =0 


= (-o" +1 -£ 


(n +s)! 


Z ^!(2z) J (n — ^)! 

5=0 


(11.152) 


Often a factor (—/)" = (e l7l ! 2 ) n will be combined with the e lz to give e ,(z n7T / 2 '). For 

( 2 ) 

Z real, j n (z) is the real part of this, n„(z) the imaginary part, and h„ (z) the complex 
conjugate. Specifically, 


h[ l) (x) — e l 


x 


(11.153a) 
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and so on. 


h[ l \x) — e‘ 


3 

x 2 



j\ (x) = 


sinx 


cosx 

X 



n . 3 

- I sinx-» cosx, 

x ) x 2 


cos x sin x 
n\{x) = - -= - 

X z X 


( 3 1\ 3 

m(x) — — ( —7-I cos x - j sinx, 

\x i x) x L 


(11.153b) 


(11.154) 


(11.155) 


Limiting Values 


For x « I/ 0 Eqs. (11.144) and (11.147) yield 

2" ft! 

jn(x') ———r-7x 


(2n + l)l (2/7 + 1)!!’ 

m,>* 


(11.156) 


2 n (-2 n)\ 

(2 


2"n!' 


= —(2n — l)!!x 


—n—1 


(11.157) 


The transformation of factorials in the expressions for n n (x) employs Exercise 8.1.3. The 
limiting values of the spherical Hankel functions go as ±in n (x). 

The asymptotic values of j n , n„, and may be obtained from the Bessel asymp¬ 
totic forms. Section 11.6. We find 


1 ( nn 

jn(x )-sin x- — , 

x V 2 


1 / mt 

n n (x) - COS X-— , 

x \ 2 


(11.158) 

(11.159) 


Jx J(x—nn/ 2) 

a£ 1 ) (x)~(-«t +1 - = -/--, 


p-ix p-i{x-nn/ 2) 
h?\x)~i"+ 1—= i--■ 


(11.160a) 

(11.160b) 


26 The condition that the second term in the series be negligible compared to the first is actually x 2[(2 n + 2)(2 n + 3)/ 

(n + 1)] 1/2 for j n (x). 
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The condition for these spherical Bessel forms is that x y>> n(n + l)/2. From these as¬ 
ymptotic values we see that j„{x) and n n (x) are appropriate for a description of standing 
spherical waves; h„\x) and h < n > (x) correspond to traveling spherical waves. If the time 

dependence for the traveling waves is taken to be e~ uot , then h^„\x) yields an outgoing 
( 2 ) 

traveling spherical wave, h n (x) an incoming wave. Radiation theory in electromagnetism 
and scattering theory in quantum mechanics provide many applications. 


Recurrence Relations 


The recurrence relations to which we now turn provide a convenient way of developing the 
higher-order spherical Bessel functions. These recurrence relations may be derived from 
the series, but, as with the modified Bessel functions, it is easier to substitute into the known 
recurrence relations (Eqs. (11.10) and (11.12)). This gives 


2 « + 1 

fn-\(x) + fn+l(x) = - f n (x), 


(11.161) 


nf„- i(x) - (n + !)/„+,(x) = (2n + 1 )f' n {x). (11.162) 

Rearranging these relations (or substituting into Eqs. (11.15) and (11.17)), we obtain 
d 


fn(x)]= X n+l f n - l(x), 


(11.163) 


-j^[x n fn(x)\ = -x n f n+ l(x). 


(11.164) 


Here /„ may represent j n , n n , or . 

The specific forms, Eqs. (11.154) and (11.155), may also be readily obtained from 
Eq. (11.164). 

By mathematical induction we may establish the Rayleigh formulas 


jnix) — (—l)"x"( --f 
x ax 


sinx 


(11.165) 


Unix) = -(-l) n X n (--^- 

\x ax 

A®W = i(-Dv(lf )"(—)• 

\x dx J \ x ) 


(11.166) 


(11.167) 
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We may take the orthogonality integral for the ordinary Bessel functions (Eqs. (11.49) and 
(11.50)), 



and substitute in the expression for j n to obtain 



(11.168) 


(11.169) 


Here a np and a nq are roots of j n . 

This represents orthogonality with respect to the roots of the Bessel functions. An illus¬ 
tration of this sort of orthogonality is provided in Example 11.7.1, the problem of a particle 
in a sphere. Equation (11.169) guarantees orthogonality of the wave functions j n (r) for 
fixed n. (If /? varies, the accompanying spherical harmonic will provide orthogonality.) 


Example 11.7.1 Particle in a Sphere 


An illustration of the use of the spherical Bessel functions is provided by the problem of 
a quantum mechanical particle in a sphere of radius a. Quantum theory requires that the 
wave function i jr, describing our particle, satisfy 


h 2 2 

-V“l/r = Ex/f, 

2m 


(11.170) 


and the boundary conditions (1) \jr{r < a) remains finite, (2) \l/(a) = 0. This corresponds 
to a square-well potential V — 0, r < «, and V = oo, r > a. Here h is Planck’s constant 
divided by 2it, m is the mass of our particle, and E is, its energy. Let us determine the 
minimum value of the energy for which our wave equation has an acceptable solution. 
Equation (11.170) is Helmholtz’s equation with a radial part (compare Section 9.3 for 
separation of variables): 


d 2 R 2dR 
dr 2 r dr 


k 2 


n(n + 1) 
r- 


R = 0, 


(11.171) 


with k 2 — 2mE/h 2 . Hence by Eq. (11.139), with n — 0, 


R = Ajo(kr) + Bno(kr). 

We choose the orbital angular momentum index n — 0, for any angular dependence would 
raise the energy. The spherical Neumann function is rejected because of its divergent be¬ 
havior at the origin. To satisfy the second boundary condition (for all angles), we require 

V 2m E 

ka = 


h 


a = a, 


(11.172) 
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where a is a root of jo, that is, jo (a ) = 0. This has the effect of limiting the allowable 
energies to a certain discrete set, or, in other words, application of boundary condition (2) 
quantizes the energy E. The smallest a is the first zero of jo, 

a — tv, 


and 


n 2 h 2 h 2 
2m a 2 8ma 2 


(11.173) 


which means that for any finite sphere the particle energy will have a positive minimum 
or zero-point energy. This is an illustration of the Heisenberg uncertainty principle for A p 
with A r < a. 

In solid-state physics, astrophysics, and other areas of physics, we may wish to know 
how many different solutions (energy states) correspond to energies less than or equal to 
some fixed energy Eq. For a cubic volume (Exercise 9.3.5) the problem is fairly simple. 
The considerably more difficult spherical case is worked out by R. H. Lambert, Am. J. 
Phys. 36:417, 1169(1968). 

The relevant orthogonality relation for the j n ( kr ) can be derived from the integral given 
in Exercise 11.7.23. ■ 


Another form, orthogonality with respect to the indices, may be written as 

/ OO 

jm (x ) j„(x)dx = 0, m^n, m,n> 0. (11.174) 

-OO 

The proof is left as Exercise 11.7.10. If m—n (compare Exercise 11.7.11), we have 

f°°[jn(x)] 2 dx = —(11.175) 
J-O O 2n + 1 

Most physical applications of orthogonal Bessel and spherical Bessel functions involve 
orthogonality with varying roots and an interval [0, a] and Eqs. (11.168) and (11.169) and 
Exercise 11.7.23 for continuous-energy eigenvalues. 

The spherical Bessel functions will enter again in connection with spherical waves, but 
further consideration is postponed until the corresponding angular functions, the Legendre 
functions, have been introduced. 


Exercises 


11 . 7.1 Show that if 


it automatically equals 


n„(x) 



N n +\/ 2 (x), 


(-D 


n +1 



1/2 CO - 
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11.7.2 


11.7.5 


11.7.6 


Derive the trigonometric-polynomial forms of j n (z) and n n (z). 

[«/ 2 ] 


jn(z)=^sin(z-™)J 2 


s =0 


(-l) s (n + 2s)l 

(2s)\(2z) 2s (n-2s)\ 


1 / VLTC \ ^—> 

+ cos ^ 


1(h-1)/2] 


s=0 
[«/ 2 ] 


, ^ (~ 1)" +1 ( nn \ ^ 

«n(z) = -;-cosl z H—— 1 


+ 


(- 1 ) 


fl+1 


■sm(z + f) £ 

' i=0 


(—l)*(n + 2s + 1)! 

(2s + \)\(2z) 2s (n-2s - 1)!’ 

(—l) s (n + 2s)! 

(2i)!(2z) 2s (n -2s)l 

(-!)>+2s+ 1)! 


j=0 

\ [(h-D/21 


(2s + l)!(2z) 2s+1 (« — 2s — 1)!' 


11.7.3 Use the integral representation of J v (x ), 


Jv(x) = 


1 


y f\ ±ixp (i- P 2 y - 1/2 d p, 


7T l/ 2 (v _ j)! \2, 

to show that the spherical Bessel functions j n (x ) are expressible in terms of trigono¬ 
metric functions; that is, for example. 


sinx 


70 CO = 

X 

11.7.4 (a) Derive the recurrence relations 


71 CO = 


sin a cos x 


2n + 1 

fn -lW + fn+l(x) — - fn(x), 

X 

nfn- 1(0 - (« + l)/n+iCO = (2n + 0/^(0 

satisfied by the spherical Bessel functions j n (x ), n n (x), h[}\x), and h\c\x). 

(b) Show, from these two recurrence relations, that the spherical Bessel function /„ (x) 
satisfies the differential equation 

x 2 fn(x) + 2 */„'CO + [ x 2 - «(n + 1 )]/,(jc) = 0. 

Prove by mathematical induction that 


7»C0 = (- 1)V '(--f 

x dx 


sin.v 


for n an arbitrary nonnegative integer. 

From the discussion of orthogonality of the spherical Bessel functions, show that a 
Wronskian relation for j n (x) and n„ (x) is 

, , 1 
jn(x)n n (x) - j n (x)n n (x) = -r-. 


27 The upper limit on the summation [n/2\ means the largest integer that does not exceed n/2. 
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11.7.7 


11.7.8 


11.7.9 


11.7.10 


11.7.11 


11.7.12 


11.7.13 


11.7.14 


Verify 

Verify Poisson’s integral representation of the spherical Bessel function, 


jn (z) = 


n r>n 

—— / cos(zcos 0 ) sin 2,,+I 9 dO. 
2 n+l n\ J o 


Show that 



J/x(x)J v (x) 


dx 

x 


2 sin[(/x — v)n/2] 
ix /x 2 — v 2 


\x + v > — 1 . 


Derive Eq. (11.174): 


Derive Eq. (11.175): 



jm(x ) jn(x) dx = 0 , 


m 7 ^ n 

777 , ?! > 0 . 



n 

2n + 1 ' 


Set up the orthogonality integral for jL(kr) in a sphere of radius R with the boundary 
condition 


j L (kR) — 0. 

The result is used in classifying electromagnetic radiation according to its angular mo¬ 
mentum. 


The Fresnel integrals (Fig. 11.15 and Exercise 5.10.2) occurring in diffraction theory 
are given by 

= = f Q cos i v2 ) dv ’ = = J 0 sm ( v2 ) dv - 

Show that these integrals may be expanded in series of spherical Bessel functions 


1 f S 

X(S) = - / j-i(u)u l/2 du =S l/2 y2hn(s), 

1 Jo r, 

n=0 

1 f S ^ 

y(s)=- / jo(u)u 1/2 du = s 1/2 V';'2„ + i(i). 

Z J0 r. 


Hint. To establish the equality of the integral and the sum, you may wish to work with 
their derivatives. The spherical Bessel analogs of Eqs. (11.12) and (11.14) are helpful. 


A hollow sphere of radius a (Helmholtz resonator) contains standing sound waves. Find 
the minimum frequency of oscillation in terms of the radius a and the velocity of sound 
v. The sound waves satisfy the wave equation 


V 2 i/r = 


1 3 2 t/? 
v 2 3 1 2 
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Figure 11.15 Fresnel integrals. 


and the boundary condition 


3 V'" 
dr 


= 0 , 


r — a. 


This is a Neumann boundary condition. Example 11.7.1 has the same PDE but with a 
Dirichlet boundary condition. 


ANS. R m j n = 0.3313i>/a, 7. max = 3.018a. 
11.7.15 Defining the spherical modified Bessel functions (Fig. 11.16) by 


show that 





ko(x) — -. 

x 


Note that the numerical factors in the definitions of i n and k n are not identical. 

11.7.16 (a) Show that the parity of i n (x) is (—1)". 

(b) Show that k„ (x) has no definite parity. 
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Figure 11.16 Spherical modified Bessel 
functions. 
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11.7.19 


11.7.20 


11.7.21 


11.7.22 


2 n + 1 

(b) k„-i(x) - k n+ i(x) — - k„(x), 

x 

nk n -\{x) + (,n + l)k n+ \(x) — -(2 n + 1 )k' n (x). 

Derive the limiting values for the spherical modified Bessel functions 


(a) 

(b) 


in (X) ; 


(In + !)!!’ 


k„(x) ■ 


(2 n - 1)!! 

vB+l ’ 


x <5C 1. 


in(x) ~ , 


k n (x) -, 

X 


x » -n(n + 1). 


Show that the Wronskian of the spherical modified Bessel functions is given by 

, , 1 

in (x)k (x) - i (x)k n (x) = - 

X- 

A quantum particle of mass M is trapped in a “square” well of radius a. The Schrodinger 
equation potential is 


— Vo, 0 < r < a 
0 , r > a. 


V(r) = 

The particle’s energy E is negative (an eigenvalue). 


(a) Show that the radial part of the wave function is given by y) (k\ r) for 0 < r < a 
and ki(k 2 r) for r > a. (We require that \f/(0) be finite and i/ / (oo) —>• 0.) Here 


kj = 2 M(E + Vo)/h 2 ,k% — —2 ME/ti z , and / is the angular momentum (n in 
Eq. (11.139)). 

(b) The boundary condition at r — a is that the wave function i// (r) and its first deriv¬ 
ative be continuous. Show that this means 

(d/dr)jt(k\r ) _ (, d/dr)k l (k 2 r) 

jt (k\r) r=a ki(k 2 r ) 

This equation determines the energy eigenvalues. 

Note. This is a generalization of Example 10.1.2. 

The quantum mechanical radial wave function for a scattered wave is given by 

sin (kr + Sq ) 


fk 


kr 


where k is the wave number, k = -J2mE/ft, and So is the scattering phase shift. Show 
that the normalization integral is 


f 


7r 


'l'k(r)i' k '(.r)r dr = —S(k-k'). 

2k 


Flint. You can use a sine representation of the Dirac delta function. See Exercise 15.3.8. 
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11 . 7.23 


11 . 7.24 


11 . 7.25 


11 . 7.26 


Derive the spherical Bessel function closure relation 

jn(ar)j n (br)r 2 dr = 8(a - b). 

Note. An interesting derivation involving Fourier transforms, the Rayleigh plane-wave 
expansion, and spherical harmonics has been given by P. Ugincius, Am. J. Phys. 40 : 
1690(1972). 

(a) Write a subroutine that will generate the spherical Bessel functions, j n (x) , that is, 
will generate the numerical value of /„ (x) given x and n. 

Note. One possibility is to use the explicit known forms of jo and j\ and to develop 
the higher index j n , by repeated application of the recurrence relation. 

(b) Check your subroutine by an independent calculation, such as Eq. (11.154). If 
possible, compare the machine time needed for this check with the time required 
for your subroutine. 

The wave function of a particle in a sphere (Example 11.7.1) with angular momen¬ 
tum l is \j/(r.9,cp) — Aji{{^/2ME)r/h)Y™{6, <p). The Yj n (9.(p ) is a spherical har¬ 
monic, described in Section 12.6. From the boundary condition jr(a,6,q>) — 0 or 
jl((\/2ME)a/h) — 0 calculate the 10 lowest-energy states. Disregard the m degen¬ 
eracy (21 + 1 values of m for each choice of /). Check your results against AMS-55, 
Table 10.6, see Additional Readings for Chapter 8 for the reference. 

Hint. You can use your spherical Bessel subroutine and a root-finding subroutine. 

Check values. ji(ai s ) = 0, 

aoi = 3.1416 
an = 4.4934 
CH 21 = 5.7635 
<*02 = 6.28 32. 

Let Example 11.7.1 be modified so that the potential is a finite Vo outside (r > a). 



(a) For E < Vq show that 


lAout (r, 0,<p) ~ k, ^V2M(V 0 - E)j. 


(b) The new boundary conditions to be satisfied at r — a are 

Vhn (a, 9 , <p) = t/f ou t(fl, 9, <p), 

9 9 

— f in(a, 9 , <p) = —fout(a. 9, <p) 
or or 


1 9 V^in 




1 djrout 


font dr 


For I — 0 show that the boundary condition at r — a leads to 


/ (E) — k 


1 

cot ka - 

ka 


■k! 


1 , 

1 + — =o, 

k'a 1 


where k = \/2ME/h and k' = s/2M(Vq — E) jh. 
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(c) With a — 4netfi 2 /Me 2 (Bohr radius) and Vo = 4Me 4 /2ti 2 , compute the possible 
bound states (0 < E < Vo). 

Hint. Call a root-finding subroutine after you know the approximate location of 
the roots of 

f{E) = 0 (0<£<V 0 ). 

(d) Show that when a = 4jtsq h 2 /Me 2 the minimum value of Vo for which a bound 
state exists is Vo = 2.4674Me 4 /2/i 2 . 

11 . 7.27 In some nuclear stripping reactions the differential cross section is proportional to 
jl(x) 2 , where / is the angular momentum. The location of the maximum on the curve of 
experimental data permits a determination of /, if the location of the (first) maximum of 
jl (x) is known. Compute the location of the first maximum of j i(x), ji(x), and 73 (x). 
Note. For better accuracy look for the first zero of j! (x). Why is this more accurate than 
direct location of the maximum? 

Additional Readings 


Jackson, J. D., Classical Electrodynamics, 3rd ed.. New York: J. Wiley (1999). 

McBride, E. B., Obtaining Generating Functions. New York: Springer-Verlag (1971). An introduction to methods 
of obtaining generating functions. 

Watson, G. N., A Treatise on the Theory of Bessel Functions, 2nd ed. Cambridge, UK: Cambridge University 
Press (1952). This is the definitive text on Bessel functions and their properties. Although difficult reading, it 
is invaluable as the ultimate reference. 

Watson, G. N., A Treatise on the Theory of Bessel Functions, 1st ed. Cambridge, UK: Cambridge University Press 
(1922). See also the references listed at the end of Chapter 13. 
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Chapter 12 


Legendre Functions 


12.1 Generating Function 

Legendre polynomials appear in many different mathematical and physical situations. 
(1) They may originate as solutions of the Legendre ODE which we have already en¬ 
countered in the separation of variables (Section 9.3) for Laplace’s equation, Helmholtz’s 
equation, and similar ODEs in spherical polar coordinates. (2) They enter as a consequence 
of a Rodrigues' formula (Section 12.4). (3) They arise as a consequence of demanding a 
complete, orthogonal set of functions over the interval [—1, 1] (Gram-Schmidt orthogo- 
nalization. Section 10.3). (4) In quantum mechanics they (really the spherical harmonics. 
Sections 12.6 and 12.7) represent angular momentum eigenfunctions. (5) They are gen¬ 
erated by a generating function. We introduce Legendre polynomials here by way of a 
generating function. 

Physical Basis — Electrostatics 

As with Bessel functions, it is convenient to introduce the Legendre polynomials by means 
of a generating function, which here appears in a physical context. Consider an electric 
charge q placed on the 7 -axis at z = a. As shown in Fig. 12.1, the electrostatic potential of 
charge q is 

1 q 

q>= -— (SI units). (12.1) 

Ait 8 q r i 

We want to express the electrostatic potential in terms of the spherical polar coordinates r 
and 6 (the coordinate <p is absent because of symmetry about the z-axis). Using the law of 
cosines in Fig. 12.1, we obtain 

y=-?—(r 2 +a 2 -2arcos0)~ l/2 . (12.2) 

4ttso 
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Figure 12.1 Electrostatic potential. 
Charge q displaced from origin. 


Legendre Polynomials 

Consider the case of r > a or, more precisely, r 2 > \a 2 — 2arcos0\. The radical in 
Eq. (12.2) may be expanded in a binomial series and then rearranged in powers of (a/r). 
The Legendre polynomial P n (cos9 ) (see Fig. 12.2) is defined as the coefficient of the nth 
power in 


<P = 


q 

4neor 


OO 


E 

n= 0 


P„ (COS0) 



(12.3) 


P„U) 



Figure 12.2 Legendre 
polynomials ? 2 (x ), P?,(x), 
P 4 (x), and Psix). 
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Dropping the factor q/Ansor and using x and t instead of cos 0 and a/r, respectively, we 
have 


g(t,x) = (1 -2 xt + t 2 ) 1/2 = P„(x)t n , 


\t\ < 1. 


(12.4) 


n =0 


Equation (12.4) is our generating function formula. In the next section it is shown that 
|(cos0)1 < 1, which means that the series expansion (Eq. (12.4)) is convergent for |r| < 
l. 1 Indeed, the series is convergent for \t\ — 1 except for \x\ = 1. 

In physical applications Eq. (12.4) often appears in the vector form (see Section 9.7) 


1 


1 


|ri 


n =0 


= -E(r) p « (cos0) ’ 


where 


and 


r> = |r 1 1 
r< = |r 2 | 


r> = |r 2 | 
r< = |r 1 1 


for |n| > |r 2 |, 


for |r 2 | > |ri|. 


(12.4a) 


(12.4b) 


(12.4c) 


Using the binomial theorem (Section 5.6) and Exercise 8.1.15, we expand the generating 
function as (compare Eq. (12.33)) 


(1—2 xt + t 2 ) 


72=0 


( 2 «)! 

2 2n (n'.) : 


2 \n 


(2 xt — r) 




22=1 


( 2 n)!! 


(12.5) 


For the first few Legendre polynomials, say, Pq , P \, and Pj, we need the coefficients of f°, 
f 1 , and t 2 . These powers of t appear only in the terms n = 0, 1, and 2, and hence we may 
limit our attention to the first three terms of the infinite series: 


0 ! 


(2xt— t 2 ) 0 +— t 2 y + 


2! 2 ,i 4! 


2\2 


(2 xt — t 2 ) 


2°(0!) 2V 7 2 2 (1!) 2V y 2 4 (2!) 2 
= lr° + vr 1 + (^x 2 - ^f 2 + C>(r 3 ). 

Then, from Eq. (12.4) (and uniqueness of power series), 

Po( x ) = 1, P\(x)=x, P 2 (x)=^x 2 - 

We repeat this limited development in a vector framework later in this section. 


1 Note that the series in Eq. (12.3) is convergent for r > a, even though the binomial expansion involved is valid only for 
r > (a 2 + 2ar )U 2 and cos# = — 1. or r > a( 1 + \/2). 
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In employing a general treatment, we find that the binomial expansion of the (2 xt — t 2 )" 
factor yields the double series 


(i — 2 xt + 1 2 ) " = y 


i^y ( -y w! 

2 2 "(n!) 2 ^ k\(n-k)\ 

n—0 k =0 


n—k+k 


(2xr~ K t 


= EEh)‘ 


(2b)! 


2 2n n\k\{n — k)\ 


■ (2 x) n ~ k t n+k . (12.6) 


From Eq. (5.64) of Section 5.4 (rearranging the order of summation), Eq. (12.6) becomes 


oo [«/ 2] 

(l — 2xf + f 2 ) 1/, “ = EEH)* 


(2n -2it)! 


«=0 A:=0 


2 2n ~ 2k k\(n — k)\(n — 2k)\ 


(2 x) n ~ 2k t'\ (12.7) 


with the t” independent of the index kr Now, equating our two power series (Eqs. (12.4) 
and (12.7)) term by term, we have 3 


[«/ 2 ] 


Pn(x)= (-D* 


(2n — 2k)\ xll _ 2k ' 


k =o 


2"k\(n — k)\(n — 2k)\ 


( 12 . 8 ) 


Hence, for n even, P n has only even powers of x and even parity (see Eq. (12.37)), and odd 
powers and odd parity for odd n. 


Linear Electric Multipoles 

Returning to the electric charge on the z-axis, we demonstrate the usefulness and power 
of the generating function by adding a charge — q at z = — a, as shown in Fig. 12.3. The 



2 [ti/2] = n/ 2 for n even, ( n — l)/2 for n odd. 

^Equation (12.8) starts with x n . By changing the index, we can transform it into a series that starts with x® for n even and x 1 
for n odd. These ascending series are given as hypergeometric functions in Eqs. (13.138) and (13.139), Section 13.4. 
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potential becomes 


<P = 


q 


47t£o 

and by using the law of cosines, we have 


(---). 
Vg nj 


(12.9) 


<P '■ 


q 


4jtSor 


1 — 2 ( — Icost 
r 


1 + 2 ( - ) cosf 
r 


a 
r 

2-i-1/2 


- 1/2 


(r > a). 


Clearly, the second radical is like the first, except that a has been replaced by —a. Then, 
using Eq. (12.4), we obtain 


<P 


r OO 


4n£or 

n =0 


oo / \ n oo 

(COS0)|-) - ^P„(cos0)(-lW - 


n =0 


= - 2 ^-rPl(COS0)( /fl ) + P3(COS@)( /fl ) +••• 
Ansor |_ \r J \r J 

The first term (and dominant term for r y>> a) is 


( 12 . 10 ) 


2 aq Pi(cosQ) 
47t£o r 2 


( 12 . 11 ) 


which is the electric dipole potential, and 2 aq is the dipole moment (Fig. 12.3). This 
analysis may be extended by placing additional charges on the z-axis so that the Pi term, 
as well as the Pq (monopole) term, is canceled. For instance, charges of q at z = a and 
Z = —a, —2 q at z = 0 give rise to a potential whose series expansion starts with P 2 (cos 6). 
This is a linear electric quadrupole. Two linear quadruples may be placed so that the 
quadrupole term is canceled but the P 3 , the octupole term, survives. 


Vector Expansion 


We consider the electrostatic potential produced by a distributed charge p(r 2 ): 

1 


<P( *i) = 


47T£o 


/ 


P(r 2) ,3 
-An. 


|ri -r 2 | 


(12.12a) 


This expression has already appeared in Sections 1.16 and 9.7. Taking the denominator 
of the integrand, using first the law of cosines and then a binomial expansion, yields (see 
Fig. 1.42) 


1 


()] - 2r, • r 2 + r|) 


23-1/2 



2 ri • r 2 



for rj > r 2 


1 

n 


r l r 2 


1 r. 

2 r 


3 (ri • r 2 ) 2 
2 r* 



3n 


|ri -r 2 | 


(12.12b) 
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(For r\ = l,r 2 = t, and rj • r 2 = xt, Eq. (12.12b) reduces to the generating function, 
Eq. (12.4).) 

The first term in the square bracket, 1, yields a potential 

<PoOr) = —— [ p(r 2 )d 3 r 2 . (12.12c) 

4tt£o n J 

The integral is just the total charge. This part of the total potential is an electric monopole. 
The second term yields 

<Pi(ri) = —\ [ r 2 p(r 2 )d 3 r 2 , (12.12d) 

47T£ 0 rf J 

where the integral is the dipole moment whose charge density p (r 2 ) is weighted by a mo¬ 
ment arm r 2 . We have an electric dipole potential. For atomic or nuclear states of definite 
parity, p(r 2 ) is an even function and the dipole integral is identically zero. 

The last two terms, both of order (r 2 /r\) 2 , may be handled by using Cartesian coordi¬ 
nates: 


3 3 

(n • r 2 ) 2 = 22 X]jX 2 j 22 x ii x 2j■ 
i=l 7=1 

Rearranging variables to take the x\ components outside the integral yields 


<P 2 (ri) = 


1 1 

47T£o 2r$ 


T. x uxi.i J [3x 2i x 2 j - 8ijrl]p(r 2 )d 3 r 2 . 
1.7 = 1 


(12.12e) 


This is the electric quadrupole term. We note that the square bracket in the integrand 
forms a symmetric, zero-trace tensor. 

A general electrostatic multipole expansion can also be developed by using Eq. (12.12a) 
for the potential <p(n) and replacing 1 /(4zr | r i — r 2 |) by Green’s function, Eq. (9.187). This 
yields the potential ^(ri) as a (double) series of the spherical harmonics Y!”(0 \, ^i) and 

Y; n (9 2 ,n)- 

Before leaving multipole fields, perhaps we should emphasize three points. 


• First, an electric (or magnetic) multipole is isolated and well defined only if all lower- 
order multipoles vanish. For instance, the potential of one charge q at z = a was ex¬ 
panded in a series of Legendre polynomials. Although we refer to the Fi(cos0) term 
in this expansion as a dipole term, it should be remembered that this term exists only 
because of our choice of coordinates. We also have a monopole, Po(cos0). 

• Second, in physical systems we do not encounter pure multipoles. As an example, 
the potential of the finite dipole (q at z = a, —q at z — —a) contained a P 2 (cqs 9 ) 
term. These higher-order terms may be eliminated by shrinking the multipole to a point 
multipole, in this case keeping the product qa constant (a -> 0, q —»• oo) to maintain 
the same dipole moment. 
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• Third, the multipole theory is not restricted to electrical phenomena. Planetary configu¬ 
rations are described in terms of mass multipoles. Sections 12.3 and 12.6. Gravitational 
radiation depends on the time behavior of mass quadrupoles. (The gravitational radia¬ 
tion field is a tensor field. The radiation quanta, gravitons, carry two units of angular 
momentum.) 

It might also be noted that a multipole expansion is actually a decomposition into the 
irreducible representations of the rotation group (Section 4.2). 

Extension to Ultraspherical Polynomials 

The generating function used here, g(t,x), is actually a special case of a more general 
generating function, 

(12.13) 

The coefficients C„ (x ) are the ultraspherical polynomials (proportional to the Gegen- 
bauer polynomials). For a — 1/2 this equation reduces to Eq. (12.4); that is, C„ \x) — 
P n (x). The cases a = 0 and a — 1 are considered in Chapter 13 in connection with the 
Chebyshev polynomials. 

Exercises 

12 . 1.1 Develop the electrostatic potential for the array of charges shown. This is a linear elec¬ 
tric quadrupole (Fig. 12.4). 

12 . 1.2 Calculate the electrostatic potential of the array of charges shown in Fig. 12.5. Here 
is an example of two equal but oppositely directed dipoles. The dipole contributions 
cancel. The octupole terms do not cancel. 

12 . 1.3 Show that the electrostatic potential produced by a charge q at z = a for r < a is 



Figure 1 2.4 Linear electric quadrupole. 
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-q +lq -2 q q 

•-•- 0 -•-•- 

z = -2a -a a 2a 

Figure 1 2.5 Linear electric octupole. 



Figure 12.6 


12.1.4 Using E = — V< p, determine the components of the electric field corresponding to the 
(pure) electric dipole potential 


<P( r) = 


2aq P\(cos6) 
4jTSor 2 


12.1.5 


Here it is assumed that r^> a. 


ANS. E r = + 


4aq cos 9 
4neor 3 


Eq — + 


2aq sinP 
47reor 3 


E v — 0 . 


A point electric dipole of strength p (1) is placed at z = a \ a second point electric dipole 
of equal but opposite strength is at the origin. Keeping the product p > ]> a constant, let 
a —»• 0. Show that this results in a point electric quadrupole. 

Hint. Exercise 12.2.5 (when proved) will be helpful. 


12.1.6 A point charge q is in the interior of a hollow conducting sphere of radius ro- The 
charge q is displaced a distance a from the center of the sphere. If the conducting 
sphere is grounded, show that the potential in the interior produced by q and the dis¬ 
tributed induced charge is the same as that produced by q and its image charge q'. The 
image charge is at a distance a' — rp/a from the center, collinear with q and the origin 
(Fig. 12.6). 

Hint. Calculate the electrostatic potential for a < r o < a'. Show that the potential van¬ 
ishes for r — ro if we take q' = —qro/a. 


12.1.7 Prove that 


r «+1 

P„(cos0) = (-1)"—- 
/?! 


d" 
3 z" 



Hint. Compare the Legendre polynomial expansion of the generating function (a -> A z, 
Fig. 12.1) with a Taylor series expansion of 1 /r, where z dependence of r changes from 
z to z — Ai (Fig. 12.7). 


12.1.8 By differentiation and direct substitution of the series form, Eq. (12.8), show that P n (jc) 
satisfies the Legendre ODE. Note that there is no restriction upon x. We may have any 
x, —oo < x < oo, and indeed any z in the entire finite complex plane. 
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12.1.9 The Chebyshev polynomials (type II) are generated by (Eq. (13.93), Section 13.3) 


1 

1 — 2xt + t 2 


Y^ U n(x)t". 

n =0 


Using the techniques of Section 5.4 for transforming series, develop a series represen¬ 
tation of U n (x). 


["/ 2 ] 


ANS. U n (x) = ^(-1)* 


*=o 


(n - k)\ 
k\(n — 2k)\ 


(2x) 


n—2k 


12.2 Recurrence Relations and Special Properties 
Recurrence Relations 


The Legendre polynomial generating function provides a convenient way of deriving the 
recurrence relations 4 and some special properties. If our generating function (Eq. (12.4)) 
is differentiated with respect to t, we obtain 


Bg(t,x) 

dt 


x — t 


(1 — 2 xt + r 2 ) 3 / 2 


= y ^nP n (x)t n x . 


(12.14) 


n =0 


By substituting Eq. (12.4) into this and rearranging terms, we have 


(1 -2xt + t 2 )^nP n (x)t n - 1 +(t -x)J2 p n Wt n =0. 


(12.15) 


n=0 


n=0 


The left-hand side is a power series in t. Since this power series vanishes for all values of 
t, the coefficient of each power of t is equal to zero; that is, our power series is unique 
(Section 5.7). These coefficients are found by separating the individual summations and 


1 We can also apply the explicit series form Eq. (12.8) directly. 
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using distinctive summation indices: 

oo oo oo 

y, mP m (x)t m ~ l — y 2 nxP„(x)t n + ^ sP s (x)t s+l 

m= 0 «=0 5=0 

oo oo 

+ y P ? U0r ' +1 -J2xP>i(x)t n =0. (12.16) 

5=0 ft=0 

Now, letting m = n + l,s , =n — 1, we find 

(2n + l)xP n (x) = (n + l)P n +i(x) + nP n -i(x), n— 1,2,3,_ (12.17) 

This is another three-term recurrence relation, similar to (but not identical with) the recur¬ 
rence relation for Bessel functions. With this recurrence relation we may easily construct 
the higher Legendre polynomials. If we take n — l and insert the easily found values of 
Pq(x) and Pi Or) (Exercise 12.1.7 or Eq. (12.8)), we obtain 

3r Pi (r) = 2P2(x) + Pq(x), (12.18) 

or 

P 2 (r) = ^ (3r 2 — l). (12.19) 

This process may be continued indefinitely, the first few Legendre polynomials are listed 
in Table 12.1. 

As cumbersome as it may appear at first, this technique is actually more efficient for 
a digital computer than is direct evaluation of the series (Eq. (12.8)). For greater stability (to 
avoid undue accumulation and magnification of round-off error), Eq. (12.17) is rewritten 
as 

P«+i (x) — 2xP n (r) - P /,-1 (r)- —-\xP n {x) - P„_i(r)]. (12.17a) 

n + 1 

One starts with Pq(x) — 1, Pi Or) = x , and computes the numerical values of all the P„ (x) 
for a given value of x up to the desired Py (x). The values of P„ (x), 0 <n<N, are 
available as a fringe benefit. 

Table 12.1 Legendre Polynomials 


PO(A-) = 1 
P\ (x) = x 

P 2 (*)=! (3* 2 -l) 

P 3 (*) = ^(5 * 3 — 3*) 

P 4 (*)= g (35* 4 - 30* 2 + 3) 

P 5 (*) = i(63* 5 - 70x 3 + 15*) 

P 6 (*) = i(231* 6 - 315* 4 + 105* 2 - 5) 

P 7 (x) = (429* 7 - 693* 5 + 315* 3 - 35*) 

P 8 (*) = jP(6435* 8 - 12012* 6 + 6930* 4 - 1260* 2 + 35) 
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More information about the behavior of the Legendre polynomials can be obtained if we 
now differentiate Eq. (12.4) with respect to x. This gives 


or 


dg(t,x) 

dx 


oo 

(1 - 2xt + f 2 ) 3 / 2 = ^ 

n =0 


oo oo 

(1 - 2 xt + t 2 ) J2 P'„(x)t n - t P«(x)t n = 0. 

n =0 n= 0 


( 12 . 20 ) 


( 12 . 21 ) 


As before, the coefficient of each power of t is set equal to zero and we obtain 


P'n+lix) + P' n _\(x) = 2 xP' n (. x ) + P n (x). (12.22) 

A more useful relation may be found by differentiating Eq. (12.17) with respect to x and 
multiplying by 2. To this we add (2 n + 1) times Eq. (12.22), canceling the P' n term. The 
result is 




P n+ iW - P'n -iW = (2 n + l)Pn(x). 

From Eqs. (12.22) and (12.23) numerous additional equations may be developed, 5 in¬ 
cluding 


P' n+l (x) = (n + 1 )P n (x) + xPlM), (12.24) 

P'n- lU) = —nP n (x) +xP' n (x), (12.25) 

(l — x 2 )P' n (x) =nP„- i(x) -fuP„(x), (12.26) 

(1 - x 2 )P;,(x) = (n + 1 )xP„(x) - (n + l)P„+t(x). (12.27) 


By differentiating Eq. (12.26) and using Eq. (12.25) to eliminate P'_\ (x), we find that 
P n (x) satisfies the linear second-order ODE 


(1 - x 2 )P"(x) - 2xP' n (x) +n(n + 1 )P„(x) = 0. 


(12.28) 


The previous equations, Eqs. (12.22) to (12.27), are all first-order ODEs, but with poly¬ 
nomials of two different indices. The price for having all indices alike is a second-order 


Using the equation number in parentheses to denote the left-hand side of the equation, we may write the derivatives as 

2 ■ ^(12.17) + (2 n + 1) • (12.22) => (12.23), 

\ {(12.22) + (12.23)} => (12.24), 

\ {(12.22)-(12.23)} => (12.25), 

(12.24)„^„_ 1 +x • (12.25) => (12.26), 

(12.26) +n ■ (12.25) => (12.28). 
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differential equation. Equation (12.28) is Legendre’s ODE. We now see that the polynomi¬ 
als P n (x) generated by the power series for (1 — 2 xt + r 2 ) -1 / 2 satisfy Legendre’s equation, 
which, of course, is why they are called Legendre polynomials. 

In Eq. (12.28) differentiation is with respect to x (x — cos 9). Frequently, we encounter 
Legendre’s equation expressed in terms of differentiation with respect to 9: 


1 d 
sin$ dO 



dP„ (cos0)\ 
dO ) 


+ n(n + l)P„(cos0) = 0. 


(12.29) 


Special Values 


Our generating function provides still more information about the Legendre polynomials. 
If we set x = 1, Eq. (12.4) becomes 

OO 


1 


1 


(1 - 2f + r 2 ) 1 / 2 1 -t 


= £<"• 


(12.30) 


n =0 


using a binomial expansion or the geometric series. Example 5.1.1. But Eq. (12.4) for x — 1 
defines 


1 


(1 - 2 r + r 2 )!/2 


= ^>„(l)r". 


n =0 


Comparing the two series expansions (uniqueness of power series. Section 5.7), we have 

Pn( 1) = 1. (12.31) 

If we let x = — 1 in Eq. (12.4) and use 

1 1 


this shows that 


(1 + 2t + f 2 ) 1 / 2 1 +t’ 


Pni- !) = (-!)". 


(12.32) 


For obtaining these results, we find that the generating function is more convenient than 
the explicit series form, Eq. (12.8). 

If we take x — 0 in Eq. (12.4), using the binomial expansion 


(l+,2)- I,2 = l-(l 2 + j3‘ + - + (-1 ) 

Z o 

have 6 


1 2 , ^ 4 


„ 1 ■ 3 • • • (2n — 1) 
2 "«! 


r 2 " H-, (12.33) 


1 • 3 • • • (2n — 1) (2n — 1)!! (-l)"(2n)! 

Pin (0) = (-1)"-^-- = ( 1)”~ rrr = (12.34) 


2 "n! 

P 2 „+i(0)=0, n = 0,1,2 .... 

These results also follow from Eq. (12.8) by inspection. 


(2n)!! 2 2 " (n!) 2 


(12.35) 


'The double factorial notation is defined in Section 8.1: 


(2n)!! = 2 ■ 4 ■ 6 ■ ■ ■ (2n), 


(In - 1)!! = 1 • 3 • 5 • • • (2n — 1), 


(_!)!! = i. 
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Parity 

Some of these results are special cases of the parity property of the Legendre polynomials. 
We refer once more to Eqs. (12.4) and (12.8). If we replace x by —x and t by —t, the 
generating function is unchanged. Hence 

g(t,x) = g(-t, -x) = [1 - 2 (-O(-x) + (—f) 2 ] 1/2 

OO OO 

= P n(-X)(~t) n = J2 P n(x)t H . (12.36) 

n= 0 n= 0 

Comparing these two series, we have 

(12.37) 

that is, the polynomial functions are odd or even (with respect to x — 0 , 9 = jr/ 2 ) according 
to whether the index n is odd or even. This is the parity , 7 or reflection, property that plays 
such an important role in quantum mechanics. For central forces the index n is a measure 
of the orbital angular momentum, thus linking parity and orbital angular momentum. 

This parity property is confirmed by the series solution and for the special values tabu¬ 
lated in Table 12.1. It might also be noted that Eq. (12.37) may be predicted by inspection 
ofEq. (12.17), the recurrence relation. Specifically, if P„_j(x) and xP n (x) are even, then 
P n+ i(x) must be even. 

Upper and Lower Bounds for P n (cos 0) 

Finally, in addition to these results, our generating function enables us to set an upper limit 
on | P n (cos 9) |. We have 

(1 - 2t cos 9 + r)“ 1/2 = (1 - te w )~ l/2 ( 1 - te~ w )~ l/2 

= (1 + \te w + lt 2 e 2W + ■■■) 

• (1 + \te~ w + lt 2 e- 2W + •••), (12.38) 

with all coefficients positive. Our Legendre polynomial, P„(cos0), still the coefficient of 
t ", may now be written as a sum of terms of the form 

\a m ( e"" 6 + e~ lmd ) = a m cos mO (12.39a) 

with all the a m positive and m and n both even or odd so that 

n 

P n (cos9)= a m cosm9. (12.39b) 

m =0 or 1 

7 In spherical polar coordinates the inversion of the point ( r,6,(p ) through the origin is accomplished by the transformation 
[r —> r, 6 —> re — 6, and (p —> (p±jr]. Then, cos 6 —► cos(^ — 0) = — cos 6, corresponding to x —> —x (compare Exercise 2.5.8). 
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This series, Eq. (12.39b), is clearly a maximum when 6 = 0 and cos mO = 1. But for x = 
cos 9 = 1, Eq. (12.31) shows that P n ( 1) = 1. Therefore 

|P„(cos0)| < P„(l) = 1. (12.39c) 

A fringe benefit of Eq. (12.39b) is that it shows that our Legendre polynomial is a linear 
combination of cosmd. This means that the Legendre polynomials form a complete set 
for any functions that may be expanded by a Fourier cosine series (Section 14.1) over the 
interval [ 0 , tt]. 

• In this section various useful properties of the Legendre polynomials are derived from 
the generating function, Eq. (12.4). 

• The explicit series representation, Eq. (12.8), offers an alternate and sometimes supe¬ 
rior approach. 

Exercises 

12.2.1 Given the series 

cuo + oil cos 2 9 + o^cos 4 # + (*6 cos 6 0 = oqPq + CI2P2 + «4 P4 + a(,P(>, 

express the coefficients a, as a column vector a and the coefficients a ; as a column 
vector a and determine the matrices A and B such that 

A a = a and Ba = a. 

Check your computation by showing that AB = 1 (unit matrix). Repeat for the odd case 

a\ cos 9 + or$ cos 3 0 + 015 cos 5 9 + a 7 cos 7 9 = a\ P\ + 03 P 3 + C 15 P 5 + a-iPj. 

Note. P n (cos9) and cos" 9 are tabulated in terms of each other in AMS-55 (see Addi¬ 
tional Readings of Chapter 8 for the complete reference). 

12.2.2 By differentiating the generating function g(t. x) with respect to t, multiplying by 2 1 , 
and then adding git, x), show that 

1 _ f 2 00 

This result is useful in calculating the charge induced on a grounded metal sphere by a 
point charge q. 

12.2.3 (a) Derive Eq. (12.27), 

(1 -x 2 )P' n ix) = in + 1 )xP n (x) - in + l)P„ + i(.r). 

(b) Write out the relation of Eq. (12.27) to preceding equations in symbolic form 
analogous to the symbolic forms for Eqs. (12.23) to (12.26). 
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12.2.4 

12.2.5 

12.2.6 

12.2.7 

12.2.8 

12.2.9 

12.2.10 

12.2.11 

12.2.12 


A point electric octupole may be constructed by placing a point electric quadrupole 
(pole strength p [2) in the /;-direction) at z — a and an equal but opposite point elec¬ 
tric quadrupole at z = 0 and then letting a —> 0, subject to p i2) a — constant. Find the 
electrostatic potential corresponding to a point electric octupole. Show from the con¬ 
struction of the point electric octupole that the corresponding potential may be obtained 
by differentiating the point quadrupole potential. 


Operating in spherical polar coordinates, show that 


9 

dz 


P n (cos 0) 

ytl-\~ 1 


= -in + 1) 


P„ + i(cosg) 

ftl+2 


This is the key step in the mathematical argument that the derivative of one multipole 
leads to the next higher multipole. 

Hint. Compare Exercise 2.5.12. 


From 

1 d L * 9, —t/21 

P L (cos 6 ) = — ^ (1 - 2t cos e +1 2 ) 1 /2 1 (=0 

show that 


Pl(\) — 1- Pl(-D = (-Im¬ 


prove that 

p " (i)= ^ L Pn{x) 1^=1 = \ n{n+1} - 

Show that P n (cos9) = (— 1)" I ),(— cos 0) by use of the recurrence relation relating 

P n , P n+ 1 , and P n -1 and your knowledge of Pq and P\. 

From Eq. (12.38) write out the coefficient of t 2 in terms of cos nO, n < 2. This coeffi¬ 
cient is P 2 (cos 0 ). 

Write a program that will generate the coefficients a s in the polynomial form of the 

Fegendre polynomial 

n 

P n (x) — Y: a, X s . 

s =0 

(a) Calculate AoM over the range [0, 1] and plot your results. 

(b) Calculate precise (at least to five decimal places) values of the five positive roots of 
Pio(x). Compare your values with the values listed in AMS-55, Table 25.4. (For 
the complete reference, see Additional Readings of Chapter 8.) 

(a) Calculate the largest root of P n (x) for n — 2(1)50. 

(b) Develop an approximation for the largest root from the hypergeometric represen¬ 
tation of P n (x) (Section 13.4) and compare your values from part (a) with your 
hypergeometric approximation. Compare also with the values listed in AMS-55, 
Table 25.4. (For the complete reference, see Additional Readings of Chapter 8.) 
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12.2.13 (a) From Exercise 12.2.1 and AMS-55, Table 22.9, develop the 6x6 matrix B that 

will transform a series of even-order Legendre polynomials through Pw(x) into a 
power series Y^l=Q a 2 nX 2 " ■ 

(b) Calculate A as B -1 . Check the elements of A against the values listed in AMS-55, 
Table 22.9. (For the complete reference, see Additional Readings of Chapter 8.) 

(c) By using matrix multiplication, transform some even power series Y^n=o a 2 nX 2n 
into a Legendre series. 

12.2.14 Write a subroutine that will transform a finite power series a n x n into a Legendre 
series Yl-n-O b„P„(x). Use the recurrence relation, Eq. (12.17), and follow the technique 
outlined in Section 13.3 for a Chebyshev series. 


12.3 Orthogonality 


Legendre’s ODE (12.28) may be written in the form 


— [(1 -x 2 )P' n {x)] + n(n + \)P n (x) = 0, 


(12.40) 


showing clearly that it is self-adjoint. Subject to satisfying certain boundary condi¬ 
tions, then, it is known that the solutions P n (x) will be orthogonal. Upon comparing 
Eq. (12.40) with Eqs. (10.6) and (10.8) we see that the weight function w(x) = 1 , C — 
(d/dx)( 1 — x 2 )(d/dx ), p(x) = 1 — x 2 , and the eigenvalue X — n(n + 1). The integration 
limits on x are ±1, where p(±l) = 0. Then for m ^ n, Eq. (10.34) becomes 

• l 

P n {x)P m (x)dx — 0, 8 (12.41) 

-l 




f 


P n (cos 0) P m (cos 9) sin 6 dO — 0, 


(12.42) 


showing that P n (x) and P m (x) are orthogonal for the interval [—1, 1]. This orthogonality 
may also be demonstrated by using Rodrigues’ definition of P n (x) (compare Section 12.4, 
Exercise 12.4.2). 

We shall need to evaluate the integral (Eq. (12.41)) when n — m. Certainly it is no longer 
zero. From our generating function, 

-,2 


(1 — 2 tx + t 


- LXJ 

2 ) _1 = E p ” 

" n =0 


C x)t n 


Integrating from x = — 1 to x = +1, we have 

CXD 


/*! 00 r 1 


dx\ 


(12.43) 


(12.44) 


s In Section 10.4 such integrals are interpreted as inner products in a linear vector (function) space. Alternate notations are 

j * [P n (X)]* P m (x)dx = (P n | P m ) = (P„, P m ) ■ 

The () form, popularized by Dirac, is common in the physics literature. The () form is more common in the mathematics 
literature. 
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the cross terms in the series vanish by means of Eq. (12.42). Using y — 1 — 2 tx + t 2 , 
dy — —2tdx, we obtain 


c- 


dx 


1 


l 


2 1 J(i-t) 2 


(1+?) dy 1 
— = - In 

y t 


■ 2 tx + t 2 

Expanding this in a power series (Exercise 5.4.1) gives us 


1 +1 
1 - t 


1 

-In 

t 



f 2n 


2 n + 1 


(12.45) 


(12.46) 


Comparing power-series coefficients of Eqs. (12.44) and (12.46), we must have 

J l [P n (x)] 2 dx = ^-j. (12.47) 

Combining Eq. (12.42) with Eq. (12.47) we have the orthonormality condition 

f 2 S, n n 

/ P m {x)P n {x)dx = —^-. (12.48) 

J-l 2 n+ 1 

We shall return to this result in Section 12.6 when we construct the orthonormal spherical 
harmonics. 


Expansion of Functions, Legendre Series 


In addition to orthogonality, the Sturm-Liouville theory implies that the Legendre polyno¬ 
mials form a complete set. Let us assume, then, that the series 

OO 

Y^a n P„(x) = f(x) (12.49) 

n=0 

converges in the mean (Section 10.4) in the interval [—1, 1], This demands that fix) and 
fix) be at least sectionally continuous in this interval. The coefficients a n are found by 
multiplying the series by P m {x) and integrating term by term. Using the orthogonality 
property expressed in Eqs. (12.42) and (12.48), we obtain 

- ~ a m = f f{x)P m {x)dx. (12.50) 

2m+1 J_ i 

We replace the variable of integration x by t and the index m by n. Then, substituting into 
Eq. (12.49), we have 


/M = E 


2 n + i / r l 


n—0 


/: 


f (t)P n (t) dt )Pnix). 


(12.51) 


This expansion in a series of Legendre polynomials is usually referred to as a Legendre 
series. 9 Its properties are quite similar to the more familiar Fourier series (Chapter 14). In 


9 Note that Eq. (12.50) gives a m as a definite integral, that is, a number for a given fix). 
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particular, we can use the orthogonality property (Eq. (12.48)) to show that the series is 
unique. 

On a more abstract (and more powerful) level, Eq. (12.51) gives the representation of 
fix) in the vector space of Legendre polynomials (a Hilbert space. Section 10.4). 

From the viewpoint of integral transforms (Chapter 15), Eq. (12.50) may be considered 
a finite Legendre transform of fix). Equation (12.51) is then the inverse transform. It may 
also be interpreted in terms of the projection operators of quantum theory. We may take 
V m in 

2m ± 1 f 1 r 

[V m f](x) = P m {x) --- J ^ P m (t)[f(t)]dt 

as an (integral) operator, ready to operate on fit). (The /(f) would go in the square bracket 
as a factor in the integrand.) Then, from Eq. (12.50), 

[V m f](x) =a m P m (x). w 

The operator V m projects out the mth component of the function /. 

Equation (12.3), which leads directly to the generating function definition of Legendre 
polynomials, is a Legendre expansion of 1 fr\. This Legendre expansion of 1 / r\ or 1 / r\i 
appears in several exercises of Section 12.8. Going beyond a Coulomb field, the \/r \2 is 
often replaced by a potential V (|r i — r 2 1), and the solution of the problem is again effected 
by a Legendre expansion. 

The Legendre series, Eq. (12.49), has been treated as a known function fix) that we 
arbitrarily chose to expand in a series of Legendre polynomials. Sometimes the origin and 
nature of the Legendre series are different. In the next examples we consider unknown 
functions we know can be represented by a Legendre series because of the differential 
equation the unknown functions satisfy. As before, the problem is to determine the un¬ 
known coefficients in the series expansion. Here, however, the coefficients are not found 
by Eq. (12.50). Rather, they are determined by demanding that the Legendre series match 
a known solution at a boundary. These are boundary value problems. 


Example 12.3.1 Earth’s Gravitational Field 


An example of a Legendre series is provided by the description of the Earth’s gravitational 
potential U (for exterior points), neglecting azimuthal effects. With 

R — equatorial radius = 6378.1 ±0.1 km 

GM , , 

-= 62.494 ± 0.001 km 2 /s 2 , 

R 

we write 


U(r, 0) — 


GM 

~R~ 


R 

r 



n +1 

P„ icosO) 


(12.52) 


10 The dependent variables are arbitrary. Here x came from the x in V m ■ 
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a Legendre series. Artificial satellite motions have shown that 

a 2 = (1,082,635 ± 11) x 10“ 9 , 
a 3 = (-2,531 ±7) x 10“ 9 , 
a 4 = (—1,600 ± 12) x 10“ 9 . 

This is the famous pear-shaped deformation of the Earth. Other coefficients have been 
computed through n — 20. Note that P\ is omitted because the origin from which r is 
measured is the Earth’s center of mass ( P[ would represent a displacement). 

More recent satellite data permit a determination of the longitudinal dependence of the 
Earth’s gravitational field. Such dependence may be described by a Laplace series (Sec¬ 
tion 12.6). ■ 


Example 12.3.2 Sphere IN a Uniform Field 

Another illustration of the use of Legendre polynomials is provided by the problem of 
a neutral conducting sphere (radius fq) placed in a (previously) uniform electric field 
(Fig. 12.8). The problem is to find the new, perturbed, electrostatic potential. If we call 
the electrostatic potential 11 V, it satisfies 

V 2 V = 0, (12.53) 

Laplace’s equation. We select spherical polar coordinates because of the spherical shape of 
the conductor. (This will simplify the application of the boundary condition at the surface 
of the conductor.) Separating variables and glancing at Table 9.2, we can write the unknown 
potential V (r, 0 ) in the region outside the sphere as a linear combination of solutions: 

V(r, 0) = J2 a >y Pn (cos 0) + J2 b » „ +1 ■ (12.54) 

n =0 n =0 



V=0 


Figure 12.8 Conducting sphere in 
a uniform field. 

11 It should be emphasized that this is not a presentation of a Legendre-series expansion of a known V (cos 6). Here we are back 
to boundary value problems of PDEs. 
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No ^-dependence appears because of the axial symmetry of our problem. (The center of 
the conducting sphere is taken as the origin and the "-axis is oriented parallel to the original 
uniform field.) 

It might be noted here that n is an integer, because only for integral n is the 0 depen¬ 
dence well behaved at cos 6 = ±1. For nonintegral n the solutions of Legendre’s equation 
diverge at the ends of the interval [—1, 1], the poles 6 — 0,7r of the sphere (compare Exam¬ 
ple 5.2.4 and Exercises 5.2.15 and 9.5.5). It is for this same reason that the second solution 
of Legendre’s equation, Q n , is also excluded. 

Now we turn to our (Dirichlet) boundary conditions to determine the unknown a„ and 
b„ of our series solution, Eq. (12.54). If the original, unperturbed electrostatic field is Eq, 
we require, as one boundary condition, 

V(r -» oo) = —Eoz = —Eorcosd — — EorPi(cosd). (12.55) 

Since our Legendre series is unique, we may equate coefficients of P„ (cos 6 ) in Eq. (12.54) 
(r —> oo) and Eq. (12.55) to obtain 

a„ — 0, n> 1 and n = 0, a\ — — Eq. (12.56) 


If a,i ^ 0 for n > 1, these terms would dominate at large r and the boundary condition 
(Eq. (12.55)) could not be satisfied. 

As a second boundary condition, we may choose the conducting sphere and the plane 
6 = tc /2 to be at zero potential, which means that Eq. (12.54) now becomes 


V(r = ro) — 


b _o 

ro 




OO 

Pi (cos 9) + Y' b n 

n =2 


P„(cos6) 

r" + 1 

r o 


— 0 . 


(12.57) 


In order that this may hold for all values of 0, each coefficient of P n (cos 9) must vanish. 12 
Hence 


b 0 = 0, 13 b„= 0, n > 2, (12.58) 

whereas 

b\ — Eor^. (12.59) 

The electrostatic potential (outside the sphere) is then 

\ 

V = —EorPi(cosd) H-Pi (cos 0) = —EorPi(cos0)ll — j. (12.60) 

In Section 1.16 it was shown that a solution of Laplace’s equation that satisfied the bound¬ 
ary conditions over the entire boundary was unique. The electrostatic potential V, as given 
by Eq. (12.60), is a solution of Laplace’s equation. It satisfies our boundary conditions and 
therefore is the solution of Laplace’s equation for this problem. 


2 Again, this is equivalent to saying that a series expansion in Legendre polynomials (or any complete orthogonal set) is unique. 
The coefficient of Pq is ^o/ r O- We set bo = 0 because there is no net charge on the sphere. If there is a net charge q, then 
bo^O. 
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It may further be shown (Exercise 12.3.13) that there is an induced surface charge den¬ 
sity 


a — -so 


8V 

dr 


= 3soEqcos9 


(12.61) 


on the surface of the sphere and an induced electric dipole moment (Exercise 12.3.13) 


P = 47TrQSoEo. 


(12.62) 


Example 12.3.3 Electrostatic Potential of a Ring of Charge 

As a further example, consider the electrostatic potential produced by a conducting ring 
carrying a total electric charge q (Fig. 12.9). From electrostatics (and Section 1.14) the 
potential i/r satisfies Laplace’s equation. Separating variables in spherical polar coordinates 
(compare Table 9.2), we obtain 

OO ft 

Vf(r,0) = ^c„^p r E„(cos0), r > a. (12.63a) 

n =0 

Here a is the radius of the ring that is assumed to be in the 9 — n/2 plane. There is no 
cp (azimuthal) dependence because of the cylindrical symmetry of the system. The terms 
with positive exponent in the radial dependence have been rejected because the potential 
must have an asymptotic behavior, 

q 1 

f ---, r » a. (12.63b) 

47 T£o r 

The problem is to determine the coefficients c n in Eq. (12.63a). This may be done by 
evaluating ij/(r, 9) at 0 = 0, r — z, and comparing with an independent calculation of the 



Figure 12.9 Charged, 
conducting ring. 
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potential from Coulomb’s law. In effect, we are using a boundary condition along the z- 
axis. From Coulomb’s law (with all charge equidistant). 


t/r(r, 9) — 


q 


1 


47T£o (z 2 + a 2 ) 1 / 2 ’ 
4ttsqz „ 2 2 s {s \) 2 


j=0 


0 = 0 
r=z, 

2s 


z> a. 


(12.63c) 


The last step uses the result of Exercise 8.1.15. Now, Eq. (12.63a) evaluated at 9 — 0, r = z 
(with P n ( 1) =1), yields 


\fr(r, 9) = < 


7 n +1 ’ 


r =z. 


(12.63d) 


n =0 


Comparing Eqs. (12.63c) and (12.63d), we get c n — 0 for n odd. Setting n — 2s, we have 

(12.63e) 


q , (2sy. 

C2s = ~ A -(“I) 


47T£o' 2 2s (£!) 2 ’ 

and our electrostatic potential i jr(r, 9) is given by 


x/f(r, 9) = 


4jtsor 




( 2 s)! /a 


s=0 


2 2 s (s !) 2 \ r 


2s 


P 2 s (cos9), 


r > a. 


(12.63f) 


The magnetic analog of this problem appears in Example 12.5.3. 


Exercises 

12.3.1 You have constructed a set of orthogonal functions by the Gram-Schmidt process (Sec¬ 
tion 10.3), taking u n (x) = x n , n = 0, 1,2,, in increasing order with w(x) = 1 and 
an interval —1 < x < 1. Prove that the nth such function constructed is proportional to 
Pn (x). 

Hint. Use mathematical induction. 

12.3.2 Expand the Dirac delta function in a series of Legendre polynomials using the interval 
-1 <x < 1 . 

12.3.3 Verify the Dirac delta function expansions 

^ 2 u + 1 

5(1 -.0 = — p n(x) 

n =0 

„ 2 n + 1 

a(l+*) = £(-l)"—— Pnix). 

n =0 

These expressions appear in a resolution of the Rayleigh plane-wave expansion (Exer¬ 
cise 12.4.7) into incoming and outgoing spherical waves. 

Note. Assume that the entire Dirac delta function is covered when integrating over 

[-U]. 
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12.3.4 

12.3.5 

12.3.6 

12.3.7 

12.3.8 

12.3.9 


12.3.10 


Neutrons (mass 1) are being scattered by a nucleus of mass A (A > 1). In the center- 
of-mass system the scattering is isotropic. Then, in the laboratory system the average of 
the cosine of the angle of deflection of the neutron is 

1 f 71 Acos$ + l 

(cost If) — - / —. - r-^sinOdO. 

' 2 Jo (A 2 + 2Acos6> +1)V2 

Show, by expansion of the denominator, that (cos i//> = 2/3 A. 


A particular function fix) defined over the interval [—1, 1] is expanded in a Legendre 
series over this same interval. Show that the expansion is unique. 

A function fix) is expanded in a Legendre series fix) — YfnLo a nPnix). Show that 

r i oo 2 

n =0 

This is the Legendre form of the Fourier series Parseval identity. Exercise 14.4.2. It also 
illustrates Bessel’s inequality, Eq. (10.72), becoming an equality for a complete set. 


Derive the recurrence relation 

(1 — x 2 )P' n (x) — nP„-i(x) — nxP n (x) 
from the Legendre polynomial generating function. 

Evaluate /J P n {x)dx. 

ANS. n — 2s\ 1 for s — 0, 0 for s > 0, 

n = 2s + 1; PiA0)/(2s + 2) = (-l) s (2s - 1)!!/1(2* + 2)!! 

Hint. Use a recurrence relation to replace P n (x) by derivatives and then integrate by 
inspection. Alternatively, you can integrate the generating function. 


(a) For 


fix) = 


+ 1 , 

- 1 , 


0 < x < 1 
— 1 < x < 0, 


show that 


rl 00 r 

J [fix)] dx = 2^~^(4n + 3) 

1 n =0 


(2n - 1)!! 
(2n +2)!! 


(b) By testing the series, prove that the series is convergent. 


Prove that 



~x 2 )KP' m dx = 0, 


unless m = n ± 1, 


_ 2 n(n 2 - 1) s 
“ 4n 2 — 1 


if m < n. 


2n {n + 2) (n + 1) t 
“ (2/i + l)(2n + 3) 


if m > n. 
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12.3.11 The amplitude of a scattered wave is given by 

1 oo 

f(0) — - Till + 1) exp[i<5/] sin Si Pi (cos 6). 

K 1=0 

Here 9 is the angle of scattering, / is the angular momentum eigenvalue, hk is the 
incident momentum, and <5/ is the phase shift produced by the cenUal potential that is 
doing the scattering. The total cross section is er tot = f \f(9)\ 2 d£l. Show that 

4t r ^ 2 

atot = 2^(2/ + 1) sm- Si. 

i=o 

12.3.12 The coincidence counting rate, W{9), in a gamma-gamma angular correlation experi¬ 
ment has the form 

OO 

w(9) = ^2 a - n Pin (cos 9). 

n =0 

Show that data in the range tc /2 < 9 < it can, in principle, define the function W(0) 
(and permit a determination of the coefficients ain)- This means that although data in 
the range 0 <9 <n /2 may be useful as a check, they are not essential. 

12.3.13 A conducting sphere of radius rg is placed in an initially uniform electric field, Eo- 
Show the following: 

(a) The induced surface charge density is 

a = 3sgEocos9. 

(b) The induced electric dipole moment is 

P = 47rr ( ] £()£■() • 

The induced electtic dipole moment can be calculated either from the surface 
charge [part (a)] or by noting that the final electric field E is the result of su¬ 
perimposing a dipole field on the original uniform field. 

12.3.14 A charge q is displaced a distance a along the "-axis from the center of a spherical 
cavity of radius R. 

(a) Show that the electric field averaged over the volume a < r < R is zero. 

(b) Show that the electric field averaged over the volume 0 < r < a is 

Q *nqa 

E = zE~ = —z - = (SI units) = —z-, 

47re 0 a 2 3e 0 

where n is the number of such displaced charges per unit volume. This is a basic calcu¬ 
lation in the polarization of a dielectric. 

Flint. E = —Wtp. 
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Figure 12.10 Charged, 
conducting disk. 


12.3.15 Determine the electrostatic potential (Legendre expansion) of a circular ring of electric 
charge for r < a. 

12.3.16 Calculate the electric field produced by the charged conducting ring of Example 12.3.3 
for 

(a) r > a, (b) r < a. 


12.3.17 


As an extension of Example 12.3.3, find the potential i jr(r, 0) produced by a charged 
conducting disk. Fig. 12.10, for r > a. the radius of the disk. The charge density a (on 
each side of the disk) is 


or(p) = 


4jra(a 2 — p 2 ) 1 / 2 ’ 


■ x 2 + y 2 . 


Hint. The definite integral you get can be evaluated as a beta function. Section 8.4. For 
more details see Section 5.03 of Smythe in Additional Readings. 


ANS. f(r,6) = 


D-d'; 


47re 0 r “ 2/ + 1 


2 / 

P 2 i (cos 6). 


12.3.18 From the result of Exercise 12.3.17 calculate the potential of the disk. Since you are 
violating the condition r > a, justify your calculation. 

Hint. You may run into the series given in Exercise 5.2.9. 


12.3.19 The hemisphere defined by r — a,0 < 9 < 7r/2, has an electrostatic potential +Vo- 
The hemisphere r = a, tt/ 2 <6 < it has an electrostatic potential — Vo. Show that the 
potential at interior points is 


V = 


Vo]T 

n =0 


4n + 3 
2 n + 2 


( \ 2«+l 

^2n(O)/V|-l(cOS0) 


= Vo^(-l)" 

n =0 


(4n + 3)(2n — 1)!! 

(2n + 2)!! 


(r\ 2n+{ 

(-) P 2 , !+ i(cos0). 


Hint. You need Exercise 12.3.8. 


12.3.20 A conducting sphere of radius a is divided into two electrically separate hemispheres by 
a thin insulating barrier at its equator. The top hemisphere is maintained at a potential 
Vo. the bottom hemisphere at — Vo. 
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12.3.21 


12.3.22 


12.3.23 


12.3.24 


12.3.25 


(a) Show that the electrostatic potential exterior to the two hemispheres is 

^ . (2s- 1)!! fa\ 2s+2 

V(r,0) = VoT(- l) J (4s + 3) p 2s+ i(cosd). 

^ (2s + 2)!! \r J 

(b) Calculate the electric charge density a on the outside surface. Note that your series 
diverges at cos 0 — ±1, as you expect from the infinite capacitance of this system 
(zero thickness for the insulating barrier). 


dV 

ANS. cr = e 0 E n = sq — 
or 


OO _ I \ !| 

= £0 Vo (- D" (4* + 3) P2 S+ 1 (cos 9 ). 


s=0 


(2 s)!! 


In the notation of Section 10.4, (p s (x ) = y/(2s + \ )/2P s (x), a Legendre polynomial is 
renormalized to unity. Explain how | <p s )(<Ps I acts as a projection operator. In particular, 
show that if |/> = a' n \<p n ), then 

\<Ps){<Ps\f) = a' s \<p s ). 

Expand .v 8 as a Legendre series. Determine the Legendre coefficients from Eq. (12.50), 

2m + 1 f 1 o 

a m = —^— J x p »iW dx - 

Check your values against AMS-55, Table 22.9. (For the complete reference, see Addi¬ 
tional Readings in Chapter 8). This illustrates the expansion of a simple function f(x). 
Actually if f{x) is expressed as a power series, the technique of Exercise 12.2.14 is 
both faster and more accurate. 

Hint. Gaussian quadrature can be used to evaluate the integral. 


Calculate and tabulate the electrostatic potential created by a ring of charge. Exam¬ 
ple 12.3.3, for r/a = 1.5(0.5)5.0 and 9 — 0°(15°)90°. Carry terms through P22(cos0). 
Note. The convergence of your series will be slow for r/a = 1.5. Truncating the series 
at P 22 limits you to about four-significant-figure accuracy. 

Check value. For r/a = 2.5 and 9 — 60°, 1 fr — 0.40272(q/47teor). 

Calculate and tabulate the electrostatic potential created by a charged disk. Ex¬ 
ercise 12.3.17, for r/a = 1.5(0.5)5.0 and 9 = 0°(15°)90°. Carry terms through 
P22(cos0). 


Check value. For r/a = 2.0 and 9 = 15°, i/ r = 0.46638(< 7/471 eor). 

Calculate the first five (nonvanishing) coefficients in the Legendre series expansion of 
f{x) — 1 — \x\ using Eq. (12.51) — numerical integration. Actually these coefficients 
can be obtained in closed form. Compare your coefficients with those obtained from 
Exercise 13.3.28. 


ANS. flo = 0.5000, «2 = —0.6250, <74 = 0.1875, a(, = —0.1016, as = 0.0664. 
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12.3.26 Calculate and tabulate the exterior electrostatic potential created by the two charged 
hemispheres of Exercise 12.3.20, for r/a — 1.5(0.5)5.0 and 6 — 0°(15°)90°. Carry 
terms through P 23 (cos 0 ). 

Check value. For r /a — 2.0 and 9 — 45°, V — 0.27066 Vo- 

12.3.27 (a) Given f(x ) = 2.0, \x\ < 0.5; f{x) — 0,0.5 < \x\ < 1.0, expand f(x) in a Legen¬ 

dre series and calculate the coefficients a„ through ago (analytically). 

(b) Evaluate Y^fLo A ( x ) for x — 0.400(0.005)0.600. Plot your results. 

Note. This illustrates the Gibbs phenomenon of Section 14.5 and the danger of trying to 
calculate with a series expansion in the vicinity of a discontinuity. 


12.4 Alternate Definitions of Legendre Polynomials 


Rodrigues’ Formula 


The series form of the Legendre polynomials (Eq. (12.8)) of Section 12.1 may be trans¬ 
formed as follows. From Eq. (12.8), 


In/ 2] 

f»w=^(-i)' 

r =0 


(2n — 2r)! 


2 n r\(n — 2 r)\(n — r)\ 


(12.64) 


For n an integer. 


[«/ 2 ] 

Pn(.x)= ^](-iy 


1 


r=0 


2 n r\(n — r)\ \dx 


d\ n 


^2n—2r 


1 ( d Vv { ~ lYn[ x 2n ~ 2r . 

2"n\ \dx ) 2—i r\(n — r)\ 

r =o 


(12.64a) 


Note the extension of the upper limit. The reader is asked to show in Exercise 12.4.1 that 
the additional terms [n/2] + 1 to n in the summation contribute nothing. However, the 
effect of these extra terms is to permit the replacement of the new summation by (x 2 — 1)" 
(binomial theorem once again) to obtain 

w =M£)' u2 - ,r a2 - 65) 

This is Rodrigues’ formula. It is useful in proving many of the properties of the Legendre 
polynomials, such as orthogonality. A related application is seen in Exercise 12.4.3. The 
Rodrigues definition is extended in Section 12.5 to define the associated Legendre func¬ 
tions. In Section 12.7 it is used to identify the orbital angular momentum eigenfunctions. 
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Schlaefli Integral 


Rodrigues’ formula provides a means of developing an integral representation of P„(z). 
Using Cauchy’s integral formula (Section 6.4) 

f(z) —dt (12.66) 

2 Til J t — z 

with 

/(z) = (z 2 - l)", (12.67) 

we have 

(z 2 - 1)” = — ~ ^ dt. (12.68) 

v ' 2ni J t — z 


Differentiating n times with respect to z and multiplying by 1 /2"n! gives 


Pn(z) = 


1 d n 
2 n n\ dz n 


(z 2 -!)" 


2 

2jti 


(i t 2 - 1)' ! 
(t — z)' !+1 


dt, 


(12.69) 


with the contour enclosing the point t — z. 

This is the Schlaefli integral. Margenau and Murphy 14 use this to derive the recurrence 
relations we obtained from the generating function. 

The Schlaefli integral may readily be shown to satisfy Legendre’s equation by differen¬ 
tiation and direct substitution (Fig. 12.11). We obtain 


ti 2\d 2 Pn 0 dP n 


1 )Pn = 


n + 1 
2 n 2jTi 


n +1 


(* 2 -P 

(t - z)"+ 2 


dt. (12.70) 


For integral n our function (t 2 — 1 )" +1 /(f — z)' !+2 is single-valued, and the integral around 
the closed path vanishes. The Schlaefli integral may also be used to define P v (z ) for non¬ 
integral v integrating around the points t — z, t = 1, but not crossing the cut line —1 to 
—oo. We could equally well encircle the points t = z and t = —1, but this would lead to 



1 1 H. Margenau and G. M. Murphy, The Mathematics of Physics and Chemistry, 2nd ed., Princeton, NJ: Van Nostrand (1956), 
Section 3.5. 
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nothing new. A contour about t = +1 and t — — 1 will lead to a second solution, Q v (z), 
Section 12.10. 


Exercises 

12.4.1 Show that each term in the summation 


A / d V (—!)'•«! 

^ \dx ) r\(n — r)\ 


2n—2r 


r=[n/ 2]+l 

vanishes (r and n integral). 

12.4.2 Using Rodrigues’ formula, show that the P„ (x) are orthogonal and that 




2 <i«= 2 


2n+ 1 

Hint. Use Rodrigues’ formula and integrate by parts. 

12.4.3 Show that l x m P n (x)dx = 0 when m < n. 

Hint. Use Rodrigues’ formula or expand x m in Legendre polynomials. 

12.4.4 Show that 

2" +1 n!n! 


fi X " Pn 


(. x ) dx = 


(2 n + 1)! 


Note. You are expected to use Rodrigues’ formula and integrate by parts, but also see if 
you can get the result from Eq. (12.8) by inspection. 


12.4.5 Show that 




^ r . {xUx - 


(2r + 2n+ l)!(r — n)\ 


r > n. 


12.4.6 As a generalization of Exercises 12.4.4 and 12.4.5, show that the Legendre expansions 
of X s are 


(a) x 2r = £ 


r 2 2,, (4« + l)(2r)!(r + n)\ 


(2r + 2n + l)!(r — n)\ 


Pln(x), s = 2r. 


n =0 


2r +1 2 2 " +1 (4n + 3)(2r + l)!(r + n + 1)! ^ , , , 

(b) x + =2^- 747 , \, - Pln+iix), s = 2r + 1. 


n =0 


(2r + 2n + 3)! (r — n)\ 

12.4.7 A plane wave may be expanded in a series of spherical waves by the Rayleigh equation, 

OO 

e ikrcosy _ g n j n (kr)P n (cosy)- 


n =0 


Show that a n — i n (2n + 1). 
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Hint. 

1. Use the orthogonality of the P n to solve for a„j n (kr). 

2. Differentiate n times with respect to (kr) and set r — 0 to eliminate the in¬ 
dependence. 

3. Evaluate the remaining integral by Exercise 12.4.4. 

Note. This problem may also be treated by noting that both sides of the equation satisfy 
the Heemholtz equation. The equality can be established by showing that the solutions 
have the same behavior at the origin and also behave alike at large distances. A “by 
inspection” type of solution is developed in Section 9.7 using Green’s functions. 

12.4.8 Verify the Rayleigh equation of Exercise 12.4.7 by starting with the following steps: 

(a) Differentiate with respect to (kr) to establish 

^2 j'n (kr)Pn(cosy) = i ^ a„ j„ (kr) cosy P n (cos y). 

n n 

(b) Use a recurrence relation to replace cos yP n (cosy) by a linear combination of 
Pn- 1 and P n+ 1 . 

(c) Use a recurrence relation to replace j' n by a linear combination of i and j n+ \. 

12.4.9 From Exercise 12.4.7 show that 

1 f 1 

jn(hr) = — J ^PnMdu. 

This means that (apart from a constant factor) the spherical Bessel function j n (kr) is 
the Fourier transform of the Legendre polynomial P n (ii). 

12.4.10 The Legendre polynomials and the spherical Bessel functions are related by 

1 C n 

j n (z) = -(-i) n / e' zcose P„(cos 0) sind dO, n = 0,1,2,.... 

2 Jo 

Verify this relation by transforming the right-hand side into 

cos(j cos 9) sin 2 " +1 9 dO 

and using Exercise 11.7.8. 

12.4.11 By direct evaluation of the Schlaefli integral show that P„( 1) = 1. 

12.4.12 Explain why the contour of the Schlaefli integral, Eq. (12.69), is chosen to enclose the 
points t = z and t — 1 when n —»• v, not an integer. 

12.4.13 In numerical work (for example, the Gauss-Legendre quadrature) it is useful to establish 
that P n (x) has n real zeros in the interior of [—1, 1], Show that this is so. 

Hint. Rolle’s theorem shows that the first derivative of (x 2 — l) 2 " has one zero in the 
interior of [—1, 1]. Extend this argument to the second, third, and ultimately the nth 
derivative. 


— f 

2" +l n\ Jo 
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When Helmholtz’s equation is separated in spherical polar coordinates (Section 9.3), one 
of the separated ODEs is the associated Legendre equation 


1 d ( dP" 1 (cos(9) 

-sin 0 —-- 

sin 0 d6\ dO 


n(n + 1) 


sin 2 0 


P™ (cos 6>) = 0. 


With x = cos 9, this becomes 


(12.71) 


(1 


t 2 ) —P« 
’dx 2 " 


(x) 


. 2x _ P 

a r n 
dx 


(x) + 


n(n + 1) 


CW = o. 


(12.72) 


If the azimuthal separation constant m 2 — 0, we have Legendre’s equation, Eq. (12.28). 
The regular solutions P™(x) (with m not necessarily zero, but an integer) are 


Am 

v = P;i\x) = (1 - x 2 ) m/ - — P„(x) (12.73a) 

with in > 0 an integer. 

One way of developing the solution of the associated Legendre equation is to start with 
the regular Legendre equation and convert it into the associated Legendre equation by using 
multiple differentiation. These multiple differentiations are suggested by Eq. (12.73a), the 
generation of associated Legendre polynomials, and spherical harmonics of Section 12.6 
more generally, in Section 4.3 using raising or lowering operators of Eq. (4.69) repeatedly. 
Lor their derivative form see Exercise 12.6.8. We take Legendre’s equation 

(1 - x 2 )P'' - 2xP' n + n(n + 1 )P n = 0, (12.74) 

and with the help of Leibniz’ formula 15 differentiate m times. The result is 

(1 — x 2 ^u" — 2 x(m + 1 )u' + (n — m)(n + m + 1 )u = 0, (12.75) 

where 

d m 

u =——P„(x). (12.76) 

dx m 

Equation (12.74) is not self-adjoint. To put it into self-adjoint form and convert the weight¬ 
ing function to 1, we replace u(x) by 

v(x) = (1 - x 2 ) m/2 u(x) = (1 - *T /2 ^. ( 12 - 73b ) 


15 Leibniz’ formula for the nth derivative of a product is 

A n n / M \ A n ~ s A s 

— [MW»WJ-£( )— AM-JM, 

s=0 v 7 


n\ _ n\ 
s ) (n- 5)!5! ’ 


a binomial coefficient. 
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Solving for u and differentiating, we obtain 


, mxv 2 \ 

/ + T 


u" + 


2mxv' 


■ + 


III V 


2\—m/2 

m(m + 2)x 2 v 


+ 


1-X 2 ' 1~X 2 ' (1 - A 2 ) 


2t2 


(l-, 2 ) 


2\ —m/2 


(12.77) 


(12.78) 


Substituting into Eq. (12.74), we find that the new function i> satisfies the self-adjoint 
ODE 


(l — a 2 )u" — 2xv' + 


n (n + 1 ) 


v = 0 , 


(12.79) 


which is the associated Legendre equation; it reduces to Legendre’s equation when m is set 
equal to zero. Expressed in spherical polar coordinates, the associated Legendre equation 
is 


1 d ( dv\ 

-( sin@— ) 

sin 6d9\ d6 ) 


n(n + 1 )- 7 


sirr 0 


v — 0 . 


(12.80) 


Associated Legendre Polynomials 

The regular solutions, relabeled P"'(x), are 

Jffl 

v = p;:\x) = (1 - x 2 ) m/2 — P n (x). (12.73c) 

These are the associated Legendre functions. 16 Since the highest power of x in P„(x) is 
A'", we must have m < n (or the /n-fold differentiation will drive our function to zero). 
In quantum mechanics the requirement that m < n has the physical interpretation that the 
expectation value of the square of the z component of the angular momentum is less than 
or equal to the expectation value of the square of the angular momentum vector L, 

[L])<[L 2 ) = f 2 f lm d\. 

From the form of Eq. (12.73c) we might expect m to be nonnegative. However, if P n (a) 
is expressed by Rodrigues’ formula, this limitation on m is relaxed and we may have —n < 
m < n, negative as well as positive values of m being permitted. These limits are consistent 
with those obtained by means of raising and lowering operators in Chapter 4. In particular, 
\m\ > n is ruled out. This also follows from Eq. (12.73c). Using Leibniz’ differentiation 
formula once again, we can show (Exercise 12.5.1) that P"' (x) and P~ m (x) are related by 

P~ m (x) = (-l) m ^CW. (12.81) 

(n + m)\ 

^Occasionally (as in AMS-55; for the complete reference, see the Additional Readings of Chapter 8), one finds the associated 
Legendre functions defined with an additional factor of (—l) m . This (— l) m seems an unnecessary complication at this point. 
It will be included in the definition of the spherical harmonics 1^(0, (p ) in Section 12.6. Our definition agrees with Jackson’s 
Electrodynamics (see Additional Readings of Chapter 11 for this reference). Note also that the upper index m is not an exponent. 
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From our definition of the associated Legendre functions P™(x), 

Pn(x) = P„(x). 


(12.82) 


A generating function for the associated Legendre functions is obtained, via Eq. (12.71), 
from that of the ordinary Legendre polynomials: 


(2m)!(l — x 2 ) m / 2 
2" ! m!(l - 2tx + f 2 ) m +!/2 


OO 


s =0 


(12.83) 


If we drop the factor (1 — x 2 )'"^ 2 = sin'" 6 from this formula and define the polynomi¬ 
als V? +m {x) = P™ +m (x)( 1 — .r 2 ) - '"/ 2 , then we obtain a practical form of the generating 
function. 


(2m)! 

,?/«( . ) 2'"m!(l — 2tx + t 2 ) m + 1 / 2 


OO 


Y,K +m ^y. 

s =0 


(12.84) 


We can derive a recursion relation for associated Legendre polynomials that is analogous 
to Eqs. (12.14) and (12.17) by differentiation as follows: 

(1 - 2 tx + = ( 2m + 1)(* - t)g m (x, t ). 

Substituting the defining expansions for associated Legendre polynomials we get 


(1 _ 2tx + = (2m + \)Y\xV? +m f - PT +m t S+l l 

s s 

Comparing coefficients of powers of t in these power series, we obtain the recurrence 
relation 


(s + DKWi - ( 2wi + 1 + 2s ) x K+m + (s + 2m)^+ m _i = 0. (12.85) 

For m = 0 and s —n this relation is Eq. (12.17). 

Before we can use this relation we need to initialize it, that is, relate the associated 
Legendre polynomials to ordinary Legendre polynomials. We can use P'" = (2m — 1)!! 
fromEq. (12.73c). Also, since |m| < n, we may set P" +1 = 0 and use this to obtain starting 
values for various recursive processes. We observe that 

(1 -2xt + t 2 )gi(x,t)=(l -2xt + t 2 y m = Y^Ps(x)t s , ( 12 . 86 ) 

so upon inserting Eq. (12.84) we get the recursion 

vUi - 2xV l + V l-\ = p s (12-87) 

More generally, we also have the identity 

(1 - 2xt + t 2 )g m+ i(x, t) = (2m + 1 )g m (x,t), (12.88) 

from which we extract the recursion 

K+1 +1 - 2x K+,n + K+m-l = C2« + 1 )CW. d 2 - 89 ) 

which relates the associated Legendre polynomials with superindex m + 1 to those with m. 
For m = 0 we recover the initial recursion Eq. (12.87). 
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Table 12.2 Associated Legendre Functions 

pl(x) = ( 1-A 2 ) 1/2 = sin <9 

P 2 (x) = 3x(l — x 2 ) 1 / 2 = 3 cos# sin# 

P 2 (a) = 3(1 - a 2 ) = 3 sin 2 9 

P 3 1 (a)= I (5a 2 — 1)(1 — a 2 ) 1 / 2 = | (5 cos 2 8 — 1) sin $ 

P 2 (a) = 15a(1 — a 2 ) = 15 cos 9 sin 2 8 
P 3 3 ( a) = 15(1 - a 2 ) 3 / 2 = 15 sin 3 9 

P 4 (a) = 3 (7a 3 — 3a)(1 — a 2 ) 1 / 2 = |(7cos 3 9 — 3 cos 9 ) sin# 
P 2 (a)= ^(7a 2 - 1)(1 — a 2 ) = ^(7cos 2 0- 1) sin 2 6» 

P 4 3 (a) = 105a(1 — a 2 ) 3 / 2 = 105 cos $ sin 3 8 
p4( A -) = 105(1 - A 2 ) 2 = 105 sin 4 8 


Example 12 . 5.1 Lowest Associated Legendre Polynomials 

Now we are ready to derive the entries of Table 12.2. For m = 1 and .v = 0, Eq. (12.87) 
yields V\ = 1, because Vq = 0 — do not occur in the definition, Eq. (12.84), of the 
associated Legendre polynomials. Multiplying by (1 — x 2 ) 1 / 2 = sin 0 we get the first line 
of Table 12.2. For s = 1 we find, from Eq. (12.87), 

V\ (x) — P\ + 2xV\ — x + 2x = 3x, 

from which the second line of Table 12.2, 3 cost? sin 9, follows upon multiplying by sin0. 
For s — 2 we get 

V\ (x) = P 2 + 2xV\ ~V\ = \ (3x 2 - 1) + 6x 2 - 1 = ^x 2 - 3 -, 

in agreement with line 4 of Table 12.2. To get line 3 we use Eq. (12.88). For m = 1, s — 0, 
this gives V^{x) — 3V\ (x) = 3, and multiplying by 1 — x 2 = sin 2 0 reproduces line 3 of 
Table 12.2. For lines 5, 8, 9, Eq. (12.84) may be used, which we leave as an exercise. More 
generally, we use Eq. (12.89) instead of Eq. (12.87) to get a starting value of "P™. Then 
Eq. (12.85) reduces to a two-term formula for V™, giving (2m — 1)!!. Note that, if m — 0, 
this is (-1)!!= 1. ■ 


Example 12.5.2 Special Values 

For x = 1 we use 

OO 

(1 -2f+ f 2 )“'”“ 1/2 = (l 
in Eq. (12.84) and find 


s =0 


—2m — 1 




(2m)! (-2m - 1 


s+rav ) 2 m m } 


(12.90) 
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where 

7)= 1 

for s = 0 and 

( —m\ _ (—m)(—m - 1) • • • (1 - s — m) 

V 5 / 7 

for s > 1. For m = 1, s = 0 we have V\{1) — ("q 3 ) = 1; for 5 = 1, V\(Y) — — ( _ j 3 ) = 3; 
for 5 = 2, V\ (1) = (“ 3 ) = ( ~ 3) 2 ( ~ 4) = 6 = |(5 - 1), which all agree with Table 12.2. For 
x = 0 we can also use the binomial expansion, which we leave as an exercise. ■ 


Recurrence Relations 


As expected and already seen, the associated Legendre functions satisfy recurrence rela¬ 
tions. Because of the existence of two indices instead of just one, we have a wide variety 
of recurrence relations: 

C +l - ( | ^ 2 ) 1/2 p n + ["(" + 1) - m(« - D]C _1 = 0, (12.91) 


(2 n + \)xP™ = (n + + (n - m + 1 )P™ +V (12.92) 


(2n + l)(l-x 2 ) 1/2 C = F'"+ 1 


pin +1 
r n -1 


= (n + m)(n + m — 1 )P'"_i 


- (n - m + \){n - m + 2 )P™ +1 1 , 


(12.93) 


(1 - x 2 ) l/2 P™’ = ' 2 P" ,+ ' - \{n + m)(n - m + 1) P™~\ (12.94) 

These relations, and many other similar ones, may be verified by use of the generat¬ 
ing function (Eq. (12.4)), by substitution of the series solution of the associated Legen¬ 
dre equation (12.79) or reduction to the Legendre polynomial recurrence relations, us¬ 
ing Eq. (12.73c). As an example of the last method, consider Eq. (12.93). It is similar to 
Eq. (12.23): 


(2 n + l)Pn(x) = P’ n+l {x) - P’ n _ j(x). (12.95) 

Let us differentiate this Legendre polynomial recurrence relation m times to obtain 

d m d m d m 

( 2 n + 1 )-— P n (x) — - — P' .Ax) —-— P' Ax) 
dx m dx m " +1 dx" 1 n 1 


d m+ 1 d m+l 

-P„ + ](x) - , „ X | P«-i(-t). 


dx m+l 


dx m+l 


(12.96) 


Now multiplying by (1 — T 2 )( m +L/2 anc | us j n g the definition of P n (x ), we obtain the first 
part of Eq. (12.93). 
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Parity 

The parity relation satisfied by the associated Legendre functions may be determined by 
examination of the defining equation (12.73c). As x -> —x, we already know that P n (x ) 
contributes a (—1)". The 777 -fold differentiation yields a factor of (—1)'". Hence we have 

P“(-x) = (—1 ) n+m P™{x). (12.97) 

A glance at Table 12.2 verifies this for 1 < m < n < 4. 

Also, from the definition in Eq. (12.73c), 

P"'(±l) = 0, for 777 ^ 0. (12.98) 


Orthogonality 


The orthogonality of the P™ (x) follows from the ODE, just as for the P n (x) (Section 12.3), 
if 777 is the same for both functions. However, it is instructive to demonstrate the orthogo¬ 
nality by another method, a method that will also provide the normalization constant. 

Using the definition in Eq. (12.73c) and Rodrigues’ formula (Eq. (12.65)) for P n (x), we 
find 




P"\x)P’'\x)dx= — 

p q 2 p+i p 


'n 7 * 1 / 

— / X m I 

WJ-i V 


( d p+m n \ d q+m n 
1 X p - —X q dx. 


d x P+ m 


dx q+m 


(12.99) 


The function X is given by X = (x 2 — 1). If p ^ q, let us assume that p < q. Notice that the 
superscript m is the same for both functions. This is an essential condition. The technique 
is to integrate repeatedly by parts; all the integrated parts will vanish as long as there is a 
factor X — x 2 — 1. Let us integrate q + m times to obtain 
.1 


L 


p;{x)p™{x)dx = 


/• 1 rfq+m 


j: 


x q - 


X" 


d p+m 


X p )dx. (12.100) 


2 p +<tp\q\ J_ { " dx q+m \" dx p+m 

The integrand on the right-hand side is now expanded by Leibniz’ formula to give 


X q 


d q+m 


dx‘J+ m 

q+m 


x n 


d p+m 

dx p+m 


X p 


= xq T (g + 777)! ( d q+m ~‘ xm \ dP +m+i x „ 

—' i\(q + m — i)\ \ /< 


7=0 


\(q + 772 — /)! \dx q+m 1 J dx p+m+l 

Since the term X m contains no power of x greater than x 2m , we must have 

q + m — i < 2m 

or the derivative will vanish. Similarly, 

p + m + i < 2 p. 

Adding both inequalities yields 


( 12 . 101 ) 


( 12 . 102 ) 


(12.103) 


q < p- 


(12.104) 
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which contradicts our assumption that p < q. Hence, there is no solution for i and the 
integral vanishes. The same result obviously will follow if p > q. 

For the remaining case, p — q, we have the single term corresponding to i = q — m. 
Putting Eq. (12.101) into Eq. (12.100), we have 



(—l) q+2 ' n (q + ?«)! X J d 2 >" \ 

2 2q q\q\(2m)\(q — m)\ J_\ \dx 2m ) 


Since 



dx. 

(12.105) 




= (x 2 -!)"'= x 2m -mx 2m ~ 2 + - 


(12.106) 


d 2m 

dx 2m 


X m = (2 777)!, 


Eq. (12.105) reduces to 

J [Pq(x)f dx = 

The integral on the right is just 


(-l)g+2»«(2 q)\(q + m)\ r 1 ^ ^ 

2 2 1q\q\(q — m)\ J_\ 


(12.107) 


(12.108) 


„ r (—\) q 2 lq+i q\q\ 

(-1)« / sin 2q+l dde=- --- — (12.109) 

Jo (2^ + 1)! 

(compare Exercise 8.4.9). Combining Eqs. (12.108) and (12.109), we have the orthogo¬ 
nality integral. 


(12 110) 

or, in spherical polar coordinates, 

2 (q mV 

/ P'p (cos9)P™(cos0)sin0d0 = -——— • j 2 - - ’-8 pq . ( 12 . 111 ) 

Jo y 2<? + 1 ( q-m)\ 

The orthogonality of the Legendre polynomials is a special case of this result, obtained 
by setting m equal to zero; that is, for m — 0, Eq. (12.110) reduces to Eqs. (12.47) and 
(12.48). In both Eqs. (12.110) and (12.111), our Sturm-Liouville theory of Chapter 10 
could provide the Kronecker delta. A special calculation, such as the analysis here, is re¬ 
quired for the normalization constant. 

The orthogonality of the associated Legendre functions over the same interval and with 
the same weighting factor as the Legendre polynomials does not contradict the unique¬ 
ness of the Gram-Schmidt construction of the Legendre polynomials. Example 10.3.1. 
Table 12.2 suggests (and Section 12.4 verifies) that f_ i P™ (x)P^" (x) dx may be written as 



P n p ‘(x)P q m (x)(] 


— x 2 )'" dx , 


where we defined earlier 
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The functions P"‘ (x) may be constructed by the Gram-Schmidt procedure with the weight¬ 
ing function w(x) = (1 — x 2 ) m . 

It is possible to develop an orthogonality relation for associated Legendre functions of 
the same lower index but different upper index. We find 

[' C(*)P*(s) (1 - x 2 )~ 1 dx = ( ” + m)! S m , k . (12.112) 

J m(n — ml ) 

Note that a new weighting factor, (1 — x 2 ) -1 , has been introduced. This relation is a math¬ 
ematical curiosity. In physical problems with spherical symmetry solutions of Eqs. (12.80) 
and (9.64) appear in conjunction with those of Eq. (9.61), and orthogonality of the az¬ 
imuthal dependence makes the two upper indices equal and always leads to Eq. (12.111). 


Example 12.5.3 Magnetic Induction Field OF a Current Loop 

Like the other ODEs of mathematical physics, the associated Legendre equation is likely 
to pop up quite unexpectedly. As an illustration, consider the magnetic induction field B 
and magnetic vector potential A created by a single circular current loop in the equatorial 
plane (Fig. 12.12). 

We know from electromagnetic theory that the contribution of current element I dX to 
the magnetic vector potential is 


dA — 


/xq I dX 
47T r 


(12.113) 


(This follows from Exercise 1.14.4 and Section 9.7) Equation (12.113), plus the symmetry 
of our system, shows that A has only a <p component and that the component is independent 



Figure 12.12 Circular current 
loop. 
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of tp} 1 


By Maxwell’s equations, 

V 


Since 


we have 


A = q>A v (r, 0). (12.114) 

xH = J, — =0 (SI units). (12.115) 

3 1 

W H = B = VxA, (12.116) 

Vx(VxA) = /i 0 J, (12.117) 


where J is the current density. In our problem J is zero everywhere except in the current 
loop. Therefore, away from the loop, 

VxVx^(r,9) = 0, (12.118) 


using Eq. (12.114). 

From the expression for the curl in spherical polar coordinates (Section 2.5), we obtain 
(Example 2.5.2) 


V x [V x <pAy(r, 6)~\ — (p 


3 2 A (p 
dr 2 


2d Ay 1 3 2 Ay, 
r dr r 2 dd 2 


1 3 
r 2 dd 


(cot 9 Ay) 


= 0 . 


(12.119) 


Letting A v (r, 9) = R(r)®(6) and separating variables, we have 

, dR 

r 2 —r- + 2- n(n+l)R=0, (12.120) 

dr- dr 

d 2 ® d® 0 

— T + cote— + n(n + 1)0 - = 0. (12.121) 

de- dd sin 2 9 

The second equation is the associated Legendre equation (12.80) with m = 1, and we may 
immediately write 

®(9) = P„ l (cos 9). (12.122) 


The separation constant n(n + 1), n a nonnegative integer, was chosen to keep this solution 
well behaved. 

By trial, letting R(r ) = r a , we find that a — /?, or —n — 1. The first possibility is dis¬ 
carded, for our solution must vanish as r —> oo. Hence 

i / \ tl~\~ 1 

A <pn = -^Pn{cos9)=c n r-\ P^(cosO) (12.123) 


17 Pair off corresponding current elements IdX(<p\) and I d\((p 2 ), where (p — (p\ = (p2 — <P- 
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00 / \ 

A<p(r,6) = J2 c n\-) P^(cos9) (r>a). 

n=l ' 


(12.124) 


Here a is the radius of the current loop. 

Since A v must be invariant to reflection in the equatorial plane, by the symmetry of our 
problem. 


A v (r, cos 6) = A v (r, —cos 9), 


(12.125) 


the parity property of P,'”(cos0) (Eq. (12.97)) shows that c„ — 0 for n even. 

To complete the evaluation of the constants, we may use Eq. (12.124) to calculate B z 
along the /-axis ( B- = B, (r, 9 = 0)) and compare with the expression obtained from the 
Biot-Savart law. This is the same technique as used in Example 12.3.3. We have (compare 
Eq. (2.47)) 


B, = V x A = 


r r sin# 3 9 


1 COt# 1 3 Aa 

(sin#A„,) =- Ay H- —} 


(12.126) 


dP^(co&6) _ . d (cos 0) _ 1 n2 n(n+ 1) p0 

3 9 ~ SmU d(cosd) ~ 2 " n ' 2 

(Eq. (12.94)) and then Eq. (12.91) with m = 1, 

9 2 cos 9 , 

Mr (cos#)-P,;(cos#) + n(n + l)P„(cos#) = 0 , 

sin 6 

we obtain 


(12.127) 


(12.128) 


d ' 1 

B r (r, 9) = J2 c n n ( n + 1)-^ p n(cos9), r > a. 


(12.129) 


(for all 9). In particular, for 9 — 0 , 


d ' 

Br(r > 0 ) = ^ c „ h (/7 + 1 )— 


(12.130) 


We may also obtain 


1 3 (rA v ) 


Be(r,0) = -—^ 

r dr 


= E c "”)TT 2 P » 1(cos0) ’ 


(12.131) 


The Biot-Savart law states that 


un dX x r 

<7B = —I - 

4 n r- 


(SI units). 


(12.132) 


We now integrate over the perimeter of our loop (radius a). The geometry is shown in 
Fig. 12.13. The resulting magnetic induction field is z B z , along the ’-axis, with 


Mo I 2 / 2 , 2\-3/2 a 1 « 

5 ’=— =^--3 ! + T 2 


2\ -3/2 


(12.133) 
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Expanding by the binomial theorem, we obtain 


Ho I a 1 

“z — 0 -J 

2 




2 lz 


8 Vz 




2 oo 


2 Z : 


s=0 


(2i+l)!!/a\ 

(2s)!! W 


2s 


z> a. 


(12.134) 


Equating Eqs. (12.130) and (12.134) term by term (with r — z), we find 
Mo I IM)I 

Cl = -, C 3 =-, C2 = CA — ■ ■ ■ = 0. 

4 16 


c„ = (-1) 


(«-1)/2_ 


/r 0 / 


(n/2)! 


2n(n + 1) [(n — l)/2]!(i)! ’ 


n odd. 


(12.135) 


Equivalently, we may write 


„ _ ( 1V . MO 7 (2n)! _ „Mo 7 (2n - 1)!! 

2«+i f 1 22)i+2 n!(n + 1) , 2 (2« + 2)!! 


(12.136) 


18' 


The descending power series is also unique. 
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and 


A v (r,6) 



2 n 

P 2n+ l( cos6) ). 


(12.137) 


Br(r,0) 


2 00 

t'2/i+l (2n + 1) (2n + 2) 


) Zn 

P 2n+ 1(COS0), 


(12.138) 


B 0 (r,0) 


O OO 

, c*—> 

— / , ( -2n +1 (2w + 1) 
«=0 



2n 

P 2n+ l(c°Sl9). 


(12.139) 


These fields may be described in closed form by the use of elliptic integrals. Exer¬ 
cise 5.8.4 is an illustration of this approach. A third possibility is direct integration of 
Eq. (12.113) by expanding the denominator of the integral for A v in Exercise 5.8.4 as 
a Legendre polynomial generating function. The current is specified by Dirac delta func¬ 
tions. These methods have the advantage of yielding the constants c n directly. 

A comparison of magnetic current loop dipole fields and finite electric dipole fields may 
be of interest. For the magnetic current loop dipole, the preceding analysis gives 


/lo / a 2 
B r (r,6) = ^^ 
2 

Ho I a 2 


p l~^ - />3 + 




>1 


4 r - 

From the finite electric dipole potential of Section 12.1 we have 

2 


E r (r,0) = 
Eg(r,e) = 


qu 


7TSor J 

qa 


p l 


21 °- 


P 3 


2tceo>' 3 


~ Pn. 


(12.140) 

(12.141) 


(12.142) 

(12.143) 


The two fields agree in form as far as the leading term is concerned (r -3 P\), and this is 
the basis for calling them both dipole fields. 

As with electric multipoles, it is sometimes convenient to discuss point magnetic mul¬ 
tipoles (see Fig. 12.14). For the dipole case, Eqs. (12.140) and (12.141), the point dipole 
is formed by taking the limit a —> 0, / -> oo, with la 2 held constant. With n a unit vector 
normal to the current loop (positive sense by right-hand rule. Section 1.10), the magnetic 
moment m is given by m = nlna 2 . ■ 


0 ; 0, ip) 



-a 


a 



Figure 12.14 Electric dipole. 



Exercises 

12.5.1 

12.5.2 


12.5.3 

12.5.4 

12.5.5 

12.5.6 
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Prove that 

p—m 

1 n 

where P"\x) is defined by 


w=( _, r ^ w , 

(77 + 77?)! 


P”(x) = — (1 - x 2 ) m/2 ^— (x 2 - 1)". 

" v 9n„l' ' ,j Y n+m V ' 


^n+m 


2 n n \ v 7 dx" 

Hint. One approach is to apply Leibniz’ formula to (x + 1)" (x — 1)". 


Show that 


4(0) = 0, 

4+1 ( 0 ) = (-!)' 

by each of these three methods: 


(2 n + 1)! 
(2 "n\) 2 


(- 1 )" 


(2/7+1)!! 

(2n)!! 


(a) use of recurrence relations, 

(b) expansion of the generating function, 

(c) Rodrigues’ formula. 


Evaluate P™( 0). 

ANS. P„ m (0) = 


Show that 


(-D 

0, 


(n—m)/2 


(n + m)\ 


2"((n — m)/2)!((n + m)/2!) 


Also, P™ (0) = (-l)("-")/ 2 (/l + wl ' )!! , 

(n — //?)!! 


, n + m even, 
n + m odd. 
/? + /// even. 


P" (cos 0) = (2n - 1)!! sin" (9, 77 = 0,1,2,.... 

Derive the associated Legendre recurrence relation 

p;: ,+ l (x)- 2mX ,. n P: (X) + [77 (77 + 1 ) - 777 ( 777 - \)]P™~\x) = 0. 

Develop a recurrence relation that will yield P,](x) as 

P„ (x) = f\(x, n)P„(x) + f 2 (x, n)P n -](x). 


Follow either (a) or (b). 


(a) Derive a recurrence relation of the preceding form. Give f\ (x, n) and fiix, n ) 
explicitly. 

(b) Find the appropriate recurrence relation in print. 


(1) Give the source. 
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12.5.7 


12.5.8 


12.5.9 


12.5.10 


12.5.11 


12.5.12 


(2) Verify the recurrence relation. 

ANS. P ] n (*) = - 


nx 


(! -* 2 ) 1/2 n ^ (! — * 2 ) 1/2 


Pn- 1- 


Show that 


sin#-P„(cos0) — P.](cos9). 

d cos 0 


Show that 



« f( 

n 

dp;/ 

. d9 


- f( 

' p 1 

1 ft 


v sin 0 



,„2 nm r>m 


sin 2 # 


• o r ,n 2n(« + 1) (n +m)\ 

sin 0 dO = - o n 

2n + 1 (n — m)! 


7 1 , dP 1 

" " 1 sin@ = 0. 


These integrals occur in the theory of scattering of electromagnetic waves by spheres. 
As a repeat of Exercise 12.3.10, show, using associated Legendre functions, that 

/ *(1-*^ (x)P' m (x)dx = 


n + 1 


«! 


2 n + 1 2n — 1 (n — 2)! 
n 2 (n + 2)! 


&m,n— 1 


2n + 1 2 h + 3 n ! 


I Om,n +1 • 


Evaluate 


J sin 2 0 P,, 1 (cos 9 ) d 6. 

The associated Legendre polynomial P"' (x) satisfies the self-adjoint ODE 


(l-* 2 )^-2* J TO 


dx 2 


J* 


n(n + 1) — 


1 — * 2 


CW = 0. 


From the differential equations for P™ (*) and P ; f (*) show that 

/: 


P™(x)Phx) T ^ = 0, 


1 — *2 

for k^m. 

Determine the vector potential of a magnetic quadrupole by differentiating the magnetic 
dipole potential. 

P0/ 2 \ „ Pj(cosf9) 

ANS. Aj/g = —( Ia~)(dz)<p ——^-F higher-order terms. 


Ba/2 = ixo(la 2 )(dz ) 


,3P 2 (cos 0) ^ P 2 (cos6>) 
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This corresponds to placing a current loop of radius a at z dz and an oppositely 
directed current loop at z -> —dz and letting a —> 0 subject to (dz)a (dipole strength) 
equal constant. 

Another approach to this problem would be to integrate dA (Eq. (12.113), to expand the 
denominator in a series of Legendre polynomials, and to use the Legendre polynomial 
addition theorem (Section 12.8). 

12.5.13 A single loop of wire of radius a carries a constant current I. 

(a) Find the magnetic induction B for r < a, 6 — tt/2. 

(b) Calculate the integral of the magnetic flux (B ■ da) over the area of the current 
loop, that is 

[C B -k‘ >= ^) dvrdr - 

ANS. oo. 

The Earth is within such a ring current, in which / approximates millions of amperes 
arising from the drift of charged particles in the Van Allen belt. 

12.5.14 (a) Show that in the point dipole limit the magnetic induction field of the current loop 

becomes 

u 0 m 

B r (r,6)= ^^Pi(cos0), 

2n r J 

a o m , 

B e (r,0)= (cos9) 

2jt r 3 

with m = lira 2 . 

(b) Compare these results with the magnetic induction of the point magnetic dipole of 
Exercise 1.8.17. Take m = yin. 

12.5.15 A uniformly charged spherical shell is rotating with constant angular velocity. 

(a) Calculate the magnetic induction B along the axis of rotation outside the sphere. 

(b) Using the vector potential series of Section 12.5, find A and then B for all space 
outside the sphere. 

12.5.16 In the liquid drop model of the nucleus, the spherical nucleus is subjected to small 
deformations. Consider a sphere of radius ro that is deformed so that its new surface is 
given by 

r — ro[l + a 2 -P 2 (cos 0 )]. 

Find the area of the deformed sphere through terms of order a 2 - 
Hint. 



r sin 0 dO dtp. 

ANS. A = 47r r ( 2 [ 1 + j a 2 + O(oi^)\. 
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Note. The area element d A follows from noting that the line element ds for fixed <p is 
given by 


ds = (r 2 dO 2 + dr 2 ) l/1 = (r 2 + ^ ' dO. 

12.5.17 A nuclear particle is in a spherical square well potential V (r, 0, q>) = 0 for 0 < r < a 
and oo for r > a. The particle is described by a wave function i//(r. 0. (p) which satisfies 
the wave equation 


ft 2 
2 M 


V 2 ^ + Vo^r = E\jf, 


and the boundary condition 


r < a, 


t/r (r = a) = 0. 


Show that for the energy £ to be a minimum there must be no angular dependence in 
the wave function; that is, i// = 4r{r). 

Hint. The problem centers on the boundary condition on the radial function. 

12.5.18 (a) Write a subroutine to calculate the numerical value of the associated Legendre 

function Ph (x) for given values of N and x. 

Hint. With the known forms of P^ and P) you can use the recurrence relation 
Eq. (12.92) to generate P X N , N > 2. 

(b) Check your subroutine by having it calculate Ph (x) for x = 0.0(0.5) 1.0 and N — 
1(1)10. Check these numerical values against the known values of P^( 0) and 
P^(l) and against the tabulated values of P^,(0.5). 

12.5.19 Calculate the magnetic vector potential of a current loop. Example 12.5.1. Tabulate your 
results for r/a — 1.5(0.5)5.0 and 6 — 0°(15°)90°. Include terms in the series expansion, 
Eq. (12.137), until the absolute values of the terms drop below the leading term by a fac¬ 
tor of 10 5 or more. 

Note. This associated Legendre expansion can be checked by comparison with the el¬ 
liptic integral solution. Exercise 5.8.4. 

Check value. For r/a — 4.0 and 0 — 20°, 
A v / ijlqI — 4.9398 x 10“ 3 . 


12.6 Spherical Harmonics 

In the separation of variables of (1) Laplace’s equation, (2) Helmholtz’s or the space- 
dependence of the electromagnetic wave equation, and (3) the Schrodinger wave equation 
for central force fields. 


N 2 f + k 2 f(r)f = 0, 


(12.144) 
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the angular dependence, coming entirely from the Laplacian operator, is 


19 


O(p) d ( d&\ 0(0) d 2 <$>(ip) 

— ( sinf?—— + . , + n(n + 1)0(0)4%) = 0. (12.145) 

sin# dO \ dO) sin 0 d(p z 


Azimuthal Dependence — Orthogonality 


The separated azimuthal equation is 


1 d 2 <t>((p) 

$(<p) dip 1 


with solutions 


<$>{q>) = e - imv , e imv , 


with m integer, which satisfy the orthogonal condition 



—imi<p im 2 <p j. n _ 


dip — 2 7T 8 m | m 2 ■ 


(12.146) 


(12.147) 


(12.148) 


Notice that it is the product (^)<t>,„ 2 (<p) that is taken and that * is used to indicate the 
complex conjugate function. This choice is not required, but it is convenient for quantum 
mechanical calculations. We could have used 


<J> = sin»z^, cos mip (12.149) 

and the conditions of orthogonality that form the basis for Fourier series (Chapter 14). 
For applications such as describing the Earth’s gravitational or magnetic field, sin /;/</; and 
cos imp would be the preferred choice (see Example 12.6.1). 

In electrostatics and most other physical problems we require m to be an integer in order 
that <t>(<p) be a single-valued function of the azimuth angle. In quantum mechanics the 
question is much more involved: Compare the footnote in Section 9.3. 

By means ofEq. (12.148), 


4>rn = d— e " n v (12.150) 

V27T 

is orthonormal (orthogonal and normalized) with respect to integration over the azimuth 
angle cp. 


^For a separation constant of the form n(n + 1) with n an integer, a Legendre-equation-series solution becomes a polynomial. 
Otherwise both series solutions diverge, Exercise 9.5.5. 
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Polar Angle Dependence 


Splitting off the azimuthal dependence, the polar angle dependence (9) leads to the asso¬ 
ciated Legendre equation (12.80), which is satisfied by the associated Legendre functions; 
that is, ®(9) = P l "'(cos9). To include negative values of m, we use Rodrigues’ formula, 
Eq. (12.65), in the definition of P" 1 (cos 0). This leads to 

P]! 1 (cos 9) — -(1 — x 2 )'"^ -(,v 2 — l)”, —n<m<n. (12.151) 

" 2”ft! v ’ dx m+n v ; “ 


P"‘ (cos 9) and P~ m (cos 9) are related as indicated in Exercise 12.5.1. An advantage of this 
approach over simply defining P" ! (cos0) for 0 < m < n and requiring that P~ m — P™ is 
that the recurrence relations valid for 0 < m < n remain valid for —n < m < 0. 

Normalizing the associated Legendre function by Eq. (12.110), we obtain the orthonor¬ 
mal functions 


/2ft + 1 (ft — m)! 


(ft + »?)! 


P' n (cos9), 


— ft < ft! < ft, 


(12.152) 


which are orthonormal with respect to the polar angle 9. 


Spherical Harmonics 

The function <t> m (^>) (Eq. (12.150)) is orthonormal with respect to the azimuthal an¬ 
gle <p. We take the product of <t> m (<p) and the orthonormal function in polar angle from 
Eq. (12.152) and define 


(cos 9)e imv (12.153) 

to obtain functions of two angles (and two indices) that are orthonormal over the spheri¬ 
cal surface. These Y"'(9, <p) are spherical harmonics, of which the first few are plotted in 
Fig. 12.15. The complete orthogonality integral becomes 

r r Y™'*(9,<p)Y™ 2 (9,<p)smed6d<p = 8 nin2 8 mim2 . (12.154) 

J (p =0 J 6 =0 

The extra (—1)"' included in the defining equation of Y™(9, <p) deserves some comment. 
It is clearly legitimate, since Eq. (12.144) is linear and homogeneous. It is not necessary, 
but in moving on to certain quantum mechanical calculations, particularly in the quan¬ 
tum theory of angular momentum (Section 12.7), it is most convenient. The factor (—1)'” 
is a phase factor, often called the Condon-Shortley phase, after the authors of a classic 
text on atomic spectroscopy. The effect of this (—1)'" (Eq. (12.153)) and the (—1)'" of 
Eq. (12.73c) for P~ m (cos (9) is to introduce an alternation of sign among the positive m 
spherical harmonics. This is shown in Table 12.3. 

The functions Y™(6, <p) acquired the name spherical harmonics first because they are 
defined over the surface of a sphere with 9 the polar angle and q> the azimuth. The har¬ 
monic was included because solutions of Laplace’s equation were called harmonic func¬ 
tions and Y"‘ (cos, <p) is the angular part of such a solution. 


Y™(9,cp) = (-iy 


/2ft + 1 (ft — /«)! 

47T (n + /«)! 
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Figure 12.15 [St Y n (0, <p)Y for 0 < l < 3, m = 0,..., 3. 
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Table 12.3 Spherical Harmon¬ 
ics (Condon-Shortley Phase) 


Y ^=v^ 

I a 

I 7 , 1 (8, ip) = —. — sinSe' 1 ? 
V 8 7T 


Y\’(8, <p) = ^ —cos8 


Y~ 1 (8,(p) = +^ sinde-'V 



Yr, ^(6, (p) = +J -3 sin 6 cos 6e i(f) 

2 v 24 n 


Y^ 2 (8,<p) = J ^ 3 sin 2 8e~ 2i,p 


In the framework of quantum mechanics Eq. (12.145) becomes an orbital angular mo¬ 
mentum equation and the solution Y^(6,q>) (n replaced by L . m replaced by M) is an 
angular momentum eigenfunction, L being the angular momentum quantum number and 
M the z-axis projection of L. These relationships are developed in more detail in Sec¬ 
tions 4.3 and 12.7. 


Laplace Series, Expansion Theorem 

Part of the importance of spherical harmonics lies in the completeness property, a con¬ 
sequence of the Sturm-Liouville form of Laplace’s equation. This property, in this case, 
means that any function f(9, <p) (with sufficient continuity properties) evaluated over the 
surface of the sphere can be expanded in a uniformly convergent double series of spherical 
harmonics 20 (Laplace’s series): 

f{e,<p) = Y J a mn Y n(0,cp). (12.155) 

m,n 

If f(6, (p) is known, the coefficients can be immediately found by the use of the orthogo¬ 
nality integral. 


20 For a proof of this fundamental theorem see E. W. Hobson, The Theory of Spherical and Ellipsoidal Harmonics , New York: 
Chelsea (1955), Chapter VII. If f(6, (p) is discontinuous we may still have convergence in the mean, Section 10.4. 
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Table 1 2.4 Gravity Field Coefficients, Eq. (12.156) 


Coefficient" 

Earth 

Moon 

Mars 

C 20 

1.083 x 10“ 3 

(0.200 ± 0.002) x 10“ 3 

(1.96 ±0.01) x nr 3 

C 22 

0.16 x 10“ 5 

(2.4 ±0.5) x 10“ 5 

(—5 ± 1) x 10“ 5 

$22 

-0.09 x 10“ 5 

(0.5 ±0.6) x 10“ 5 

(3 ± l) x nr 5 


a C20 represents an equatorial bulge, whereas C22 and S22 represent an azimuthal dependence of the 
gravitational field. 


Example 12.6.1 Laplace Series —Gravity Fields 


The gravity fields of the Earth, the Moon, and Mars have been described by a Laplace 
series with real eigenfunctions: 


U (r, 6, <p) = 


GM 

~R~ 


7-££(7) l c " 

n=2 m=0 x 7 


1 Y,nn <P) + Snm Y„in (^> *P)} 


(12.156) 


Here M is the mass of the body and R is the equatorial radius. The real functions Y*\ n and 
Y° m are defined by 


Ynm (#> 9) ~ R n ( cos 0) cos ttup, Y° nn {9 , (p) — P™ (cos 0) sin imp. 


For applications such as this, the real trigonometric forms are preferred to the imaginary 
exponential form of Y^(9,q>). Satellite measurements have led to the numerical values 
shown in Table 12.4. ■ 


Exercises 


12.6.1 Show that the parity of Y^f (0, (p) is (— \) L . Note the disappearance of any M depen¬ 
dence. 

Hint. For the parity operation in spherical polar coordinates see Exercise 2.5.8 and foot¬ 
note 7 in Section 12.2. 


12.6.2 Prove that 


Ff(0, <p) = 


2L+l \ 
47r / 


1/2 


8m. 


0- 


12.6.3 In the theory of Coulomb excitation of nuclei we encounter Y ) w {n/2, 0). Show that 
'2L + 1 \ 1/2 [(L - M)\(L + M)!] 1 / 2 


,M 




= 0 


47T 
for L 


(L — M)\\(L + M)\\ 
M odd. 


-(-l) (L+M)/ 2 for L + M even. 


Here 


(2n)\\ — 2n(2n — 2) • • • 6 • 4 • 2, 

(2n + l)!! = (2n + l)(2n — 1) - - - 5 - 3 - 1. 
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12.6.4 


12.6.5 


12.6.6 


12.6.7 


(a) Express the elements of the quadrupole moment tensor XjXj as a linear combina¬ 
tion of the spherical harmonics Y™ (and Y ®). 

Note. The tensor XjXj is reducible. The Tg indicates the presence of a scalar com¬ 
ponent. 

(b) The quadrupole moment tensor is usually defined as 

Qij = J (3xjXj — r 2 8jj)p(r)dr, 

with p(r) the charge density. Express the components of (3 XiXj — r 2 Sjj) in terms 
ofr 2 F 2 M . 

(c) What is the significance of the —r 2 Sij term? 

Hint. Compare Sections 2.9 and 4.4. 

The orthogonal azimuthal functions yield a useful representation of the Dirac delta func¬ 
tion. Show that 

j OO 

S(<PI - <)92) = — exp[/m(<pi - cp 2 )\. 

m=—oo 

Derive the spherical harmonic closure relation 

OO+I J 

T T Yj m (0i,n)YF<fo, <P2) = - 02)S(<P1 - <P2) 

sin 0i 

1=0 m=—l 

— <5(cOS/?i — C0S/?2)<5(^>1 — (pi)- 


The quantum mechanical angular momentum operators L x ± i L y are given by 


L x + / L v = e i>p 



i cot 6 — 
3 <p 


Lx iL y — 



i cot/? — 
3 <p 


Show that 


(a) (L x + iL y )Y**(9, cp) = J(L - M)(L + M + l)Tf +1 (/?, cp), 

(b) (L x - iL y )Y^(0, cp) = y/(L + M)(L-M+l)Y*?- 1 (d, cp). 


With L± given by 


L± = L x ± iL y — ±e ±itp 


3 3 

— ± i cot/?— , 
3(9 dcp \ 


show that 


(a) 


vm _ 


' (l + m)\ 
(2l)\(l — m)\ 


(L-) l ~ m Y[, 


12.6.8 
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(b) r/” = 


I (l-m)l 

(21)1(1 +m)! 


(L+) 


l+m y —/ 


12.6.9 


In some circumstances it is desirable to replace the imaginary exponential of our spher¬ 
ical harmonic by sine or cosine. Morse and Feshbach (see the General References at 
book’s end) define 

Y' nn = P™ (cos 0) cos imp, 

Y mn = P™ (cos 6) sin m<p, 


where 



f* [Y'fce.ip)] 2 sind ddd<p 
Jo 


An (n + m)\ 
2(2 n + 1) (n — m)\ ’ 


n = 1,2,... 


= An for n — 0 (Yq 0 is undefined). 


These spherical harmonics are often named according to the patterns of their positive 
and negative regions on the surface of a sphere — zonal harmonics for m — 0, sectoral 
harmonics for m — n, and tesseral harmonics for 0 < m < n. For Yf nn , n = A, m = 
0,2,4, indicate on a diagram of a hemisphere (one diagram for each spherical harmonic) 
the regions in which the spherical harmonic is positive. 


12.6.10 A function f(r, 6, cp) may be expressed as a Laplace series 


f(r,0,<p) = ^2,ai m r l Y™(6, <p). 

l,m 


With () sphere use d to mean the average over a sphere (centered on the origin), show that 

(/(^^sp here = /( 0 - 0 >°)- 


12.7 Orbital Angular Momentum Operators 


Now we return to the specific orbital angular momentum operators L x ,L y , and L z of 
quantum mechanics introduced in Section 4.3. Equation (4.68) becomes 

L z fLM(0, (p) = Mf LM (9 , <p), 

and we want to show that 

^lm(0,<P) = Yl(0,<p) 

are the eigenfunctions | LM) of L 2 and L- of Section 4.3 in spherical polar coordinates, the 
spherical harmonics. The explicit form of L z = — id/d(p from Exercise 2.5.13 indicates that 
ipLM has a (p dependence of exp (iM(p) —with M an integer to keep i/^lm single-valued. 
And if M is an integer, then L is an integer also. 

To determine the 0 dependence of <A), we proceed in two main steps: (1) the 

determination of i //ll(0, <P) and (2) the development of x/r lm(0 , <p) in terms of xfru with 
the phase fixed by xfriQ. Let 

iMcp 


x^lm( 0, (p) = &LM(0)e‘ 


( 12 . 157 ) 
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From L + \I/ll = 0, L being the largest M, using the form of L+ given in Exercises 2.5.14 
and 12.6.7, we have 


" d 

_dd ~ 


e UL+l)(p Lcotd \ &LL(e) = Q 


and thus 


Normalizing, we obtain 


fLL(0, <p) — c L sin L 9e lL<p . 


t*2 tt r*7T 

c* l cl I / sin 2i+1 9d9d<p = 1. 

Jo Jo 

The 6 integral may be evaluated as a beta function (Exercise 8.4.9) and 

( l( 2 L + i)H vary- /2L + 1 
CL l_ V An{2L)\\ ~ 2 l L\ V 4tt 


(12.158) 


(12.159) 


(12.160) 


(12.161) 


This completes our first step. 

To obtain the Jtlm, M y ±L, we return to the ladder operators. From Eqs. (4.83) and 
(4.84) and as shown in Exercise 12.7.2 (J + replaced by L + and /_ replaced by L_), 


JjlmW, <p) =. 


<p ) = . 


I (L + M)l , M 

—---- (L-) L - M -^ LL { 6 ,q>), 

(2 L)\{L-M)\ y - 


I (L-M)l 

—---- (L + ) l+m \I/ l - L (0, cp). 

(2 L)\(L + M)\ + V ' V ^ 


(12.162) 


Again, note that the relative phases are set by the ladder operators. L + and operating 
on ®LM( 0 )e lM<p may be written as 


L+® LM {9)e iMv = e' (M+1) 44 - Mcote}® LM (e) 

_d 0 


= e i(M+l)v sm l+M 6 - 


d(cosd ) 


sin M ®lm(0), 


(12.163) 


L-@ LM (9)e iM,p = -jW-Vv 


—+ Mcot0 ®lm(0) 
d 0 


— e d M ~ l )<p sin l_M ( 


d(cos9 ) 


sin m 9® lm (9). 


Repeating these operations n times yields 


(L + ) n ® LM (9)e iMv - (-iy e dM+n)<p sin ”+« /'' sin M 0® LM {0) , 


(L-) n ® LM (9)e iM ‘ f> = e i(M ~ n)(p sm>'~ M 9 


d(cos9) n 

d n sin M 9® LM (9) 
d(cos9)" 


(12.164) 
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From Eq. (12.163), 


^lm(0,(P) — cl. —-————— e lM(p sin M 0 - - —77sin 2L 0, (12.165) 

v \(2L)\(L-M)\ d(cos9) L ~ M 


and for M = — L : 




= ^ e ~iL<P sin L e ^_ _ 

(2L)! L d(cosO) 2L 
= (-1 ) l c l sin L 6 e~ iLv . 


sin 2i 0 


(12.166) 


Note the characteristic (—1) L phase of xj/L.-L relative to i/ r L.L- This (—1) L enters from 


sin 2i 0 = (1 - x 2 ) L = {-l) L (x 2 - l) L 


(12.167) 


Combining Eqs. (12.163), (12.163), and (12.166), we obtain 


, / ( L-M)\ T , M M d L+M sm 2L 0 

^ LM (0,<p) = (— 1) L c l J — --- (~\) L+M e' M>p sm M 6 -— w . (12.168) 

v y r V (2L)!(L + M)! 2 d(cosO) L+M 


Equations (12.165) and (12.168) agree if 


ifLo(0, (p) = c L — - — sin- L 9. 


f(2L)\ (dcos9) L 


(12.169) 


Using Rodrigues’ formula, Eq. (12.65), we have 


x/slo(0,(p) = (— 1) l cl —^=== Pl (cos 9) 

, c L I2L+1 

= - Pl(cos9). 

|cl|V 4n 


(12.170) 


The last equality follows from Eq. (12.161). We now demand that i///.o(0, 0) be real and 
positive. Therefore 


r , V(2 L)\ 2L+1 

^ = (-D^l = (-D J WflT' 


(12.171) 


With (— \) l cl/\cl\ = 1, x//Lo(9,(p) in Eq. (12.170) may be identified with the spherical 
harmonic Y°(9, <p) of Section 12.6. 



796 Chapter 12 Legendre Functions 


When we substitute the value of (—1 ) l cl into Eq. (12.168), 

sL+M 


f lm(0,<p ) = 


7(21)! /2L + 1 / (L-MV. 


2 l L\ 


4tt \{2L)\(L + M)\ 


(-D i 


ji+M 

■ e iMv sin M 6---— sin 2L 0 

r/( cos<9) i+M 


2L + 1 


4:x 
1 

2 l L! 


(L + M)! 

2 xM/2 d L+M 


(l-, 2 ) 


dx L+M 


(, 2 -l)^ 


X = cos t 


M> 0. 
(12.172) 


The expression in the curly bracket is identified as the associated Legendre function 
(Eq. (12.151), and we have 

^lm( 0,(P) = Ylf(0,<p) 


= (-D 


M 


/2L + 1 ( L-M)\ 
4n ’ (L + M)l 


■ P^(cosO)e iMlp , M> 0, 


(12.173) 

in complete agreement with Section 12.6. Then by Eq. (12.73c), Y^ for negative super¬ 
script is given by 




(12.174) 


• Our angular momentum eigenfunctions xI/lm(0,<P) are identified with the spherical 
harmonics. The phase factor (— \) M is associated with the positive values of M and is 
seen to be a consequence of the ladder operators. 

• Our development of spherical harmonics here may be considered a portion of Lie alge¬ 
bra— related to group theory. Section 4.3. 


Exercises 

12.7.1 Using the known forms of L + and L_ (Exercises 2.5.14 and 12.6.7), show that 

/ [u*']-L-(L + u")^ = f (L+YUnL+rfida. 

12.7.2 Derive the relations 


(a) 

t. lm(0 , <p) = ^ 

/ (L + M)\ 

■{L-) L ~ M * LL {6,<p), 

/ (2L)!(L — M)\ 

(b) 

f lm(0 , <p) = 

1 (L - M)\ 

-(L + ) L+M f L ,- L {e,<p) 

/ (2 L)\(L + M)\ 
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Hint. Equations (4.83) and (4.84) may be helpful. 

12.7.3 Derive the multiple operator equations 

(L + ) n ®LM(0)e iM<p = (-l)V ' (M+n)v sin”-^ ^” 8111 M 6&lm{6) 

d(cosO) n 

(L-) n @ LM (0)e iM<p = e i(M ~ n),p sin”~ M 9 d " smM 

d(cos9)" 

Hint. Try mathematical induction. 


12.7.4 Show, using ( L -) n , that 


Y~ M (9. <p) = (-1 ) M Y* L M (9, cp). 


12.7.5 Verify by explicit calculation that 


(a) L + Y?(9, q>) = -J-^sin9e iv = V2yU 6, <p), 

V 47 r 

(b) L_T.°(6», <p) = +J— sin 9e~ i<p = V2Y~ l (9, q>). 

V 4jt 


The signs (Condon-Shortley phase) are a consequence of the ladder operators L + and 
L-. 


12.8 The Addition Theorem for Spherical Harmonics 
T rigonometric Identity 

In the following discussion, (0\ . <p \) and (tT, <fn_) denote two different directions in our 
spherical coordinate system (pci, y i, zi), separated by an angle y (Fig. 12.16). The polar 
angles 9\, 62 are measured from the zi -axis. These angles satisfy the trigonometric identity 

cos y = cos0i cos02 + sin0i sinfTcosOpi — q> 2 ), (12.175) 

which is perhaps most easily proved by vector methods (compare Chapter 1). 

The addition theorem, then, asserts that 

(12.176) 

or equivalently, 

A H 

A,(cosy) = 2 ^r Y™(9 l ,<p l )[Y™(e 2 ,<P2)]*. 21 (12.177) 

m=—n 

21 The asterisk for complex conjugation may go on either spherical harmonic. 
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In terms of the associated Legendre functions, the addition theorem is 
P n (cos y) = P n (cos 6\) P n (cos O 2 ) 

+ 2 V ”~ Wi1 i p n (cos Ol ) Pn (cos 02 ) cos mifPi-n)- 
z —' (n + my. 

m= 1 

(12.178) 

Equation (12.175) is a special case of Eq. (12.178), n = 1. 


Derivation of Addition Theorem 

We now derive Eq. (12.177). Let (y, ^) be the angles that specify the direction (0j, <p 1 ) in a 
coordinate system (x 2 , y 2 , Z 2 ) whose axis is aligned with ( 62 , <^ 2 )- (Actually, the choice of 
the 0 azimuth angle § in Fig. 12.16 is irrelevant.) First, we expand Y"'(9 1 , ip \) in spherical 
harmonics in the (y, f) angular variables: 

n 

Y”(e u n)= E <^ Y n(r^)- (12.179) 

o=—n 

We write no summation over n in Eq. (12.179) because the angular momentum n of L/" is 
conserved (see Section 4.3); as a spherical harmonic, Y™(6-\ , y \) is an eigenfunction of L 2 
with eigenvalue n (n + 1). 


z \ 



Figure 12.16 Two directions separated by an 
angle y. 
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We need for our proof only the coefficient a'" iy which we get by multiplying Eq. (12.179) 
by [Y®(y, £)]* and integrating over the sphere: 

<0 = f Y?(fc<pi)[Yfl(y,S)]*dn Y 'S. (12.180) 

Similarly, we expand P n ( cos y ) in terms of spherical harmonics Yj"(9 1 , (p\): 

/ 4 \ t /2 n 

P„(cosy)= Y°(y,i;)= b n mY™(.0 (12.181) 


where the b mn will, of course, depend on 62 , <P2, that is, on the orientation of the Z 2 -axis. 
Multiplying by [F™ ( 6 1 , ^ 1 )]* and integrating with respect to 9 1 and (pi over the sphere, we 
have 

bnm = J P„(cosy)Y”*(e u q> l )dag lin . (12.182) 

In terms of spherical harmonics Eq. (12.182) becomes 

/ 4j r \^ 2 C 

(2^+T) J Y n(Y^)[ Y n(bi,n)]*d^ = b nm . (12.183) 

Note that the subscripts have been dropped from the solid angle element d£2. Since the 
range of integration is over all solid angles, the choice of polar axis is irrelevant. Then 
comparing Eqs. (12.180) and (12.183), we see that 


h* — a m 
u nm u n0 


An 

2 n + 1 


1/2 


(12.184) 


Now we evaluate F"' (O 2 , (pi) using the expansion of Eq. (12.179) and noting that the 
values of (y, f) corresponding to (9\, (p\) = ( 62 , (P 2 ) are (0, 0). The result is 

/?I7 4 -1 \ J / 2 

C (92, (P2) = a”:, F®(0,0) = ^( —j , (12.185) 


all terms with nonzero a vanishing. Substituting this back into Eq. (12.184), we obtain 

An 

bn m = ^——[K( 0 2 ,cp 2 )Y- (12.186) 

Finally, substituting this expression for b mn into the summation, Eq. (12.181) yields 
Eq. (12.177), thus proving our addition theorem. 

Those familiar with group theory will find a much more elegant proof of Eq. (12.177) 
by using the rotation group. 22 This is Exercise 4.4.5. 

One application of the addition theorem is in the construction of a Green’s function for 
the three-dimensional Laplace equation in spherical polar coordinates. If the source is on 


“Compare M. E. Rose, Elementary Theory of Angular Momentum, New York: Wiley (1957). 
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the polar axis at the point (r = a, 0 — 0, (p — 0), then, by Eq. (12.4a), 


1 1 

- = --= > P„(cosy)- 

R r — z/7 L —' i 


■n +1 ; 


n= 0 
oo 


= ^P (i (cosy)— T , 


r > a 


r < a. 


(12.187) 


n=0 


Rotating our coordinate system to put the source at (a, 62 , tpi) ttncl the point of observation 
at (r, 6 \, <p \), we obtain 

1 

G(r, 0i,<pi,a,02,<P2) = — 

K 

4n 


= E E 2^[Y?(.ou<pi)]* Y ?(<h,ny 


.n +1 ’ 


r > a, 


n=0m=—n 
00 n 


4n 


= E E 


n=0m=—n 


+ 1 ' 


r < a. (12.188) 


In Section 9.7 this argument is reversed to provide another derivation of the Legendre 
polynomial addition theorem. 


Exercises 

12.8.1 In proving the addition theorem, we assumed that Y^(0\ , <p\) could be expanded in a 
series of Y™(9 2 , (fn), in which m varied from — n to +n but n was held fixed. What 
arguments can you develop to justify summing only over the upper index, m , and not 
over the lower index, n ? 

Hints. One possibility is to examine the homogeneity of the K™, that is, Y"‘ may be 
expressed entirely in terms of the form cos" - ^ 0 sin p 0, or x n ~ p ~ s y p z s /r n . Another 
possibility is to examine the behavior of the Legendre equation under rotation of the 
coordinate system. 

12.8.2 An atomic electron with angular momentum L and magnetic quantum number M has a 
wave function 


*(r, 0,(p) = f(r)Yi?(O,<p). 

Show that the sum of the electron densities in a given complete shell is spherically 
symmetric; that is, Y1m=-l V / *(c 0, <p ) is independent of 0 and cp. 

The potential of an electron at point r e in the field of Z protons at points r p is 



47T£o 


z 


E 



12.8.3 
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12.8.4 


Show that this may be written as 



4tt£o r e 



[YF{8 p ,<p p )YY?{e e ,<p e ), 


where r e > r p . How should | I> be written for r e <r p ! 


Two protons are uniformly distributed within the same spherical volume. If the coor¬ 
dinates of one element of charge are (r i, 0 \, <p\ ) and the coordinates of the other are 
0'2, (> 2 - <Pi) and /'| 2 is the distance between them, the element of energy of repulsion 
will be given by 

7 dr i dx 7 7 rr dr\ sin0j dO\ dw\ r 7 drj sin 02 d &2 dq>i 

dijf = p z -= p —----. 

ri2 n2 


Here 


charge 3e 
volume 4 ttR 3 


charge density, 


r 2 2 — r 2 + r| — 2 r\r 7 cos y. 


Calculate the total electrostatic energy (of repulsion) of the two protons. This calculation 
is used in accounting for the mass difference in “mirror” nuclei, such as O 15 and N 15 . 


ANS. 


6c2 

5 R' 


This is double that required to create a uniformly charged sphere because we have two 
separate cloud charges interacting, not one charge interacting with itself ( with permuta¬ 
tion of pairs not considered). 


12.8.5 


12.8.6 


Each of the two 1 S electrons in helium may be described by a hydrogenic wave function 

Vr(r) = (— 3 ) e ~ Zr ' a o 

in the absence of the other electron. Here Z, the atomic number, is 2. The symbol ao is 
the Bohr radius, h 2 /me 2 . Find the mutual potential energy of the two electrons, given 
by 

r e 2 

/ i/f*(r 1 )i/r*(r2) — x[r(r l )ir(r 2 )d i r l d 3 r2. 

J n 2 


Note. d 3 r\ — r 2 dr\ sin0i d0\ dcp\ = dr i, ri 2 = |ri — r 2 |. 


ANS. 


5e 2 Z 

8«o 


The probability of finding a 1 S hydrogen electron in a volume element r 2 dr sin 0 dO dip 
is 


l 9 

—^ expf—2r/tfo]r dr sin# dO d(p. 

JICIq 



802 


Chapter 1 2 Legendre Functions 


Find the corresponding electrostatic potential. Calculate the potential from 


V(ri) = 


4jT£o 


/ 


P(r 2) , 3 

- d 3 r 2 , 

n 2 


12.8.7 


with ri not on the "-axis. Expand /■ 12 - Apply the Legendre polynomial addition theorem 
and show that the angular dependence of U(ri) drops out. 


ANS. V(n)=-^- 
Ans 0 






A hydrogen electron in a 2 P orbit has a charge distribution 


p — — C ^—=r 2 e r / a ° sin 2 6 , 

6 Ana^ 

where ao is the Bohr radius, h 2 /me 2 . Find the electrostatic potential corresponding to 
this charge distribution. 

12.8.8 The electric current density produced by a 2 P electron in a hydrogen atom is 


J = 


„ qh 
32ma,j 


e r / a °rsm 0 . 


Using 


A( ri ) = 


Mo f 

An J 


J(r 2 ) 
l r i — r 2 | 


d 3 r 2 , 


find the magnetic vector potential produced by this hydrogen electron. 

Hint. Resolve into Cartesian components. Use the addition theorem to eliminate y, the 
angle included between ri and r 2 . 

12.8.9 (a) As a Laplace series and as an example of Eq. (1.190) (now with complex func¬ 

tions), show that 

00 n 

5(^i-n 2 ) = £ E Y "'* ( ° 2 ’ n)Y?(0u<pi)- 

n= 0 m=—n 

(b) Show also that this same Dirac delta function may be written as 


5(S2i - 


^ 2 )=E 

12=0 


2/2 + 1 
An 


P n (cos y). 


Now, if you can justify equating the summations over n term by term, you have an 
alternate derivation of the spherical harmonic addition theorem. 
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12.9 Integrals of Products of Three Spherical 
Harmonics 


Frequently in quantum mechanics we encounter integrals of the general form 

(C | r«\r«) = [" £ [r“‘ ]• i f <*•» df 

(2L 2 + 1)(2L 3 + 1) 

: f — c(l 2 L3L 1 \ooo)C(L2L 3 l 1 \m 2 m 3 m 1 ), 

4jt(2Li + 1) 

(12.189) 

in which all spherical harmonics depend on 9,<p. The first factor in the integrand may come 
from the wave function of a final state and the third factor from an initial state, whereas the 
middle factor may represent an operator that is being evaluated or whose “matrix element” 
is being determined. 

By using group theoretical methods, as in the quantum theory of angular momentum, 
we may give a general expression for the forms listed. The analysis involves the vector- 
addition or Clebsch-Gordan coefficients from Section 4.4, which are tabulated. Three gen¬ 
eral restrictions appear. 

1. The integral vanishes unless the triangle condition of the L’s (angular momentum) is 
zero, \L\ — L 3 \ < L 2 < L\ + L 3 . 

2. The integral vanishes unless M 2 + M 3 = M\. Here we have the theoretical foundation 
of the vector model of atomic spectroscopy. 

3. Finally, the integral vanishes unless the product [Yf ]* Y ^ 2 Yf 3 is even, that is, unless 
L\ + L 2 + L 3 is an even integer. This is a parity conservation law. 



The key to the determination of the integral in Eq. (12.189) is the expansion of the prod¬ 
uct of two spherical harmonics depending on the same angles (in contrast to the addition 
theorem), which are coupled by Clebsch-Gordan coefficients to angular momentum L , M, 
which, from its rotational transformation properties, must be proportional to Y^(9,(p)\ 
that is, 

C(L 2 L 3 Li\M 2 M 3 Mi)Y^( 0, cp)Y^(0, <p) ~ t "' (9, <p). 

M i ,M 2 

For details we refer to Edmonds. 23 

Let us outline some of the steps of this general and powerful approach using Section 4.4. 
The Wigner-Eckart theorem applied to the matrix element in Eq. (12.189) yields 

[ y l'\ y Li\ y l?) = (—Y) L2 ~ Li+Li C {L 2 L 3 L\\M 2 M 3 M\) 


( Y Li II Y Ln II Y Lj ) 

V(2Ti + l) 


(12.190) 


23 E. U. Condon and G. H. Shortley, The Theory of Atomic Spectra, Cambridge, UK: Cambridge University Press (1951); M. 
E. Rose, Elementary Theory of Angular Momentum, New York: Wiley (1957); A. Edmonds, Angular Momentum in Quantum 
Mechanics, Princeton, NJ: Princeton University Press (1957); E. P. Wigner, Group Theory and Its Applications to Quantum 
Mechanics (translated by J. J. Griffin), New York: Academic Press (1959). 
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where the double bars denote the reduced matrix element, which no longer depends on 
the Mj. Selection rules (1) and (2) mentioned earlier follow directly from the Clebsch- 
Gordan coefficient in Eq. (12.190). Next we use Eq. (12.190) for Mi = M 2 = M 3 = 0 in 
conjunction with Eq. (12.153) for m = 0, which yields 




(_l)L2-L3+L t 

C(L 2 L 3 L 1 |ooo)-(y L ,||y L ,i|y L3 ) 

LL 1 + 1 


(2L 1 + 1)(2L 2 + 1)(2L 3 +1) 


4tt 


1 

2 



PL { (x)P Ll {x)P Li (x) dx. 


(12.191) 


where x — cos 9. By elementary methods it can be shown that 



Pl 1 (x ) Pl 2 (x) Pl 3 (x) dx 


= —^—C(L 2 L 3 L i|000) 2 . 
IL\ + 1 


(12.192) 


Substituting Eq. (12.192) into (12.191) we obtain 


j , , T I(2L 2 + 1)(2L 3 + 1) 

(Y Ll II Y L2 1| Y L3 ) = (- i)G-G+G C(L 2 L 3 L l |000)^/ —--. (12.193) 

The aforementioned parity selection rule (3) above follows from Eq. (12.193) in conjunc¬ 
tion with the phase relation 


C(L 2 L 3 L l \- M 2 ,-M 3 , -Mi) = (-l) L 2 +L 3 _il C(L 2 E 3 Li|M 2 M 3 Mi). (12.194) 

Note that the vector-addition coefficients are developed in terms of the Condon-Shortley 
phase convention , 23 in which the (—1)'" of Eq. (12.153) is associated with the positive m. 

It is possible to evaluate many of the commonly encountered integrals of this form with 
the techniques already developed. The integration over azimuth may be carried out by 
inspection: 



e -iM lVe iM 2<Pe iM 3Vd(p _ 2jtSM2+M3 _ Mu0 . 


(12.195) 


Physically this corresponds to the conservation of the z component of angular momentum. 


Application of Recurrence Relations 

A glance at Table 12.3 will show that the 0-dependence of K^ 2 , that is, P^(0), can be 
expressed in terms of cos 6 and sin 6 . However, a factor of cos 0 or sin 0 may be combined 
with the K/'y factor by using the associated Legendre polynomial recurrence relations. For 
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instance, from Eqs. (12.92) and (12.93) we get 

' (L — M + 1)(L + M + 1) 


cos 6 Y^ = ■ 


e i<p sin 0 Y™ = 


(2L+ l)(2L + 3) 

"(L-M)(L + M)"| 1/2 i 
_(2L - 1)(2L+ 1). 

(L + M + 1)(L + M 


1/2 


/M 
l L +1 


•M 

( L-1 


(12.196) 


■ 2 )' 


+ 


(2L+ l)(2L + 3) 
(L — M){L — M — 1) 


1/2 


^M+l 

‘L+l 


1/2 




sin0F, M = + 


(2L-1)(2L+1) 

(L - M+ 1)(L -M + 2) 
(2L+ l)(2L + 3) 

"(L + M)(L + M — 1) 
(2L — l)(2L + 1) 


,M +1 
'L-l 

1/2 


(12.197) 


,M- 1 
‘L+l 


1/2 


7 M-1 
l L- 1 • 


(12.198) 


Using these equations, we obtain 


/ 


Y^ 1 * cos 0 Y^ d £2 = 


+ 


{L-M+l)(L + M+l) 
(2L+l)(2L + 3) 

(L — M)(L + M) "• 1/2 


1/2 




(2L — l)(2L + 1) 


&Mi,M&L\.L— 1 • (12.199) 


The occurrence of the Kronecker delta (Li, L ± 1) is an aspect of the conservation of 
angular momentum. Physically, this integral arises in a consideration of ordinary atomic 
electromagnetic radiation (electric dipole). It leads to the familiar selection rule that transi¬ 
tions to an atomic level with orbital angular momentum quantum number L\ can originate 
only from atomic levels with quantum numbers L i — 1 or L i + 1. The application to ex¬ 
pressions such as 


7 


quadrupole moment 
is more involved but perfectly straightforward. 


Y^*(0,(p)P 2 (cos 0)Y^ (6>, (p) dO. 


Exercises 


12.9.1 Verify 


(a) 

(b) 


/ 

/ 


y l (0, <p)Y$(6, <p)Y?*(d, <p)dtl = 


1 

VUr 


Y L Y l Y L +1 dn = 


[T j(L + M + 1)(L — M + 1) 
V 47T y (2L + l)(2L + 3) 
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(c) 

(d) 


/ 

/ 


V M v l v M+l* 
r L M r L +1 




j 3 j (L + M + 1)(L + ~M + 2) 

V 8tt Y (2L+ l)(2L + 3) 


V M V \ V M+ 1* 
*L 1 1 r L-l 



(L - M)(L - M - 1) 
(2L- 1)(2L + 1) 


These integrals were used in an investigation of the angular correlation of internal con¬ 
version electrons. 

12.9.2 Show that 


(a) 



xPl(x)Pn{x) dx 


2(L + 1) 

(2L+l)(2L + 3)’ 
2 L 

(2 L- 1)(2L + 1) ’ 


(V = L + 1, 
N — L — l, 


(b) 



x 2 Pl(x)Pn(x) dx = 


2(L + l)(L + 2) 
(2L+l)(2L + 3)(2L + 5)’ 
2(2L 2 + 2L — 1) 

(2L — 1)(2L + 1)(2L + 3) ’ 
2 L(L- 1) 

(2L — 3)(2L — 1)(2L + 1) ’ 


N — L + 2, 
N = L, 


N — L — 2. 


12.9.3 Since xP n (x) is a polynomial (degree n + 1), it may be represented by the Legendre 
series 

OO 

xP n (x) = y^a s P s (x). 

s=0 


(a) Show that a s — 0 for s < n — 1 and s > n + 1. 

(b) Calculate a„_i, a n , and ci n +\ and show that you have reproduced the recurrence 
relation, Eq. 12.17. 

Note. This argument may be put in a general form to demonstrate the existence of a 
three-term recurrence relation for any of our complete sets of orthogonal polynomials: 

X(p/i — a n+ 1 1 + a„ <p n + Cl fl — ] (fn — |. 

12.9.4 Show that Eq. (12.199) is a special case of Eq. (12.190) and derive the reduced matrix 
element {Y Ll ||Ti||T l ). 

r , , j V3(2L + 1) 

ANS. {Y Ll \\Yi\\Y L ) = (—1 ) Li+1 ~ l C(ILL\ 1000) —— --. 

47T 

12.10 Legendre Functions of the Second Kind 

In all the analysis so far in this chapter we have been dealing with one solution of Legen¬ 
dre’s equation, the solution P n (cos 9), which is regular (finite) at the two singular points of 
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the differential equation, cos 9 = ± 1. From the general theory of differential equations it 
is known that a second solution exists. We develop this second solution, Q n , with nonneg¬ 
ative integer n (because Q„ in applications will occur in conjunction with P n ), by a series 
solution of Legendre’s equation. Later a closed form will be obtained. 


Series Solutions of Legendre’s Equation 


To solve 


d T id y 

— +n{n + \)y = 0 

dx |_ dx _ 

(12.200) 

we proceed as in Chapter 9, letting 24 


OO 

y = ^2axx k+x , 
x=o 

(12.201) 

with 


OO 

y' — ^(HA)diJ W_1 , 
x=o 

(12.202) 

OO 

y" = J2& + A)(* + A - 1 )aix k+x ~ 2 . 
x=o 

(12.203) 


Substitution into the original differential equation gives 

OO 

J2( k + A.)(fc + A - 1 )a x x k+x ~ 2 
x=o 

oo 

+ ^[n(n + 1) - 2(k + A) - (k + X){k + A. — 1 )]axx k+x = 0. (12.204) 

X=Q 

The indicial equation is 


k(k- 1) = 0, 


(12.205) 


with solutions k = 0,1. We try first k — 0 with ciq = 1, a\ =0. Then our series is described 
by the recurrence relation 

(A. + 2) (A + l)a A+2 + [n(n + 1) - 2A - A (A - 1 )]a x = 0, (12.206) 


which becomes 


a \+2 = 


(n + A + l)(n — A) 


ax. 


“ 1 Note that x may be replaced by the complex variable z. 


(A + 1)(A + 2) 


(12.207) 
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Labeling this series, from Eq. (12.201), v( jc) = p„(x). we have 


Pn(x) = 1 - 


n(n - 


2 ! 


1) 2 (n 

—x- H- 


■ 2 )n(n + 1 )(n 


4! 


■3) 4 . 

—x + • 


(12.208) 


The second solution of the indicial equation, k — 1, with uq — 0, a\ = 1, leads to the 
recurrence relation 


flA+2 = 


(n + X + 2 )(n — X — 1) 
(A. + 2)(A, + 3) 


ax. 


(12.209) 


Labeling this series, from Eq. (12.201), y(x) = q n (x). we obtain 

(n-])(n + 2) 3 («-3)(B-l)(« + 2)(fi+4) 5 

q n (x)=x -—-x H-—-x-. 

Our general solution of Eq. (12.200), then, is 


( 12 . 210 ) 


>'« (x) = A n p n (x) + B n q n {x), 


( 12 . 211 ) 


provided we have convergence. From Gauss’ test. Section 5.2 (see Example 5.2.4), we do 
not have convergence at x = ± 1. To get out of this difficulty, we set the separation constant 
n equal to an integer (Exercise 9.5.5) and convert the infinite series into a polynomial. 

For n a positive even integer (or zero), series p„ terminates, and with a proper choice 
of a normalizing factor (selected to obtain agreement with the definition of P n {x) in Sec¬ 
tion 12.1) 


Pn(x) = (- 1)" /2 


n\ 

2 "[( n / 2)!] 2 


Pn ( X ) = (-iy 


(2s)\ 


(2.y — 11" 

= (~ i r J" P 2 s(x), for n — 2s. (12.212) 

(2i)!! 

If n is a positive odd integer, series q„ terminates after a finite number of terms, and we 
write 


P n {x) = (- 1)”“ 1)/2 


2" _1 {[n — l)/2]!} 


;q„{x) 


(2s + 1)! (2v + l)!! . 0 , , 

= ( ~ } 2 2 Hv!) 2 g2j+l(X) = ( ~ } (2v)!! q2s+l(x) ’ for « = ^ + L 

(12.213) 


Note that these expressions hold for all real values of x, —oo < x < oo, and for complex 
values in the finite complex plane. The constants that multiply p„ and q„ are chosen to 
make P n agree with Legendre polynomials given by the generating function. 

Equations (12.208) and (12.210) may still be used with n = v, not an integer, but now 
the series no longer terminates, and the range of convergence becomes — 1 < x < 1. The 
endpoints, x = ±1, are not included. 

It is sometimes convenient to reverse the order of the terms in the series. This may be 
done by putting 



n — 1 


— X 


in the first form of P n (x). 


n even. 


s — 


2 


in the second form of P n (x) 


n odd, 
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so that Eqs. (12.212) and (12.213) become 


[«/ 2 ] 

Pn(x)=j2(- iy 

.5=0 


(2n - 2.S')! 


m—2 s 


2 "s!(n — s)!(n — 2s)! 


(12.214) 


where the upper limit s = n/2 (for n even) or (n — l)/2 (for ;? odd). This reproduces 
Eq. (12.8) of Section 12.1, which is obtained directly from the generating function. This 
agreement with Eq. (12.8) is the reason for the particular choice of normalization in 
Eqs. (12.212) and (12.213). 


Q n (x ) Functions of the Second Kind 

It will be noticed that we have used only p n for n even and q n for n odd (because they ter¬ 
minated for this choice of n). We may now define a second solution of Legendre’s equation 
(Fig. 12.17) by 


[«/2]! 2 2" 

Qn(x) = (- 1)"/ 2 ^-- q n (x) 


= (-l Y 


n\ 

am 

(2s- 1)!! 


qis(x), 


for n even, n — 2s, 


(12.215) 



Figure 12.17 Second Legendre function, Q n (x ), 
0 < x < 1. 
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Figure 12.18 Second 
Legendre function, Q n (x), 
x > 1. 


Qn (X) 


n\ 

i ( 25 )!! 

(-l) s+ (2.V + l')!! P2 ' v+l(X ' ) ’ for n odd, n = 2s + 1. (12.216) 


This choice of normalizing factors forces Q„ to satisfy the same recurrence relations as 
P n . This may be verified by substituting Eqs. (12.215) and (12.216) into Eqs. (12.17) and 
(12.26). Inspection of the (series) recurrence relations (Eqs. (12.207) and (12.209)), that is, 
by the Cauchy ratio test, shows that Q„(x) will converge for — 1 < x < 1. If \x\ > 1, these 
series forms of our second solution diverge. A solution in a series of negative powers of 
x can be developed for the region |x| > 1 (Fig. 12.18), but we proceed to a closed-form 
solution that can be used over the entire complex plane (apart from the singular points 
x — il and with care on cut lines). 


Closed-Form Solutions 


Frequently, a closed form of the second solution, Q n (z), is desirable. This may be obtained 
by the method discussed in Section 9.6. We write 


Qn(z ) = P n (z) 


A« + B, 


*r 


dx 


(1 -X^)[P n {x)Y 


(12.217) 


in which the constant A n replaces the evaluation of the integral at the arbitrary lower limit. 
Both constants, A n and B n , may be determined for special cases. 
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For n = 0, Eq. (12.217) yields 


Go(z) = Po(z) 


Aq + Bo 


f 


dx 


( 1 - 

,5 


■ x 2 )[Pq(x )] 2 

,2s+l 


= Ao - 


D 1 , 1 + Z 

5 0 -ln-- 

2 1 - z 


= A„ + fll) | z + i- + L + ... + i_ 


(12.218) 


the last expression following from a Maclaurin expansion of the logarithm. Comparing this 
with the series solution (Eq. (12.210)), we obtain 


z 3 z 5 


,2s+1 


Q o(z) — qo(z) — z + — + — H-F -—— 

3 5 25+1 


+ • 


we have Ao — 0, Bo — 1. Similar results follow for n — 1. We obtain 

rz dx 


Qi(z) = z 


A i + Z?i 


T — 

Id- 


.r 2 )x 2 J 


,1 1+z 1 

= ^iz + #iz -In-- 

,2 1 - z z 


(12.219) 


( 12 . 220 ) 


Expanding in a power series and comparing with Qi(z) — —pi(z), we have A\ — 0, 11 \ = 
1. Therefore we may write 

1 1+z 1 1+z 

<2o(z) = - In --, Gt(z) = -zln--1, |z| < 1. (12.221) 

21—z 2 1—z 

Perhaps the best way of determining the higher-order Q„ (z) is to use the recurrence 
relation (Eq. (12.17)), which may be verified for both x 2 < 1 and x 2 > 1 by substituting in 
the series forms. This recurrence relation technique yields 

G 2 (z) = ^(z)ln^ - l Pi (z). (12.222) 

2 1 — z 2 

Repeated application of the recurrence formula leads to 

1 1 + z 2n — 1 2n — 5 

Qn(z)=~Pn(z) In---- P n -l(z) ~ — -7“ Pn—3 (z) ' '' ■ (12.223) 

2 1 — Z 1 ■ n 3(n — 1) 

From the form ln[(l + z)/(l — z)] it will be seen that for real z these expressions hold in 
the range — 1 < x < 1. If we wish to have closed forms valid outside this range, we need 
only replace 


In 


1 + x 
1 — x 


by 


In 


z + 1 
z — 1 


When using the latter form, valid for large z, we take the line interval -1 < ,v < 1 as a cut 
line. Values of Q„(x) on the cut line are customarily assigned by the relation 

Qn (X) — \[Qn (X + i0 ) + Q n (x - iO)] , 


(12.224) 
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the arithmetic average of approaches from the positive imaginary side and from the nega¬ 
tive imaginary side. Note that for z —> x > 1, z — 1 —*■ (1— x)e ±,7T . The result is that for 
all z, except on the real axis, — 1 < x < 1, we have 

<2o(z)= (12.225) 

2 z — 1 

2i(z) = xzln ——y — 1. (12.226) 

2 z-\ 

and so on. 

For convenient reference some special values of Q n (z) are given. 

Q n ( 1) = oo, from the logarithmic term (Eq. (12.223)). 

Q n (oo) = 0. This is best obtained from a representation of Q n (x) as a series of nega¬ 
tive powers of x, Exercise 12.10.4. 

Q n (—Z ) = (—1)" +1 Qn(z). This follows from the series form. It may also be derived 
by using Qo(z), Qi(z) and the recurrence relation (Eq. (12.17)). 

Q n (0) = 0, for n even, by (3). 

Q n ( 0) = (-1 )(»+D/ 2 ^ (n ~ 2 ”~ 1 

n\ 

, (251!! 

= (— l) s+1 -, for n odd, n = 2s+l. 

(25 + 1)!! 

This last result comes from the series form (Eq. (12.216)) with p„{ 0) = 1. 


1. 

2 . 

3. 

4. 

5. 


Exercises 


12.10.1 Derive the parity relation for Q n (x). 

12.10.2 From Eqs. (12.212) and (12.213) show that 


(a) 


P2n CO = 


IT ( 2 »+^~ l ) ! y2s 
2 2 "— 1 ( 2 s)!(n + 5 — 1 )!(« — 5 )! 

j=0 


(b) 


P 2 n+l(x) 


= (2/1 + 25 + 1)! 2 , +1 

2 2 n (25 + l)!(n + s)!(n — 5 )! 

j=0 


Check the normalization by showing that one term of each series agrees with the corre¬ 
sponding term of Eq. (12.8). 

12.10.3 Show that 


(a) 


e2„(A-) = (-l)"2 2 "^(-l)* 

s=0 


(n + 5 )! (n - 5 )! 2l+1 

(25+ 1)!(2« -25)!* 


2 „ ^ (n + 5)!(25-2n)! 2 , +1 
2 -^ { 2 s + 1 )!(5 — «)! 


W < I- 
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(b) 


02„+iU) = (-1)" +1 2 2 " JVl)' 5 

s=0 


(n+s)\(n-s)\ 2s 
(2s)\(2n -2s + I)! - ' 


22n+1 (n + S )l(2s-2n-2)\ 2 , 

(2s)!(s-n-l)! 


\x\ < 1 . 


12.10.4 


(a) Starting with the assumed form 


CXD 

Qn (x) = 'Y2,b-xx k ~ x , 
1=0 

show that 


Qn(x) = b{)X " 1 


OO 


E 


(n+s)l(n + 2s)l(2n + 1)! _ 2 , 
s\(n\) 2 (2n+2s + l)\ X 


(b) The standard choice of bo is 


bo 


2"(n\) 2 
(2n + 1)! 


Show that this choice of b a brings this negative power-series form of Q n (x) into 
agreement with the closed-form solutions. 


12.10.5 Verify that the Legendre functions of the second kind, Q„(x), satisfy the same recur¬ 
rence relations as P n (x ), both for |x| < 1 and for |x| > 1: 


(2 n + l)xQn(x) — (n + l)Q n +i(x) + n<2«-i(x), 


(2n + i)gn(x) = e; I+1 (x)-e;_ 1 (x). 


12.10.6 (a) Using the recurrence relations, prove (independent of the Wronskian relation) that 

n[P n (x)Qn- l(x) - Pfi—i (x) Qn (x)] = P\{x)Qo{x) - Po(x)Qi(x). 


(b) By direct substitution show that the right-hand side of this equation equals 1. 


12.10.7 (a) Write a subroutine that will generate Q n (x) and Q o through Q n -\ based on the 

recurrence relation for these Legendre functions of the second kind. Take x to be 
within (—1,1) — excluding the endpoints. 

Hint. Take Qo(x) and Q \ (x) to be known. 

(b) Test your subroutine for accuracy by computing <2io(x) and comparing with the 
values tabulated in AMS-55 (for a complete reference, see Additional Readings in 
Chapter 8). 


12.11 Vector Spherical Harmonics 


Most of our attention in this chapter has been directed toward solving the equations of 
scalar fields, such as the electrostatic potential. This was done primarily because the scalar 
fields are easier to handle than vector fields. However, with scalar field problems under 
firm control, more and more attention is being paid to vector field problems. 
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Maxwell’s equations for the vacuum, where the external current and charge densities 
vanish, lead to the wave (or vector Helmholtz) equation for the vector potential A. In a par¬ 
tial wave expansion of A in spherical polar coordinates we want to use angular eigenfunc¬ 
tions that are vectors. To this end we write the coordinate unit vectors x, y, z in spherical 
notation (see Section 4.4), 


e+i 


x+iy 

V2 ’ 


e 0 = z, 


e_i = 


x-iy 

V2 


(12.227) 


so that e,„ form a spherical tensor of rank 1. If we couple the spherical harmonics with the 
e m to total angular momentum J using the relevant Clebsch-Gordan coefficients, we are 
led to the vector spherical harmonics: 


YjLMj(e,<p)= ^C(L17|MmMj)Tf (6,<p)e m . (12.228) 

It is obvious that they obey the orthogonality relations 

J Y* JLMj {0,<p)-Yj, L , M ' j {0,(p)dQ. = 8jj>8 LL '8 MjM > M . (12.229) 

Given /, the selection rules of angular momentum coupling tell us that L can only take on 
the values J + 1, J, and / — 1. If we look up the Clebsch-Gordan coefficients and invert 
Eq. (12.228) we get 


f YM(0,cp) = - 


L + 1 
2L+ 1 


1/2 

Yll+im + 


L 

2L + 1 


1/2 

Yll-im, 


(12.230) 


displaying the vector character of the Y and the orbital angular momentum contents, L + 1 
and L — 1, of r . 

Under the parity operations (coordinate inversion) the vector spherical harmonics trans¬ 
form as 


Yll+imW', <p') = (-l) i+1 Y ll+imW, <p), 

\ LL - lM (d', <p’) = (-l) i+1 Y Li _ 1M (0, <p), (12.231) 

Y LL M(e',<p') = (-i) L Y L LM(e,<p), 

where 

9' = 7T-d <p' = n + (p. (12.232) 

The vector spherical harmonics are useful in a further development of the gradient 
(Eq. (2.46)), divergence (Eq. (2.47)) and curl (Eq. (2.49)) operators in spherical polar co- 
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ordinates: 


V[F(r)7f (0, ,!>)] = - 


' L + 1 ' 

1/2 

" d L~ 

2L+ 1_ 


_dr r _ 


L 

1/2 

r d L + 11 
1 

2 L + l_ 


dr r 


FYn+iM 

FYll-im, 


V • [F{r)Y LL +\ M {0, </>)] = — | 

V • [F(r)Y LL - im(0, <P)\ = 

V • \F(r)Y LLM (0, (pj\ = 0, 

V x \F(j)Y ll+ \m\ = i 


f L+ 1 N 

\' n 

r dF L + 2 1 

1 F 

\2L + 1, 

) 

dr r 


( L ' 

r 2 

r dF L- 11 

F 

\2L + 1, 

1 

i 

dr r 


2L+\ 


1/2 r 


dF L + 2 

— + - F 

dr r 




Y?(.e,<p), 


Y llm, 


(12.233) 

(12.234) 

(12.235) 

(12.236) 

(12.237) 


V x [F(r)Y LLM ] = i 


2L + \ 
+ i{ 


V 1/2 

\ dF 

) 

1 

^ 1 

1 

^ 1 

i_ 


/ L + l ' 

r 2 

r dF L + l 1 

1 F 

\2L + 1, 

) 

dr r 


V x [F(r)Y LL -i M ] = i 


' L + 1 ' 

1/2 

R - 

h' 

1 

q 

_i 

2L+ 1_ 


L dr r ^ J 


1 LL+IM 

Yll-im - 

Yllm- 


(12.238) 

(12.239) 


If we substitute Eq. (12.230) into the radial component rd/dr of the gradient operator, 
for example, we obtain both dF/dr terms in Eq. (12.233). For a complete derivation of 
Eqs. (12.233) to (12.239) we refer to the literature. 25 These relations play an important 
role in the partial wave expansion of classical and quantum electrodynamics. 

The definitions of the vector spherical harmonics given here are dictated by convenience, 
primarily in quantum mechanical calculations, in which the angular momentum is a sig¬ 
nificant parameter. Further examples of the usefulness and power of the vector spherical 
harmonics will be found in Blatt and Weisskopf, 25 in Morse and Feshbach (see General 
References book’s end), and in Jackson’s Classical Electrodynamics , 3rd ed.. New York: J. 
Wiley & Sons (1998), which use vector spherical harmonics in a description of multipole 
radiation and related electromagnetic problems. 


• Vector spherical harmonics are developed from coupling L units of orbital angular 
momentum and 1 unit of spin angular momentum. An extension, coupling L units 
of orbital angular momentum and 2 units of spin angular momentum to form tensor 
spherical harmonics, is presented by Mathews. 26 

25 E. H. Hill, Theory of vector spherical harmonics, Am. J. Phys. 22: 211 (1954); also J. M. Blatt and V. Weisskopf, Theoret- 
ical Nuclear Physics, New York: Wiley (1952). Note that Hill assigns phases in accordance with the Condon-Shortley phase 
convention (Section 4.4). In Hill’s notation X LM = Y LLM , \ LM = Y LL+1M , W LM = Y LL _ 1M . 

26 J. Mathews, Gravitational multipole radiation, in In Memoriam (H.P. Robertson, ed.), Philadelphia: Society for Industrial and 
Applied Mathematics (1963). 
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• The major application of tensor spherical harmonics is in the investigation of gravita¬ 
tional radiation. 


Exercises 


12.11.1 Construct the / = 0, m = 0 and l = 1, m = 0 vector spherical harmonics. 

ANS. Y 0 io = —r(47r) -1 / 2 
Yooo = 0 

Y 120 = — r(27r) -1 / 2 cos 0 — 0(8jt)~ 1 / 2 sin# 

Yno = (3/8 tt) 1//2 sin 0 

Yioo = r(4jr) _1 / 2 cos0 — 6{4tt)~ 1 ^ 2 sin0. 

12.11.2 Verify that the parity of Yll+im is (— l) i+1 , that of Y llm is (— 1) L , and that of 
Y//_ i v 7 is (—l) i+1 . What happened to the M-dependence of the parity? 

Hint, r and <p have odd parity; 0 has even parity (compare Exercise 2.5.8). 

12.11.3 Verify the orthonormality of the vector spherical harmonics Y jlMj ■ 

12.11.4 In Jackson’s Classical Electrodynamics, 3rd ed., (see Additional Readings of Chapter 11 
for the reference) defines Y llm by the equation 

Y LLM ie,^ 7 =^= LY ^e, v) , 

in which the angular momentum operator L is given by 

L = -i(rx V). 


Show that this definition agrees with Eq. (12.228). 

12 . 11.5 Show that 

A * 2L +1 

M=-L 

Hint. One way is to use Exercise 12.11.4 with L expanded in Cartesian coordinates 
using the raising and lowering operators of Section 4.3. 


12 . 11.6 Show that 


J Y llm ■ (f x Y llm) dQ, — 0 . 


The integrand represents an interference term in electromagnetic radiation that con¬ 
tributes to angular distributions but not to total intensity. 


Additional Readings 


Hobson, E. W., The Theory of Spherical and Ellipsoidal Harmonics. New York: Chelsea (1955). This is a very 
complete reference and the classic text on Legendre polynomials and all related functions. 

Smythe, W. R., Static and Dynamic Electricity , 3rd ed. New York: McGraw-Hill (1989). 

See also the references listed in Sections 4.4 and 12.9 and at the end of Chapter 13. 



Chapter 13 

More Special Functions 


In this chapter we shall study four sets of orthogonal polynomials, Hermite, Laguerre, and 
Chebyshev 1 of first and second kinds. Although these four sets are of less importance in 
mathematical physics than are the Bessel and Legendre functions of Chapters 11 and 12, 
they are used and therefore deserve attention. For example, Hermite polynomials occur in 
solutions of the simple harmonic oscillator of quantum mechanics and Laguerre polynomi¬ 
als in wave functions of the hydrogen atom. Because the general mathematical techniques 
duplicate those of the preceding two chapters, the development of these functions is only 
outlined. Detailed proofs, along the lines of Chapters 11 and 12, are left to the reader. We 
express these polynomials and other functions in terms of hypergeometric and confluent 
hypergeometric functions. To conclude the chapter, we give an introduction to Mathieu 
functions, which arise as solutions of ODEs and PDEs with elliptical boundary conditions. 

13.1 Hermite Functions 

Generating Functions — Hermite Polynomials 

The Hermite polynomials (Fig. 13.1), H n (x), may be defined by the generating function 2 


g(x,t) = e- t2+2,x = J2 H nix)-. 

z —' nl 

n= 0 


(13.1) 


*This is the spelling choice of AMS-55 (for the complete reference see footnote 4 in Chapter 5). However, a variety of names, 
such as Tschebyscheff, is encountered. 

2 A derivation of this Hermite-generating function is outlined in Exercise 13.1.1. 
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Figure 13.1 Hermite 
polynomials. 


Recurrence Relations 


Note the absence of a superscript, which distinguishes Hermite polynomials from the unre¬ 
lated Hankel functions. From the generating function we find that the Hermite polynomials 
satisfy the recurrence relations 

H n+ i(.r) = 2xH n (x) — 2nH n -i(x) (13.2) 

and 


H' n (x) = 2nH n -\{x). (13.3) 

Equation (13.2) is obtained by differentiating the generating function with respect to t: 


3 8 


U JL = (-2 1 + 2x)e- ,1+ltx = Y H n+ x (x)~ 

r)t ' n ' 


dt 


n =0 


r 

n\ 


00 t 11 ^ 1 °° 


= -2 Yh„(x)—— +2xYh„(x)—, 

L —' n\ A —' n\ 

n= 0 n= 0 

which can be rewritten as 

00 ' jti 

— [//„+!(x) - 2xH n (x) + 2nH„-i(x)] = 0. 


«=0 


Because each coefficient of this power series vanishes, Eq. (13.2) is established. Similarly, 
differentiation with respect to x leads to 


^=2te-' 2+2t * = Y,K(.x) 


n= 0 


oo 

2 ^2 H n(x) 

n =0 


t n +1 

ft! 


which yields Eq. (13.3) upon shifting the summation index n in the last sum n + 1 —> n. 



13.1 Hermite Functions 


819 


Table 13.1 Hermite Polynomials 


H 0 (x) = l 

Hi (x) = 2x 

H 3 (x) = 4x 2 — 2 

H 3 (x) = 8* 3 - I2x 

H 4 (x) = 16x 4 - 48x 2 + 12 

H 5 (x) = 32x 5 - 160.t 3 + 1 20x 

H 6 (x) = 64x 6 - 480.r 4 + 720x 2 - 120 


The Maclaurin expansion of the generating function 


= i + {2tx _ t2) + 


(13.4) 


n =0 


gives Hq(x) — 1 and //1 (x ) = 2x , and then the recursion Eq. (13.2) permits the construc¬ 
tion of any H n (x) desired (integral n). For convenient reference the first several Hermite 
polynomials are listed in Table 13.1. 

Special values of the Hermite polynomials follow from the generating function for 
x = 0: 


(— t~) n °° 


_H = E 1Z T L = E"- (0) i 7’ 


n =0 


n =0 


that is. 


H 2n ( 0) = (-l) 


„ ( 2 »)! 


H 2n+ \ ( 0 ) = 0 , 


n — 0, 1, 


(13.5) 


We also obtain from the generating function the important parity relation 

H n (x) = (-1)" H n (-x) 


(13.6) 


by noting that Eq. (13.1) yields 


°° /_ ^\n °° j.n 

g(~x, -t) = 'Y' H n {-x) - — =g(x,t) = Y H„(x) — . 

L —^ n\ L —' n\ 

n =0 n =0 


Alternate Representations 


The Rodrigues representation of H n (x.) is 


H n (x) = {-\ye * 2 


(13.7) 


Let us show this using mathematical induction as follows. 
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We rewrite the generating function as g(x, t) = e* 2 e yt x>2 and note that 

2 __J> - b -*) 2 

dx 

— 2x — H[(x) = —e x ~ — e ~ x ~, 

3 dx 

which is the initial n — 1 case. Assuming the case n of Eq. (13.7) as valid, we now use the 
operator identity j^e x ~ — 2xe x “ + e x in 


-e 


-(t-x) 


This yields 


dg 

at 


dt 


= (2x - 2 t)g 


7«+l 


(~l) n+l e x -—<?-** 

dx n+1 


= (-D 


rt+1 


d r 2 ~ r 2 

— e —2xe 
dx 


d n 

dx" 


d 

dx 


H n (x) + 2 xH„ (x) = H n+ \(x) 


to establish the n + 1 case, with the last equality following from Eqs.(13.2) and (13.3). 

More directly, differentiation of the generating function n times with respect to t and 
then setting t equal to zero yields 


H n {x) = —(e- ,2+2,x ) 
dt" y ’ 


- - 
n„x 2 0 „-(t-x) 2 


= (~\) n e x - e 

t =0 dx" 


9 d' 1 9 

= (-l )"e x ~ -. 

/=o dx" 


A second representation may be obtained by using the calculus of residues (Section 7.1). 
If we multiply Eq. (13.1) by t~ m ~ l and integrate around the origin in the complex f-plane, 
only the term with H m (x) will survive: 

H m (x) = — (f t~ m ~ l e~' 2+2,x dt. (13.8) 

2k i J 

Also, from the Maclaurin expansion, Eq. (13.4), we can derive our Hermite polynomial 
H„ (x) in series form: Using the binomial expansion of (2x — t) v and the index N — s + v. 


OO.. V 


= £>-<>-=£^£ 


y=0 


v\ 

y=0 5=0 


(2 x) v - s (-t) s 


oo N [At/2] 

= £vt£ < 2 A , " 1 '<- 1 >‘ 


N\ 

N=0 J=0 


N\ ( N-S 
s 


(N-s)\ 


where [1V/2] is the largest integer less than or equal to N/ 2. Writing the binomial coeffi¬ 
cient in terms of factorials and using Eq. (13.1) we obtain 


[At/2] 


Hn(x)= (2x) N ~ 2s (-iy 


N\ 


s =0 


i!(A-2i)! 
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More explicitly, replacing N -> n, we have 

H n (x) = (2x) n -—- (2x) n ~ 2 + ——- (2x) n ~ 4 l • 3 • • • 

(n — 2)!2! V (« — 4)!4! 

D/2] 

= J](-2) i (2^)' , - 2s 

j=0 


(”)l35-(2,-1) 


In/ 2] 

= J](-l) i (2^)' , - 2s 

s=o 


n\ 

(n — 2^>)! j! 


This series terminates for integral n and yields our Hermite polynomial. 


(13.9) 


Orthogonality 


If we substitute the recursion Eq. (13.3) into Eq. (13.2) we can eliminate the index n — 1, 
obtaining 

H n +\(x) = 2xH n (x) - H' n (x), 


which was used already in Example 13.1.1. If we differentiate this recursion relation and 
substitute Eq. (13.3) for the index n + 1 we find 


H' n + 1 (•*) = 2(« + 1) H n(x) = 2H n (x) + 2xH' n (x) - H”/x), 

which can be rearranged to the second-order ODE for Hermite polynomials. Thus, the 
recurrence relations (Eqs. (13.2) and (13.3)) lead to the second-order ODE 


H”/x) — 2 xH' n (x) + 2nH n (x) = 0, 


(13.10) 


which is clearly not self-adjoint. 

To put the ODE in self-adjoint form, following Section 10.1, we multiply by exp(— x 2 ). 
Exercise 10.1.2. This leads to the orthogonality integral 



H m (x)H n (x)e x dx — Q, 


m ^ n , 


(13.11) 


with the weighting function exp(— x 2 ), a consequence of putting the ODE into self-adjoint 
form. The interval (—oo, oo) is chosen to obtain the Hermitian operator boundary condi¬ 
tions, Section 10.1. It is sometimes convenient to absorb the weighting function into the 
Hermite polynomials. We may define 

<p n (x) = e- x2 ' 2 H n (x), (13.12) 


with <p n (x) no longer a polynomial. 

Substitution into Eq. (13.10) yields the differential equation for (p„ (x ), 

<p" n {x) + (2 n + 1 - x 2 )<p n (x) = 0. (13.13) 

This is the differential equation for a quantum mechanical, simple harmonic oscillator, 
which is perhaps the most important physics application of the Hermite polynomials. 
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Equation (13.13) is self-adjoint, and the solutions <p n (x ) are orthogonal for the interval 
(—oo < x < oo) with a unit weighting function. 

The problem of normalizing these functions remains. Proceeding as in Section 12.3, we 

_ 2 

multiply Eq. (13.1) by itself and then by e~ x . This yields 


e -x 2 e -s 2 +2sx e -t 2 +2tx 


OO 

Y, e~ x ~H m (x)H n (x) 

m,n =0 


S m t n 

m\n\ 


When we integrate this relation over x from —oo to +oo, the cross terms of the double 
sum drop out because of the orthogonality property: 3 


-i 


e -x 2 -s 2 +2sx-t 2 +2tx j x 


—OO 

oo 


e -C x-s-,) 2 e 2s, dx 


^ n\ 

n =0 


(13.14) 


using Eqs. (8.6) and (8.8). By equating coefficients of like powers of st, we obtain 


r°° 2 ? 

/ e~ x ~[H n {x)] dx = 2" 

J —OO 


= 2"7r 1/2 n!. 


(13.15) 


Quantum Mechanical Simple Harmonic Oscillator 


The following development of Hermite polynomials via simple harmonic oscillator wave 
functions cp n (x) is analogous to the use of the raising and lowering operators for angu¬ 
lar momentum operators presented in Section 4.3. This means that we derive the eigen¬ 
values n + 1/2 and eigenfunctions (the II„ (x)) without assuming the development that 
led to Eq. (13.13). The key aspect of the eigenvalue Eq. (13.13), (jUr — x 2 )q> n {x) — 
— (2n + l)(p„(x), is that the Hamiltonian 




(13.16) 


almost factorizes. Using naively a 2 — b 2 — (a — b)(a + b), the basic commutator \p x , x] = 
h/i of quantum mechanics (with momentum p x = (h/i)d/dx) enters as a correction in 
Eq. (13.16). (Because p x is Hermitian, d/dx is anti-Hermitian, ( d/dxy — —d/dx.) This 
commutator can be evaluated as follows. Imagine the differential operator d/dx acts on a 
wave function cp{x) to the right, as in Eq. (13.13), so 

-^-(x(p)=x-^-(p + (p, (13.17) 

dx dx 


'The cross terms (m / n) may be left in, if desired. Then, when the coefficients of s a t& are equated, the orthogonality will be 
apparent. 
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by the product rule. Dropping the wave function <p from Eq. (13.17), we rewrite Eq. (13.17) 


d d d 

— x—x —= —,x — 1, 
dx dx dx 


(13.18) 


a constant, and then verify Eq. (13.16) directly by expanding the product of operators. 
The product form of Eq. (13.16), up to the constant commutator, suggests introducing the 
non-Hermitian operators 


y/2 V dx 


■s/2 V dx J' 


(13.19) 


with (dy = d ', which are adjoints of each other. They obey the commutation relations 

[<7,an= —,x — 1, [a, a] — 0 = [a + , o + ], (13.20) 

\_dx J 

which are characteristic of these operators and straightforward to derive from Eq. (13.18) 
and 


d d 
dx' dx 


d d 

= 0=[.x,x] and x ,— =— —,. 

dx J [ dx 


Returning to Eq. (13.16) and using Eq. (13.19) we rewrite the Hamiltonian as 

TL = d^d + — = d^d + — (a ^d + ad *) = -(a 1 ^ + flfl 1 ) (13.21) 

and introduce the Hermitian number operator N — a d so that Id — N + 1/2. Let | n) be 
an eigenfunction of TL, 

TL\n) = X n \n), 

whose eigenvalue X n is unknown at this point. Now we prove the key property that N has 
nonnegative integer eigenvalues 


N\n) — I X n — — i | n) = n\n), n — 0, 1,2..., 


(13.22) 


that is, X n — n + 1/2. Since a\n) is complex conjugate to (n\a ^, the normalization integral 
(. n\a'd\n) > 0 and is finite. From 

(a\nj)^a\ri) = (n\d^d\n) = ^ X n — > 0 (13.23) 


we see that N has nonnegative eigenvalues. 

We now show that if d\n) is nonzero it is an eigenfunction with eigenvalue i = 
X n — 1. After normalizing a\n ), this state is designated |n — 1). This is proved by the 
commutation relations 

(13.24) 
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which follow from Eq. (13.20). These commutation relations characterize N as the number 
operator. To see this, we determine the eigenvalue of N for the states a^\n) and a\n). Using 
= N + [a, <7^] = N + 1, we find that 

N(a^ |n>) = a ^)|n) = a^([d, + 1V)|«} 

— a^(N + l)|n) = + ^a t |n> = (n+ l)a t |n), (13.25) 

N(a\n )) = ( aa * — l)d|n} = a(N — l)|n} = (n — \)a\n). 

In other words, N acting on a ' \n) shows that a ' has raised the eigenvalue n corresponding 
to | n) by one unit, whence its name raising, or creation, operator. Applying a ' repeatedly, 
we can reach all higher states. There is no upper limit to the sequence of eigenvalues. 
Similarly, a lowers the eigenvalue /? by one unit; hence it is a lowering (or annihilation) 
operator because. Therefore, 

a^|n)~|n + l), a\n) ~ \n — 1). (13.26) 


Applying a repeatedly, we can reach the lowest, or ground, state |0) with eigenvalue /,()• We 
cannot step lower because Xq > 1 /2. Therefore a |0) = 0, suggesting we construct i^o = |0) 
from the (factored) first-order ODE 


Integrating 


we obtain 


V2air o = +x\i/o = 0. 



1 2 

lnt/fo = ~-x + In cq, 


where cq is an integration constant. The solution. 


(13.27) 


(13.28) 


(13.29) 


f 0 (x) = c 0 e- x2/2 , (13.30) 

is a Gaussian that can be normalized, with co = : r -1 / 4 using the error integral, Eqs. (8.6) 
and (8.8). Substituting i/^o into Eq. (13.13) we find 


n io> = 




(13.31) 


so its energy eigenvalue is /.o = 1 /2 and its number eigenvalue is n — 0, confirming the 
notation |0). Applying a ‘ repeatedly to ij/Q= |0), all other eigenvalues are confirmed to be 
X n — n + 1/2, proving Eq. (13.13). The normalizations needed for Eq. (13.26) follow from 
Eqs. (13.25) and (13.23) and 


{n\aa'\n) = (n\a^ a + 1 | n) = n + 1 , 


( 13 . 32 ) 
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showing 


~Jn + \\n + 1} = a * \n), T\\n — 1} — a\n). 


(13.33) 


Thus, the excited-state wave functions, i/ r i, if2, and so on, are generated by the raising 
operator 


„+ 1 / d\ X\f2 Jl n 

">=‘" 0) = Ti{ x - ^r <x) =■ <13J4) 

yielding (and leading to upcoming Eq. (13.38)) 

f n (x) = N n H n (x)e - x2 / 2 , N n = 7T _1 ^ 4 (2"n!) _1/2 , (13.35) 


where H n are the Hermite polynomials (Fig. 13.2). 

As shown, the Hermite polynomials are used in analyzing the quantum mechanical sim¬ 
ple harmonic oscillator. For a potential energy V = l K z 2 — ^ ma> 2 z 2 (force F = — VV = 
— Kzz ), the Schrodinger wave equation is 

_|_V 2 q/( z ) + I/i: z 2 q/( z ) = £q/( z ). (13.36) 

2m 2 

Our oscillating particle has mass m and total energy E. By use of the abbreviations 


4 mK m 2 ar 
x—az with a = —=- = —=— 

h 2 h 2 

2E fm\ l/2 _ 2E 
h yA"/ tia>’ 


(13.37) 


in which a> is the angular frequency of the corresponding classical oscillator, Eq. (13.36) 
becomes (with 'T(z) = V T( x/a) = i//(x)) 

d +(X-x 2 )ir(x) = 0. (13.38) 

This is Eq. (13.13) with X = 2n + 1. Hence (Fig. 13.2), 


i/f„(x) = 2 "/ 2 7r I//4 («!) l ^ 2 e x ~/ 2 H n (x), 


(normalized). 


(13.39) 


Alternatively, the requirement that n be an integer is dictated by the boundary conditions 
of the quantum mechanical system. 


lim 'T(z) = 0. 

z—>±oo 


Specifically, if n -» v, not an integer, a power-series solution of Eq. (13.13) (Exercise 9.5.6) 

2 

shows that H v (x ) will behave as x v e x for large x. The functions ir v (x) and 'IV(z) will 
therefore blow up at infinity, and it will be impossible to normalize the wave function T (z). 
With this requirement, the energy E becomes 



(13.40) 
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x 





Figure 13.2 Quantum mechanical 
oscillator wave functions: The 
heavy bar on the x-axis indicates the 
allowed range of the classical 
oscillator with the same total energy. 


As n ranges over integral values (n > 0), we see that the energy is quantized and that there 
is a minimum or zero point energy 


E min =^hw. (13.41) 

This zero point energy is an aspect of the uncertainty principle, a genuine quantum phe¬ 


nomenon. 
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In quantum mechanical problems, particularly in molecular spectroscopy, a number of 
integrals of the form 



x' e x H n (x)H m (x)dx 


are needed. Examples for r — 1 and r — 2 (with n — m) are included in the exercises at the 
end of this section. A large number of other examples are contained in Wilson, Decius, and 
Cross. 4 

In the dynamics and spectroscopy of molecules in the Born-Oppenheimer approxima¬ 
tion, the motion of a molecule is separated into electronic, vibrational and rotational mo¬ 
tion. Each vibrating atom contributes to a matrix element two Hermite polynomials, its 
initial state and another one to its final state. Thus, integrals of products of Hermite poly¬ 
nomials are needed. 


Example 13.1.2 threefold fiermite formula 


We want to calculate the following integral involving m = 3 Hermite polynomials: 


f°° -x 2 

h = \ e Hn 1 (x)Hn 2 (x)Hn 3 (x) dx, 
J —oo 


(13.42) 


where N, > 0 are integers. The formula (due to E. C. Titchmarsh, J. Lond. Math. Soc. 23: 
15 (1948), see Gradshteyn and Ryzhik, p. 838, in the Additional Readings) generalizes the 
m — 2 case needed for the orthogonality and normalization of Hermite polynomials. To 

derive it, we start with the product of three generating functions of Hermite polynomials, 

_ 2 

multiply by e x , and integrate over x in order to generate I 3 : 


Z 3 = 




tj—x) 2 + 2 (t\t 2 +tlt 3 +t 2 t 3 ) 


dx 


— v ^ r e 2 ( , l f 2+fl«3+f2f3) 


(13.43) 


The last equality follows from substituting y = x — ^ • tj and using the error integral 

f^° 0 O e~'"dy = y/n, Eqs. (8.6) and (8.8). Expanding the generating functions in terms of 
Hermite polynomials we obtain 


^ 3 = E 


Ni,N 2 ,N 3 =0 


t Ni JV2JV3 
'l l 2 '3 

A 1 W 2 W 3 


■X 


e x Hn j (x) H^-, (x ) Hn 3 (x )dx 


00 2 n 

— a/tt E T77 (f l r 2 + hh + tiJi) N 
' N\ 

N =0 


00 lN 

= v^Y — 

4.^ ah 


E 


N\ 


N\ nd.ni'.nd. 

N =0 0 <rii<N, J2i n i=N 


(BG)" 1 (BI3)" 2 ihh )" 3 . 


4 E. B. Wilson, Jr., J. C. Decius, and P. C. Cross, Molecular Vibrations, New York: McGraw-Hill (1955), reprinted Dover (1980). 
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using the polynomial expansion 



The powers of the foregoing tjt^ become 

(hh) ni (tih)" 2 (ht-i)" 3 = 


N\=n\+ri2, A r 2 = «i+«3, NT, = n 2 + n 2 . 


That is, from 


there follows 


2N — 2{rt \ + «2 + ” 3 ) = N\ + N 2 + N 3 


2N = 2ni + 2Nj = 2n 2 + 2 N 2 — 2nj, + 2N\, 


so we obtain 


n 1 — N — /V 3 , n 2 = N — N 2 , n-}= N — N\. 


The «, are all fixed (making this case special and easy) because the N, are fixed, and 

3 

2/V = ^ Nj, with N > 0 an integer by parity. Hence, upon comparing the foregoing like 

i =1 

* 1 * 2*3 powers, 


^z2 n N l \N 2 \N 3 \ 

(N - N[)\(N - A^ 2 )!(A^ - A^ 3 )! ’ 


(13.44) 


which is the desired formula. If we order Ni > N 2 > N$ > 0, then n\ > n 2 > nj > 0 
follows, being equivalent to N — Nj > N — N 2 > N — N\ > 0, which occur in the denom¬ 
inators of the factorials of 73 . ■ 


Example 13.1.3 


Direct Expansion of Products of Hermite Polynomials 


In an alternative approach, we now start again from the generating function identity 


JVi n 2 


V H n . ( X)H N . (x) j -= e 2x ^ +t ^- , i- t 2 = e ix(.h+t2)-(ti+t2 ) 2 . e 2nt 2 

^ NiK A 2 V ) 

Ni,N 2 =0 

^ „ , ,(?i+?2) w ^(2fir 2 ) 1 ' 

= ^H N (X) m ^ 


jv=o 


y=0 


V! 
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Using the binomial expansion and then comparing like powers of t\t 2 we extract an identity 
due to E. Feldheim (J. Loud. Math. Soc. 13: 22 (1938)): 

H Nl (x)H N2 (x)= J2 H Ni+N 2 -2v -- ( N ' I , Nl - 2v ) 

1 2 ^ 1+2 vl(Ni +N 2 -2 v)! V Ni-v ) 

E (13.45) 

0<v<min(JVi,Ar 2 ) ' ’ ' ’ 

For v = 0 the coefficient of Hy ] + ,y, is obviously unity. Special cases, such as 

H\ — #2 + 2, H l H 2 = H 3 +4 H u H\ = H 4 + 8// 2 + 8, H X H 3 = H 4 + 6H 2 , 


can be derived from Table 13.1 and agree with the general twofold product formula. 

This compact formula can be generalized to products of m Hermite polynomials, and 
this in turn yields a new closed form result for the integral I m . 

Let us begin with a new result for I 4 containing a product of four Hermite polynomials. 
Inserting the Feldheim identity for //.v, //y, and //y, //,y 4 and using orthogonality 


/ o° 2 

e x Hn 2 dx = s/tt2 Nl N x ISn 1 n 2 

-00 


for the remaining product of two Hermite polynomials yields 


h = 


I! 


Hni Hn 2 H N} H Na dx 


E 2 ^ ! 

0 < /r < min ( N \, N2 ); 0 < v <min ( N3, N4) 


n 2 

d 


2 v v\ 


N 3 

v 


N 4 

v 


i: 


e X HNi+N 2 -2iiHn 4 +N4-2v dx 


Ah 

= E 

v ’=0 


y/jt2 M (N 3 + N 4 - 2v)\N\ \N 2 \N 3 \N 4 \ 


(M — N 3 — N 4 — v)\(M - Ni+ v)\(M -N 2 + v)1(N 3 - v)\(N 4 - v)\v\ 


(13.46) 


Here we use the notation M — (N\ + N 2 + N 3 + N 4 )/2 and write the binomial coefficients 
explicitly, so 

±(Ah +N 2 -N 3 -N 4 ) = M-N 3 - N 4 , 
i(7Vi - N 2 + N 3 + N 4 ) = M - N 2 , 

\(N 2 -N x +N 3 +N 4 ) = M-N x . 

From orthogonality we have [x = (N x + N 2 — N 3 — N 4 )/2 + v. The upper limit 
of v is min(A^ 3 , N 4 . M — N\,M — N 2 ) — min (N 4 . M — N x ) and the lower limit is 
max(0, N 3 + N 4 — M) = 0, if we order N\>N 2 >N 3 > N 4 . 
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Now we return to the product expansion of m Hermite polynomials and the correspond¬ 
ing new result from it for I m . We prove a generalized Feldheim identity, 

H Nl (x)---H Nm (x)= ^2 Hm(x)ci Vi . Vm _i, (13.47) 


where 


m— 1 

M=J2( N ‘~ 2v i) + N m, 

i =1 

by mathematical induction. Multiplying this by H^ m+1 and using the Feldheim identity, 
we end up with the same formula for m + 1 Hermite polynomials, including the recursion 
relation 


? Vm V ' 
n -\ A ■ 


Nm -\-1 
r’m 


E"ri 1 w--2v i )+iv m+ i 


Its solution is 




1 = n (^, + 1 ) (^ =1 * (iVj ‘“ 2Vj ' ) + ^)2(13.48) 


The limits of the summation indices are 


0 < v\ < min(Ni, N 2 ), 0 < V 2 < min(iV 3 , N\ + N 2 — 2vi), 

m—2 


0 < v m — 1 < mhYiV m , ^(Nj - 2iy) + (13.49) 

' i=t ' 


We now apply this generalized Feldheim identity, with indices ordered as N\ > N 2 > 
••• > /V (( ,, to I m , grouping /7y 0 • • ■ /7y,„ together and using orthogonality for the re¬ 
maining product of two Hermite polynomials H^ t (N ._ lv)+N . This yields N 1 = 

J2?=a (N i ~ 2v i) + N >n, fixing v m _i, and 


m —1 


Im — \flt2 Nl N\\ J2 n 


V2, 


-1 1=2 


M'+i 

v; 


E i ~= l 2(Nj-2v j ) + N i 


Vi'. 2" 


(13.50) 


where the limits on the summation indices are 


/ '"- 2 \ 

0 < V 2 < min(W 3 , N 2 ), ..., 0 < v m ~\ < mini N m , ^(Nj-2vj) + N m -i J. (13.51) 

' i =2 ' 




13.1 Hermite Functions 


831 


Example 13.1.4 Applications of the Product Formulas 


To check the expression I,„ for m = 3, we note that the sum with t — \=m — 2=1 
in the second binomial coefficient in I m is empty (that is, zero), so only /V, = N m - 1 = Al 2 
remains. Also, with v m - 2 — fi the sum over the v,- is that over V 2 , which is fixed by the 
constraint on the summation index v 2 : N\ = N 2 — 2v 2 + N 3 . Hence V 2 — ( N 2 + N 3 — 
N\)/2 — N — Ni, with N — (N\ + N 2 + N 3 )/2. That is, only the product remains in /,„. 
The general formula for /„, therefore gives 


/ 3 = V5F2 JVl Af 1 !^ 3 ^ 


(n 2 \ v[2V2 = V^ 2 n N 1 \N 2 \N 3 \ 

\ t> 2 / 2 (N — N\)\(N — N 2 )\(N — AI3)! ’ 


which agrees with our earlier result of Example 13.1.2. The last expression is based on 
the following observations. The power of 2 has the exponent N\ + v 2 = N. The factorials 
from the binomial coefficients are N 3 — v 2 — (N\ + N 3 — N 2)/2 — N — N 2 , N 2 — v 2 = 
(All +N 2 - N 3 )/2 = N-N 3 . 

Next let us consider m — 4, where we do not order the Hermite indices /V, as yet. The 
reason is that the general I m expression was derived with a different grouping of the Her¬ 
mite polynomials than the separate calculation of I 4 with which we compare. That is why 
we’ll have to permute the indices to get the earlier result for I 4 . That is a general conclu¬ 
sion: Different groupings of the Hermite polynomials just give different permutations of 
the Hermite indices in the general result. 

We have two summations over v 2 and v m _i = v 3 , which is fixed by the constraint N\ — 
N 2 — 2v 2 + AI 3 — 2v 3 + N 4 . Hence 


v 3 = ^ {N 2 + AI3 + N4 — All) — v 2 — M — N\ — v 2 

with M — \ (Ali + N2 + AI3 + AI4). The exponent of 2 is N\ + v 2 + V3 = M. Therefore for 
m — 4 the I m formula gives 

‘■"'•'soraorr*)""' 

_ ^ *Jn2 M N\ !Al 2 !AI3!AI4!(Al 2 - 2 v 2 + Al 3 )! 

^ v 2 \v 3 \(N 2 — V2)!(A^3 — v 2 ) HN4 — v 3 )!(N 2 + N 3 — 2 v 2 — v 3 )! 

V2>0 

_ ^ *Jn 2 M N\ \N 2 \N 3 \N 4 \(N 2 + Al 3 - 2 v 2 )! 

(AI2 — t 2 )!(A 1 3 — V2)\{N4 — v 3 )\v 2 \v 3 \{N 2 + AI3 — 2 v 2 — V3)! 

V2>0 

_ Jn 2 M N\ !Al 2 !AI3!Al 4 !(Al 2 + N 3 - 2 v 2 )! 

~~ ^ v 2 !(Af - Ali - vt)!(A 1 3 - v 2 )!(A 1 2 - vH!(M - Al 2 - AI3 + m)!(M - N 4 - v->)!' 

l.'2>() 

In the last expression we have substituted V3 and used 


N4 — v 3 — (Ali — N 2 — AI3 + AI4) + v 2 — M — Al 2 — N 3 + V2; 


N 3 + N 3 — 2 v 2 — v 3 — 


N\ + N 2 + N 3 — N4 


— V 2 = M — AI 4 — v 2 ■ 


2 
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The upper limit is V 2 < min (M 2 , N$,M — N\,M — M 4 ), and the lower limit is \>2 > 
max(0, M 2 + M 3 — M). If we make the permutation N 2 ** M 4 , vj —> v, then our previ¬ 
ous I 4 result is obtained with upper limit v < min(iV 4 , M — N\) — \(N 2 + M 3 + M 4 - Mi) 
and lower limit v > max(0, M 3 + N 4 — M) — 0 because M 3 + M 4 — Mi — M 2 < 0 for 
Mi > N 2 > M 3 > N 4 > 0. ■ 


The Hermite polynomial product formula also applies to products of simple harmonic 
oscillator wave functions, e~ mx ~ / 2 Ht>] l (x) ■ ■ ■ Hn„, (x) dx, with a different exponential 

weight function. To evaluate such integrals we use the generalized Feldheim identity for 
//\' 2 • • • H Nm in conjunction with the integral (see Gradshteyn and Ryzhik, p. 845, in the 
Additional Readings), 



_ 2 2 

e ~a x H m ( x )H„(x)dx 


1 

2 


2 \ m+n+l 


(1 


a 2 ) <m+,,)/2 r 


m + n + 1 


• iF\ 





instead of the standard orthogonality integral for the remaining product of two Hermite 
polynomials. Here the hypergeometric function is the finite sum 


iF\ 



1 — m — n 


’ 2(a 2 — 1) 


min(m,«)—1 

- E 

v=0 


(-m) v (-n) v 

v\0^) v 



V 


with (— m) v = (—m)( 1 — m) • • • (v — 1 — in ) and (— m)o = 1- This yields a result similar to 
I m but somewhat more complicated. 

The oscillator potential has also been employed extensively in calculations of nuclear 
structure (nuclear shell model) quark models of hadrons and the nuclear force. 

There is a second independent solution of Eq. (13.13). This Hermite function of the 
second kind is an infinite series (Sections 9.5 and 9.6) and is of no physical interest, at 
least not yet. 


Exercises 

13 . 1.1 Assume the Hermite polynomials are known to be solutions of the differential equa¬ 
tion (13.13). From this the recurrence relation, Eq. (13.3), and the values of H n ( 0) are 
also known. 


(a) Assume the existence of a generating function 


g(x,t) 


E 


n=0 


H n (x)t ' 1 
nl 


(b) Differentiate g(x,t) with respect to x and using the recurrence relation develop a 
first-order PDE for g(x,t). 

(c) Integrate with respect to x, holding t fixed. 

(d) Evaluate g(0, t) using Eq. (13.5). Finally, show that 

g(x, t) = exp(— t 2 + 2 tx). 
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13 . 1.2 In developing the properties of the Hermite polynomials, start at a number of different 
points, such as: 

1. Hermite’s ODE, Eq. (13.13), 

2. Rodrigues’ formula, Eq. (13.7), 

3. Integral representation, Eq. (13.8), 

4. Generating function, Eq. (13.1), 

5. Gram-Schmidt construction of a complete set of orthogonal polynomials over 
(—oo, oo) with a weighting factor of exp(—x 2 ), Section 10.3. 
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13.1.8 Show that 


I x m e x //„ ix) dx = 0 for m an integer, 0 < m < n — 1. 

J —oo 

13.1.9 The transition probability between two oscillator states m and n depends on 

xe~ x H n {x)H m {x) dx. 


f 


Show that this integral equals 7T 1 ' /2 2" _1 «!S,„,„_i + jr 1//2 2"(n + \)\8 m n +i. This result 
shows that such transitions can occur only between states of adjacent energy levels, 
m = n ± 1. 

Hint. Multiply the generating function (Eq. (13.1)) by itself using two different sets of 
variables (x, s ) and (x, t). Alternatively, the factor x may be eliminated by the recur¬ 
rence relation, Eq. (13.2). 

13.1.10 Show that 



x 2 e x H n (x)H n (x)dx — n l ^2"n\ 



This integral occurs in the calculation of the mean-square displacement of our quantum 
oscillator. 

Hint. Use the recurrence relation, Eq. (13.2), and the orthogonality integral. 

13.1.11 Evaluate 



x 2 e x H n (x)H m (x)dx 


in terms of n and m and appropriate Kronecker delta functions. 

ANS. 2"- 1 7r 1/2 (2n + l)n'.8 nm + 2 n n l/2 (.n + 2)\8 n+2 , m + 2 n - 2 7t 1/2 n\S n - 2 , m . 

13.1.12 Show that 

r°° ■ _ 2 

I x r e x H n {x)H n+p {x)dx — 

J —OO 

with n , p, and r nonnegative integers. 

Hint. Use the recurrence relation, Eq. (13.2), p times. 

13.1.13 (a) Using the Cauchy integral formula, develop an integral representation of H n (x) 

based on Eq. (13.1) with the contour enclosing the point z = —x. 


0, p > r 

2"7T 1 / 2 (h + r)\, p — r. 


ANS. H n (x) = —e* 2 
2 Jti 


(4 + x)' i+1 


dz. 


(b) Show by direct substitution that this result satisfies the Hermite equation. 
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13.1.14 With 


i jr n (x) = e 


* 2 / 2 _ 


H n (x) 


(2"n!7T 1 / 2 ) 1 / 2 ’ 


verify that 


a n fn(x) = = n l/2 \lf n ~\{x), 

al^ n (x) = Y=(x- = (n + 1) 1/2 iA«+iM- 

Vote. The usual quantum mechanical operator approach establishes these raising and 
lowering properties before the form of i// ( , (x) is known. 

13.1.15 (a) Verify the operator identity 


d 

V 

d 

x 2 ~ 

x - = — exp 

dx 

2 

— exp 
dx 



(b) The normalized simple harmonic oscillator wave function is 

Jl- 


i/r n (x) = (7r 1 / 2 2"«!) '^“exp 
Show that this may be written as 


H n (x). 


( d Y 

x 2 ~ 

V x ~Tx) exp 

~y_ 


Note. This corresponds to an n-fold application of the raising operator of Exer¬ 
cise 13.1.14. 

13.1.16 (a) Show that the simple oscillator Hamiltonian (from Eq. (13.38)) may be written as 

1 d 2 1 2 1,_ + A+A . 

H =—lZ ^ = 5 ( “'+»*“)■ 

Hint. Express E in units of hco. 

(b) Using the creation-annihilation operator formulation of part (a), show that 

Uf(x) = ^n + Jjf(r). 

This means the energy eigenvalues are E = (n + ^)(hw ), in agreement with 
Eq. (13.40). 

13.1.17 Write a program that will generate the coefficients a s , in the polynomial form of the 
Hermite polynomial H n (x) = X^s= 0 a ^x s - 

13.1.18 A function f(x) is expanded in a Hermite series: 


f(x) = Ya n H n jx). 


12=0 
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From the orthogonality and normalization of the Hermite polynomials the coefficient 
a n is given by 

1 r°° .2 

an = — | n , / f{x)H n {x)e x dx. 

2 n i J_oo 

For f(x) — x 8 determine the Hermite coefficients a n by the Gauss-Hermite quadrature. 
Check your coefficients against AMS-55, Table 22.12 (for the reference see footnote 4 
in Chapter 5 or the General References at book’s end). 

13.1.19 (a) In analogy with Exercise 12.2.13, set up the matrix of even Hermite polynomial 

coefficients that will transform an even Hermite series into an even power series: 



Extend B to handle an even polynomial series through H%(x). 

(b) Invert your matrix to obtain matrix A, which will transform an even power series 
(through x 8 ) into a series of even Hermite polynomials. Check the elements of A 
against those listed in AMS-55 (Table 22.12, in the General References at book’s 
end). 

(c) Finally, using matrix multiplication, determine the Hermite series equivalent to 
fix) =x 8 . 

13.1.20 Write a subroutine that will transform a finite power series, Yl,n=t) a nX n , into a Hermite 
series, o b n H n (x). Use the recurrence relation, Eq. (13.2). 

Note. Both Exercises 13.1.19 and 13.1.20 are faster and more accurate than the Gaussian 
quadrature. Exercise 13.1.18, if fix) is available as a power series. 

13.1.21 Write a subroutine for evaluating Hermite polynomial matrix elements of the form 

f°° . _ 2 

M pqr = I Hp(x)H q (x)x r e A dx, 

J —OO 

using the 10-point Gauss-Hermite quadrature (for p + q + r < 19). Include a parity 
check and set equal to zero the integrals with odd-parity integrand. Also, check to see 
if r is in the range \p — q\ <r. Otherwise M pqr — 0. Check your results against the 
specific cases listed in Exercises 13.1.9, 13.1.10, 13.1.11, and 13.1.12. 

13.1.22 Calculate and tabulate the normalized linear oscillator wave functions 

(x ) = 2 _ " /, 2 7 r _ 1 ' / 4 (/r!) _ 1 / 2 H„(x)exp^— — ^ for.r = 0.0(0.1)5.0 

and n — 0(1)5. If a plotting routine is available, plot your results. 

13.1.23 Evaluate e~ 2x ~ //\-, (x) ■ ■ ■ // v 4 (x) dx in closed form. 

Hint, ff^e- 2 * 2 H Nl (x)H N2 (x)H N3 (x)dx = J^Wi+^+Ab-D / 2 . _ Ni)T(s - N 2 ) 

• T is - Ni),s = (N\ + N 2 + N 3 + l)/2 or H Nl {x)H Nl (x)dx = 

(_ 1 )(W+A' 2 - 1 )/ 2 2 (A'i+A' 2 - 1)/2 . p(( A r 1 + n 2 + l)/2) may be helpful. Prove these for¬ 
mulas (see Gradshteyn and Ryzhik, no. 7.375 on p. 844, in the Additional Readings). 
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13.2 Laguerre Functions 


Differential Equation — Laguerre Polynomials 


If we start with the appropriate generating function, it is possible to develop the Laguerre 
polynomials in analogy with the Hermite polynomials. Alternatively, a series solution may 
be developed by the methods of Section 9.5. Instead, to illustrate a different technique, let 
us start with Laguerre’s ODE and obtain a solution in the form of a contour integral, as we 
did with the integral representation for the modified Bessel function K v (x ) (Section 11.6). 
From this integral representation a generating function will be derived. 

Laguerre’s ODE (which derives from the radial ODE of Schrodinger’s PDE for the hy¬ 
drogen atom) is 


xy"(x) + (1 — x)y\x) + ny(x) = 0. 


(13.52) 


We shall attempt to represent y, or rather y n , since y will depend on the parameter n, 
a nonnegative integer, by the contour integral 

0 -*z/(l-z) 


1 

y>i(x) = — 

Ini 


(1 — z)z n+l 


dz 


(13.53a) 


and demonstrate that it satisfies Laguerre’s ODE. The contour includes the origin but does 
not enclose the point z = 1. By differentiating the exponential in Eq. (13.53a) we obtain 


rfW= Si 


*z/(l—z) 


(1 - z) 2 z n 

rz/(l—z) 


dz, 


dz. 


(1 — z) 3 z" 1 

Substituting into the left-hand side of Eq. (13.52), we obtain 


(13.53b) 

(13.53c) 


1 

2:ri 

which is equal to 


1 —x 


(1 — zyz' 


3 7 n —1 


+ 


(1 — z) 2 z" (1 — z)z‘ 


dz. 


n +1 


e -.vz/(t-z) dz 


1 

_ ( 


- e -xz/(\-z) - 

2 ni J 

' dz 

_ (1 - z)z n _ 


(13.54) 


If we integrate our perfect differential around a closed contour (Fig. 13.3), the integral will 
vanish, thus verifying that y n (x) (Eq. (13.53a)) is a solution of Laguerre’s equation. 

It has become customary to define L n (x), the Laguerre polynomial (Fig. 13.4), by 5 


1 

E/1 ( X ) — — 7 
2tci 


e 


—rz/(l—z) 


(1 — z)z' i+1 


dz. 


(13.55) 


5 Other definitions of L n (x ) are in use. The definitions here of the Laguerre polynomial L n (x ) and the associated Laguerre 
polynomial Lfj (x ) agree with AMS-55, Chapter 22. (For the full ref. see footnote 4 in Chapter 5 or the General References at 
book’s end.) 
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y 



Figure 13.3 Laguerre 
polynomial contour. 



Figure 13.4 Laguerre 
polynomials. 


This is exactly what we would obtain from the series 


-jcz/U-z) °° 

g(x,z) = — -= T L n (. x)z n , 

1 ~Z n 

n =0 


\z\ < 1, 


(13.56) 


if we multiplied g(x, z) by and integrated around the origin. As in the development 

of the calculus of residues (Section 7.1), only the s _1 term in the series survives. On this 
basis we identify g(x,z) as the generating function for the Laguerre polynomials. 




13.2 Laguerre Functions 


839 


With the transformation 


xz 

--= 5 — X, 

1 - z 

s — X 

or z =-, 

(13.57) 

Ln(.x) = Z 7 ^ 

2m J 

s n e~ s 

^ ds, 

(s - x)" +1 

(13.58) 


the new contour enclosing the point s — x in the .v-plane. By Cauchy’s integral formula 
(for derivatives). 


L n (x) 


e v d n 
n\ dx n 


(x’e-) 


(integral «), 


(13.59) 


giving Rodrigues’ formula for Laguerre polynomials. From these representations of L n (x) 
we find the series form (for integral n), 


Ln (*0 — 


(- 1)' 1 


n n-\ . n z {n-\Y 2 
1 !* + 2 ! 


■ + (-!)"«! 


_A (-1 ) m n\x m _A (—iy , ~ s n\x n ~ s 
(n — m)\m\m\ (n — 


m =0 


s=0 


(n — s)\(n — JOB! 


(13.60) 


and the specific polynomials listed in Table 13.2 (Exercise 13.2.1). Clearly, the defini¬ 
tion of Laguerre polynomials in Eqs. (13.55), (13.56), (13.59), and (13.60) are equivalent. 
Practical applications will decide which approach is used as one’s starting point. Equa¬ 
tion (13.59) is most convenient for generating Table 13.2, Eq. (13.56) for deriving recur¬ 
sion relations from which the ODE (13.52) is recovered. 

By differentiating the generating function in Eq. (13.56) with respect to x and z, we 
obtain recurrence relations for the Laguerre polynomials as follows. Using the product 
rule for differentiation we verify the identities 

(1 - z) 2 ^- = (1 -x -z)g(x,z), (z - 1 )^ =zg(x,z). (13.61) 


Table 13.2 Laguerre Polynomials 


L 0 (x) = 1 

L | (x) = -x + 1 

21Z.2D = x 2 — 4x + 2 

3!L 3 (x) = -x 3 + 9.t 2 - 18x + 6 

4 \L 4 (x) = x 4 - 16x 3 + llx 2 - 96.v + 24 

5!L 5 (x) = -X 5 + 25x 4 - 200x 3 + 600x 2 - 600x + 120 

6!L 6 U) = x 6 - 36x 5 + 450x 4 - 2400x 3 + 5400x 2 - 4320x + 720 
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Writing the left-hand and right-hand sides of the first identity in terms of Laguerre polyno¬ 
mials using Eq. (13.56) we obtain 

£[(- + l)L n +i(x) - 2nL n (x) + ( n - l)L„-i(x)]z" 

n 

— £[(1 -x)L n {x) - L n -\{x)\z n . 

n 

Equating coefficients of z n yields 

(« + l)L„+i(x) = (2 n + 1 — x)L n (x) — nL n -\{x). (13.62) 


To get the second recursion relation we use both identities of Eqs. (13.61) to verify the 
third identity. 


dg __dg d(zg) 
X dx -'"dz Z dz 


(13.63) 


which, when written similarly in terms of Laguerre polynomials, is seen to be equivalent 
to 


xL' n (x) — nL n (x ) — nL n -i(x). (13.64) 

Equation (13.61), modified to read 

L n +\(x) = 2L n {x) - L n -i(x) --[(1 +x)L n (x) - L„_i(x)], (13.65) 

n + 1 

for reasons of economy and numerical stability, is used for computation of numerical val¬ 
ues of L n (x). The computer starts with known numerical values of Lq(x) and L\ (x), Ta¬ 
ble 13.2, and works up step by step. This is the same technique discussed for computing 
Legendre polynomials. Section 12.2. 

Also, from Eq. (13.56) we find 

1 OO OO 

g (°, z) = -— = Y J z n = Y J L n m\ 

^ n =0 n =0 

which yields the special values of Laguerre polynomials 

L n (0) = 1. (13.66) 


As is seen from the form of the generating function, from the form of Laguerre’s ODE, or 
from Table 13.2, the Laguerre polynomials have neither odd nor even symmetry under the 
parity transformation x —> — x. 

The Laguerre ODE is not self-adjoint, and the Laguerre polynomials L n (x) do not by 
themselves form an orthogonal set. However, following the method of Section 10.1, if we 
multiply Eq. (13.52) by e~ x (Exercise 10.1.1) we obtain 


r 

Jo 


e x L m ( x)L n (x) dx — 8, 


(13.67) 
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This orthogonality is a consequence of the Sturm-Liouville theory. Section 10.1. The nor¬ 
malization follows from the generating function. It is sometimes convenient to define or- 
thogonalized Laguerre functions (with unit weighting function) by 

(p n (x)=e~ x/2 L n (x). (13.68) 

Our new orthonormal function, (p n (x), satisfies the ODE 

x<p'n(x) + <p' n (x) + (n + ^ - ^y>„(x) = 0, (13.69) 

which is seen to have the (self-adjoint) Sturm-Liouville form. Note that the interval 
(0 < x < oo) was used because Sturm-Liouville boundary conditions are satisfied at its 
endpoints. 


Associated Laguerre Polynomials 

In many applications, particularly in quantum mechanics, we need the associated Laguerre 
polynomials defined by 6 


d k 

L k n (x) = (-l) k -^L n+k (x). 


(13.70) 


From the series form of L n (x) we verify that the lowest associated Laguerre polynomials 
are given by 

L k 0 (x)= 1, 


L\(x) = —x + k + 1, 

Tk , , * 2 „ , , (* + 2)(*+l) 

L 2 (x) — —— {k + 2)x H---• 


(13.71) 


In general. 


z.; w = £(-ir— 


(n + *)! 


m =0 


(n — m)\(k + m)\m\ 


k> — 1. 


(13.72) 


A generating function may be developed by differentiating the Laguerre generating func¬ 
tion k times to yield 


dx k l — z 


jk -xz/(i-z) 00 00 

-= <-i>* £ =£ dMV * 1 


n =0 

k * e Jcz/(l-z) 


n=0 


1 - Zj 1 - Z 


6 Some authors use Z k +k (x) = {d k /dx k )[L n + k (x)]. Hence our L k (x) = (— l) k £ k +k (x). 
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From the last two members of this equation, canceling the common factor z , we obtain 


-*z/(l-Z) 


(1 — z) k+ 


T = J2L k „(x)zT, 


n= 0 


Izl < 1- 


From this, for x = 0, the binomial expansion 


(13.73) 


1 


(1 - z) k+ 


i = E 


n=0 


i 


(-z)" = I>J(0)z" 


n =0 


yields 


u (n + k)\ 

L « (0) = ^r- 


(13.74) 


Recurrence relations can be derived from the generating function or by differentiating the 
Laguerre polynomial recurrence relations. Among the numerous possibilities are 


(n + 1 )L k +l (x) — (2 n + k+ 1 - x)L k {x) - (n +k)L k _ l (x), 

X ~J~ = nLk n (x)-(n + k)L k _ t(x). 

Thus, we obtain from differentiating Laguerre’s ODE once 

rll" rlT' dl 

x-p + L"-L; + (l-x)^p+»^=0, 
ax clx dx 

and eventually from differentiating Laguerre’s ODE k times 


(13.75) 

(13.76) 


d k 


jk— 1 


d 


k -1 


X ~d~k L n + k , L n — k , k— | L 'n + C 1 _ X ^~T~k L ' n +n Y~k L " ~ 

ax' 1 ax‘ 1 AXf'" 1 dx K 

Adjusting the index n n + k, we have the associated Laguerre ODE 




dx 2 


dx 


(13.77) 


When associated Laguerre polynomials appear in a physical problem it is usually because 
that physical problem involves Eq. (13.77). The most important application is the bound 
states of the hydrogen atom, which are derived in upcoming Example 13.2.1. 

A Rodrigues representation of the associated Laguerre polynomial 


L k n {x) 


e x x~ k d n 
n\ dx 11 


(, e~ x x' ,+k ) 


(13.78) 


may be obtained from substituting Eq. (13.59) into Eq. (13.70). Note that all these formulas 
for associated Legendre polynomials L k (x) reduce to the corresponding expressions for 
L n (x) when k = 0. 
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The associated Laguerre equation (13.77) is not self-adjoint, but it can be put in self- 
adjoint form by multiplying by e~ x x k , which becomes the weighting function (Sec¬ 
tion 10.1). We obtain 

f 00 r k k u ( n+k)\ 

J e~ x x k L k n (x)L k m (x)dx= S mn . (13.79) 

Equation (13.79) shows the same orthogonality interval (0, oo) as that for the Laguerre 
polynomials, but with a new weighting function we have a new set of orthogonal polyno¬ 
mials, the associated Laguerre polynomials. 

By letting \js k (x) — e~ x ^ 2 x k ^ 2 L k (x), i// 7 ’(x) satisfies the self-adjoint ODE 


d 2 \l/ k {x) d\/f k (x) / x 2n+k + l 
dx 2 dx 4^" 2 


— )f n {x) = 0. 


(13.80) 


The ip k (x) are sometimes called Laguerre functions. Equation (13.67) is the special case 
& = 0ofEq. (13.79). 

A further useful form is given by defining 7 

<t> k (x)=e~ x/2 x {k+l y2 L k (x). (13.81) 


Substitution into the associated Laguerre equation yields 

d 2 <t> k (x) / 1 2n + k+l k 2 - 1\ 

dx 2 ~ \ 4 2x 4x 2 J 

The corresponding normalization integral L°° \fy k (x)\ 2 dx is 


<& k (x)=0. 



e x x k+1 [L k (x)] 2 dx 


(n +k)\ 
nl 


(2 n + k+1). 


(13.82) 


(13.83) 


Notice that the 4> k n (x) do not form an orthogonal set (except with x~ l as a weighting func¬ 
tion) because of the x~ l in the term (2 n + k + l)/2.r. (The Laguerre functions Ly(x) in 
which the indices v and /x are not integers may be defined using the confluent hypergeo¬ 
metric functions of Section 13.5.) 


Example 13.2.1 


The Hydrogen Atom 


The most important application of the Laguerre polynomials is in the solution of the 
Schrodinger equation for the hydrogen atom. This equation is 


h 1 


Ze z 


-V-t/r - 

2m 47T6o r 


\[r = E i/f, 


(13.84) 


in which Z = 1 for hydrogen, 2 for ionized helium, and so on. Separating variables, we 
find that the angular dependence of i// is the spherical harmonics Y^{0,q>). The radial 
part, R(r), satisfies the equation 


fr 1 d 


2m i' 2 dr \ dr 


,dR 


Ze z 

Aire^r 


-R 


h 2 L(L + 1) 
2m r 2 


R — ER. 


(13.85) 


'This corresponds to modifying the function \J/ in Eq. (13.80) to eliminate the first derivative (compare Exercise 9.6.11). 
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For bound states, R —>■ 0 as r -> oo, and R is finite at the origin, r — 0. We do not consider 
continuum states with positive energy. Only when the latter are included do hydrogen wave 
functions form a complete set. 

By use of the abbreviations (resulting from rescaling r to the dimensionless radial vari¬ 
able p) 


2 8m E 

p —ar with a =- =— 

h 2 

Eq. (13.85) becomes 


E < 0, 


mZe 2 

2ix CQOih 2 


1 d ( 2 dx(p) \ 
p 2 dp\ dp J 



1 

4 


L(L + 1) \ 
P 2 ) 


X (P) = 0, 


(13.86) 


(13.87) 


where x(p) — R(p/ a )- A comparison with Eq. (13.82) for ^(.r) shows that Eq. (13.87) 
is satisfied by 


PX(p) = e- p/2 p L+l Ll L + 1 _ l (p ) 


(13.88) 


in which k is replaced by 2L + 1 and n by X — L — 1, upon using 

1 d 2 dx 1 d 2 

~iirP~^r = 

p z flp flp p dp- 

We must restrict the parameter 1 by requiring it to be an integer n,n= 1,2, 3,_ 8 This 

is necessary because the Laguerre function of nonintegral n would diverge 9 as p n e p , which 
is unacceptable for our physical problem, in which 


lim R(r) — 0. 

r-»oo 


This restriction on X, imposed by our boundary condition, has the effect of quantizing the 
energy, 


Z 2 m ( e 2 \ 2 
ln 2 h 2 V47reo/ 


(13.89) 


The negative sign reflects the fact that we are dealing here with bound states (E < 0), cor¬ 
responding to an electron that is unable to escape to infinity, where the Coulomb potential 
goes to zero. Using this result for E n , we have 


with 


me 2 Z 2 Z 2 Z 

a — - 2 • — =-, p =- r, 

2TX€otr n nao nao 


(13.90) 


4neoh 2 
ao o 

wr 


the Bohr radius. 


^This is the conventional notation for A.. It is not the same n as the index n in <E>^ (x). 
^This may be shown, as in Exercise 9.5.5. 
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Thus, the final normalized hydrogen wave function is written as 


fnLM{r,0,(p) 



0 n-L - 1)! 
2 n(n + L)\ 


1/ V“ r / 2 («r) L L^+ 1 _ I 


(ar)Y^(0, (p). 


(13.91) 


Regular solutions exist for n > L + 1, so the lowest state with L — 1 (called a 2P state) 
occurs only with n =2. ■ 


Exercises 


13.2.1 

13.2.2 


13.2.3 

13.2.4 

13.2.5 


13.2.6 


Show with the aid of the Leibniz formula that the series expansion of L n (x) 
(Eq. (13.60)) follows from the Rodrigues representation (Eq. (13.59)). 

(a) Using the explicit series form (Eq. (13.60)) show that 

L' n (0) = -n, 

L"(0) = \n{n - 1). 

(b) Repeat without using the explicit series form of L n (x). 


From the generating function derive the Rodrigues representation 


x v —k 


L k ,M) = 


ex 


: (e~ x x n+k ). 


n\ dx n 

Derive the normalization relation (Eq. (13.79)) for the associated Laguerre polynomials. 


Expand x r in a series of associated Laguerre polynomials L k (x), k fixed and n ranging 
from 0 to r (or to oo if r is not an integer). 

Hint. The Rodrigues form of L k (x) will be useful. 


ANS. x r 


(r + k)\r\J2 

n =0 


(-1 ) n L k „(x) 

(n + At)!( r — n) \ ’ 


0 < x < oo. 


Expand e ax in a series of associated Laguerre polynomials lJ n (x). k fixed and n rang¬ 
ing from 0 to oo. 


(a) Evaluate directly the coefficients in your assumed expansion. 

(b) Develop the desired expansion from the generating function. 


ANS. e~ ax = 


1 


■E 


(1 + a) 1+k 

n =0 


L k n (x), 


0 < x < oo. 


13.2.7 Show that 


f e x x k+{ L k (x)L k (x)dx= ^ (2n + k + 1). 

Jo n\ 


xL k - (2 n + k+ 1 )L k - (n + K)L k n _ x - (n + 1 )L k n+v 


Hint. Note that 
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13.2.8 Assume that a particular problem in quantum mechanics has led to the ODE 

d 2 y k 2 — 1 2n + k + 1 1 

dx 2 4x 2 2x 4 

for nonnegative integers n, k. Write y (x) as 

y(x) = A(x)B(x)C(x), 

with the requirement that 

(a) A(x) be a negative exponential giving the required asymptotic behavior of y(x) 
and 

(b) B(x) be a positive power of x giving the behavior of y (x) for 0 < x 1. 


13.2.9 


Determine A(x) and B{x). Find the relation between C(x) and the associated Laguerre 
polynomial. 

ANS. A(x) = e~ x ' 2 , B(x)=x^ k+l ^ 2 , C(x) = L k n (x). 

From Eq. (13.91) the normalized radial part of the hydrogenic wave function is 


R nL (r)= a 3 


(n-L - 1)!' 
2n(n + L)\ 


1/2 


in which a = 2Z/na^ — 2Zme 2 /Aneoh 2 . Evaluate 


(a) (r}= / rR nL (ar)R nL (ar)r 2 dr, 


pOO 

(r)= / rR nL I 

Jo 

BOO 

{'-')= [ 

Jo 


R H L{o/r)R nL (ar)r- dr. 


The quantity (r) is the average displacement of the electron from the nucleus, whereas 
(r _1 ) is the average of the reciprocal displacement. 

ANS. <r> = ^[3« 2 -L(L + l)], ( r ~ 1 )=-^-. 

2 n z ao 

13.2.10 Derive the recurrence relation for the hydrogen wave function expectation values: 

~~r( rS+l ) ~ ( 2s + 3 ) fl o(^ J ) + -y-[( 2L + l) 2 - (s + l) 2 ]flo(r s_1 ) = 0, 

with s > —2 L — 1, (r s ) = r s . 

Hint. Transform Eq. (13.87) into a form analogous to Eq. (13.80). Multiply by p s+ 2 u f — 
cp s+l u. Here u — p<&. Adjust c to cancel terms that do not yield expectation values. 

13.2.11 The hydrogen wave functions, Eq. (13.91), are mutually orthogonal, as they should be, 
since they are eigenfunctions of the self-adjoint Schrodinger equation 

/ ir* lLlM ^ n2L2 M 2 r 2 drdSl = ^n\H2 SliL 2 Sm 1 m 2 - 
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Yet the radial integral has the (misleading) form 

nOO 

J e -“''/ 2 («r) z 'L^+^ 1 («r) e -“'-/ 2 (ar) i L^_ 1 («r)r 2 Jr, 

which appears to match Eq. (13.83) and not the associated Laguerre orthogonality re¬ 
lation, Eq. (13.79). How do you resolve this paradox? 

ANS. The parameter a is dependent on n. The first three a, previ¬ 
ously shown, are 2Z/n\ao. The last three are 2 Z/h2«o- For 
n i = «2 Eq. (13.83) applies. For n \ ^ ni neither Eq. (13.79) 
nor Eq. (13.83) is applicable. 


13.2.12 


A quantum mechanical analysis of the Stark effect (parabolic coordinate) leads to the 
ODE 


d / du\ 

dS\ds) 


1 m 1 

-E£ + L - 

2 5 4 $ 



u — 0. 


Here F is a measure of the perturbation energy introduced by an external electric field. 
Find the unperturbed wave functions (F — 0) in terms of associated Laguerre polyno¬ 
mials. 


ANS. it(£) = e“ £?/2 f m/2 L"'(e|), with s = V 3 2E > 0, 
p — L/s — (m + l)/2, a nonnegative integer. 


13.2.13 The wave equation for the three-dimensional harmonic oscillator is 

h 2 1 

-V 2 i/r H— Mco 2 r 2 ifr = Eilr. 

2M V 2 V 

Here a> is the angular frequency of the corresponding classical oscillator. Show that the 
radial part of if/ (in spherical polar coordinates ) may be written in terms of associated 
Laguerre functions of argument (fir 2 ), where fi — Mco/h. 

Flint. As in Exercise 13.2.8, split off radial factors of r 1 and e ~^ r ~/ 2 . The associated 
Laguerre function will have the form l!^\^ i _ l _y^(f>r 2 ). 

13.2.14 Write a computer program that will generate the coefficients a s in the polynomial form 
of the Laguerre polynomial L„(x) — Yl"=o a s xS ■ 

13.2.15 Write a computer program that will transform a finite power series J2n=o a n x>l into a 
Laguerre series b n L n (x). Use the recurrence relation, Eq. (13.62). 

13.2.16 Tabulate Lio(x) for x — 0.0(0.1)30.0. This will include the 10 roots of Lio- Beyond 
x = 30.0, L io(.r) is monotonic increasing. If graphic software is available, plot your 
results. 


Check value. Eighth root = 16.279. 

13.2.17 Determine the 10 roots of L\q(x) using root-finding software. You may use your knowl¬ 
edge of the approximate location of the roots or develop a search routine to look for the 
roots. The 10 roots of L\{)(x) are the evaluation points for the 10-point Gauss-Laguerre 
quadrature. Check your values by comparing with AMS-55, Table 25.9. (For the refer¬ 
ence see footnote 4 in Chapter 5 or the General References at book’s end.) 
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13.2.18 Calculate the coefficients of a Laguerre series expansion ( L n (x),k — 0) of the ex¬ 
ponential e~ x . Evaluate the coefficients by the Gauss-Laguerre quadrature (compare 
Eq. (10.64)). Check your results against the values given in Exercise 13.2.6. 

Note. Direct application of the Gauss-Laguerre quadrature with f (x)L n (x)e~ x gives 
poor accuracy because of the extra e~ x . Try a change of variable, y = lx, so that the 
function appearing in the integrand will be simply L n (y/ 2). 

13.2.19 (a) Write a subroutine to calculate the Laguerre matrix elements 

rOQ 

Mmnp — I L m (,x)L u {x)x^e clx. 

Jo 

Include a check of the condition |m — n\ < p < m + n. (If p is outside this range, 
M mnp = 0. Why?) 

Note. A 10-point Gauss-Laguerre quadrature will give accurate results for 
m + n + p < 19. 

(b) Call your subroutine to calculate a variety of Laguerre matrix elements. Check 
M mn i against Exercise 13.2.7. 

13.2.20 Write a subroutine to calculate the numerical value of L k n (x ) for specified values of n , k, 
and x. Require that n and k be nonnegative integers and x > 0. 

Hint. Starting with known values of L k {) and L k (x), we may use the recurrence relation, 
Eq. (13.75), to generate L k (x), n = 2, 3,4,_ 

13.2.21 Show that x n e~ x //„ (xy) dx — y/nn ! P n (y), where P„ is a Legendre polynomial. 

13.2.22 Write a program to calculate the normalized hydrogen radial wave function 

This is xj/uLM of Eq. (13.91), omitting the spherical harmonic Y k1 (0, (p). Take Z — 1 
and flo = 1 (which means that r is being expressed in units of Bohr radii). Accept n 
and L as input data. Tabulate V/„/ (r) for r — 0.0(0.2 )R with R taken large enough to 
exhibit the significant features of \[r. This means roughly K — 5 for n = 1, R = 10 for 
n = 2, and R — 30 for n — 3. 

13.3 Chebyshev Polynomials 

In this section two types of Chebyshev polynomials are developed as special cases of ul- 
traspherical polynomials. Their properties follow from the ultraspherical polynomial gen¬ 
erating function. The primary importance of the Chebyshev polynomials is in numerical 
analysis. 


Generating Functions 


In Section 12.1 the generating function for the ultraspherical, or Gegenbauer, polynomials 


(1 — 2 xt + 1 2 ) 


7 2T7 = E C »“ ) Wt", |*| <1, |*|<1 


(13.92) 


was mentioned, with a = \ giving rise to the Legendre polynomials. In this section we first 
take a = 1 and then a — 0 to generate two sets of polynomials known as the Chebyshev 
polynomials. 
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Type II 

With a = 1 and C„ ] (x) — U n (x), Eq. (13.92) gives 

1 OO 

l-2xt + t 2 = ^ Unix)tn ’ |x|<1 ’ kl<L (13 ' 93) 

n =0 

These functions U n (x) generated by (1 — 2 xt + r 2 ) -1 are labeled Chebyshev polynomials 
type II. Although these polynomials have few applications in mathematical physics, one 
unusual application is in the development of four-dimensional spherical harmonics used in 
angular momentum theory. 
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We call T n (x) the type I Chebyshev polynomials. Note that the notation and spelling of the 
name for these functions differs from reference to reference. Here we follow the usage of 
AMS-55 (for the full reference see footnote 4 in Chapter 5). 

Differentiating the generating function (Eqs. (13.99)) with respect to t and multiplying 
by the denominator, 1 — 2 xt + / , we obtain 


—t — (t — x) 


T 0 (x) + 2j2 T n(x)t n 


n =1 


oo 

(l — 2 xt + t 2 ) y^n7), (x)t n ~ l 

n =1 
oo 

[» T „ t n ~ 1 - 2 xn T n t n + n T n t n+1 ], 

n= 1 


from which the recurrence relation 


T n +i(x) - 2xT n (x) + T n -\{x) = 0 


(13.100) 


follows by shifting the summation index so as to get the same power, t n , in each term and 
then comparing coefficients of t n . Similarly treating Eq. (13.93) we find 

~ i -2xt + t 2 2Xt + f2 ) 

n= 1 

from which the recursion relation 


U„+ i(x) - 2 xU n (x) + U n -\{x) — 0 (13.101) 

follows upon comparing coefficients of like powers of t (see Table 13.3). 

Then, using the generating functions for the first few values of n and these recurrence 
relations for the higher-order polynomials, we get Tables 13.4 and 13.5 (see also Figs. 13.5 
and 13.6). 

As with the Hermite polynomials. Section 13.1, the recurrence relations, Eqs. (13.100) 
and (13.101), together with the known values of 7o(x), T\(x), Uq(x), and Ui(x), provide a 
convenient — that is, for a computer — means of getting the numerical value of any T„(x o) 
or U„ (a'o), with .xp a given number. 


Table 13.3 Recursion relation” P n +\(x) — 
(A n x + Bn) P n (x) C n P n —i(x) 



Pn(x) 

An 

Bn 

Cn 

Legendre 

Pn(x ) 

2»+l 
/)+ 1 

0 

1 

n+1 

Chebyshev I 

T„(x) 

2 

0 

1 

Shifted Chebyshev I 

T*(x) 

4 

-2 

1 

Chebyshev II 

Unix) 

2 

0 

1 

Shifted Chebyshev II 

U*(x) 

4 

-2 

1 

Associated Laguerre 

L { n\x) 

_ 1 _ 

n+1 

2n+k+\ 

n+1 

n+k 

n+1 

Hermite 

Unix) 

2 

0 

2 n 


P n denotes any of the orthogonal polynomials. 
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Table 13.4 Chebyshev 
polynomials, type I 

7j, = 1 

T\=x 

T 2 = lx 1 - 1 

T 3 = 4x 3 - 3a 

T 4 = 8a 4 - 8a 2 + 1 

7b = 16 a 5 — 20a 5 + 5a 

T 6 = 32a 6 - 48a 4 + 18a 2 - 1 


Table 13.5 Chebyshev 
polynomials, type II 

U 0 = l 

U 1 = 2a 

U 2 = 4a 2 - 1 

U 3 = 8a 3 - 4a 

U 4 = 16a 4 - 12a 2 + 1 

t/5 = 32 a 5 — 32a 3 + 6a 

U 6 = 64a 6 - 80a 4 + 24a 2 - 1 



Figure 13.5 Chebyshev polynomials T n (x). 



Figure 13.6 Chebyshev polynomials U„(x). 
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Again, from the generating functions, we can obtain the special values of various poly¬ 
nomials: 


t„( i) = i, r„(-i) = (-i)" > 

72,. (0) = (-!)", 7 2n+ i(0) = 0; 


(13.102) 


£4(1) —n + \, U n {—\) = (—l)"(n + 1), 

UiniQ) = (-!)", t/2«+i(0) = 0. 


For example, comparing the power series 


1 - 1 2 
(1 ~t) 2 


1 + t 

1 -t 


Y( tn + f !+ i ) 

n= 0 


(13.103) 


with Eq. (13.99) for x — 1 gives T n (l), and for x — — 1 a similar expansion of (1 — f)/(l + 
t) gives T n (— 1), while replacing t -> —t 2 in the first power series yields 7„ (0). The power 
series for (1 ± t)~ 2 and (1 + f 2 ) -1 generate the corresponding f/„(±l), U n ( 0). 

The parity relations for T„ and U n follow from their generating functions, with the sub¬ 
stitutions t —> —t. x —> —x, which leave them invariant; these are 

T„(x) = (-l) n T„(-x), U n (x) = (-l) n U„(~x). (13.104) 


Rodrigues’ representations of T„(x) and U„ (x) are 

(—1)' 1 tt 1 / 2 (1 — x 2 ) 1 / 2 d n 


and 


T„(x) = 


U n {x) = 


^[(i-, 2 r 1/2 i 


2" (n — j)! dx 
(-!)"(« + l)7T 1/2 d 


:[(!-.x 2 )" +1/2 ]. 


2«+ 1 (n+ i)!(l -x 2 )U 2 dx 1 


(13.105) 


(13.106) 


Recurrence Relations — Derivatives 


Differentiation of the generating functions for 7„ (x ) and U„ (x) with respect to the variable 
x leads to a variety of recurrence relations involving derivatives. For example, from Eq. 
(13.99) we thus obtain 


OO 

(1 — 2 xt + 1 2 )2Y, T' n ix)t n 
n =1 


2 1 


T 0 (x) + 2j2^n(x)t n 


n =1 


from which we extract the recursion 


27„_ 1 (x) = T' n (x) - 2 xT;,_ 1 (x) + T'_ 2 (x), (13.107) 

which is the derivative of Eq. (13.100) for n —> n — 1. Among the more useful recursions 
we thus find are 


(1 - .r 2 )r,'(.r) = —nxT n (x) + nT n -\{x) 


(13.108) 
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and 

(1 - x 2 )U' n (x) = -nxU n (x) + (n + l)U n -i(x). (13.109) 

Manipulating a variety of these recursions as in Section 12.2 for Legendre polynomials one 
can eliminate the index n — 1 also in favor of T” and establish that T n (x), the Chebyshev 
polynomial type I, satisfies the ODE 

(1 - x 2 )T''(x ) - xT’ n {x) + n 2 T n (x) = 0. (13.110) 

The Chebyshev polynomial of type II, U n (x), satisfies 

(1 - x 2 )U”(x) - 3 xU' n (x) + n(n + 2)U„(x) = 0. (13.111) 

Chebyshev polynomials may be defined starting from these ODEs, but our emphasis has 
been on generating functions. 

The ultraspherical equation 

d 2 d 

(1 -x 2 )—jC^ a} (x) - (2a + l)x — Cl ol) (x) + n(n + 2a)C^ ) (x)=0 (13.112) 

dx z clx 

is a generalization of these differential equations, reducing to Eq. (13.110) for a — 0 and 
Eq. (13.111) fora = 1 (and to Legendre’s equation for a — 4). 


Trigonometric Form 


At this point in the development of the properties of the Chebyshev solutions it is beneficial 
to change variables, replacing x by cos0. With x — cos 6 and d/dx — (—1/sin 9)(d/dd), 
we verify that 


(l-, 2 ) 


d z T n d 2 T n 


■cot 6- 


dT n 


dx 2 dO 2 dO 

Adding these terms, Eq. (13.110) becomes 


xTL — — cot 0 


dT n 
dO ' 


—l +n 2 T n = 0, (13.113) 

the simple harmonic oscillator equation with solutions cos nO and sin nO. The special val¬ 
ues (boundary conditions at x = 0. 1) identify 


T n — cos nO — cos«(arccos x). 


(13.114a) 


A second linearly independent solution of Eqs. (13.110) and (13.113) is labeled 

V„ = sin n6 = sinn(arccos.r). (13.114b) 


The corresponding solutions of the type II Chebyshev equation, Eq. (13.111), become 


Un 

W„ 


sin(n + 1)0 
sin0 

cos(/r + 1)0 
sin0 


(13.115a) 


(13.115b) 
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The two sets of solutions, type I and type II, are related by 

V n (x)= (l-x 2 ) l/2 U„-i(x), (13.116a) 

W n (x) = (l-x 2 )~ l/2 T n+l (x). (13.116b) 

As already seen from generating functions, T n (x) and U n (x) are polynomials. Clearly, 
V„ (x) and W n (x ) are not polynomials. From 


T n (x) + i V n (x) = cos nO + i sin nO 

= (cos0 + tsin0)" = [jt + i(l - x 2 ) l,2 ] n , \x\ < 1 (13.117) 

we obtain expansions 

T n (x) = x n - Q x "“ 2 ( 1 - x 2 ) + ( 4 ) x "“ 4 ( 1 - x2 ) 2 - ' (13.118a) 


and 


V n (x) — y/l - X 2 


ft \ v n— 1 (ft \ v n—2> 

1 


5 (l-x 2 ) + . 


(13.118b) 


From the generating functions, or from the ODEs, power-series representations are 

(13.119a) 


[«/ 2 ] 

Tn{x)= n -Y,(-ft n 

m =0 


W- 2 - 


m\(n — 2 m)! 

for n > 1 , with [n/ 2 ] the largest integer below 11 /2 and 


[«/ 2 ] 

£/»(*) = E ( -D” 

m=0 


■(2x)"~ 2 ’". 


m\(n — 2 m)! 


(13.119b) 


Orthogonality 


If Eq. (13.110) is put into self-adjoint form (Section 10.1), we obtain w(x ) = (1 — x 2 ) -1 / 2 
as a weighting factor. For Eq. (13.111) the corresponding weighting factor is (1 — x 2 ) +l/ ' 2 . 
The resulting orthogonality integrals. 


/ I 

T m (x)T n (x)(l - x 2 )~ 1,Z dx = 

/ I 

V m {x)V n {x){\-x 2 )~ l/2 dx = 


10 , 

7r 

2 ’ 

7T, 

10 , 

7T 

2 ’ 

0 , 


m 7 ^ n , 
m = n/ 0 , 
m — n — 0 , 

m 7 ^ n , 
m = « / 0 , 
m — n — 0 , 


/ I 

f/ m (x)[/„(x)(l -x 2 ) 1/2 dx = 


(13.120) 


(13.121) 


(13.122) 
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and 

r * 

J i W m (x)W n (x)(l-x 2 ) 1/2 dx=jS m7 „, (13.123) 

are a direct consequence of the Sturm-Liouville theory. Chapter 10. The normalization 
values may best be obtained by using x = cos 6 and converting these four integrals into 
Fourier normalization integrals (for the half-period interval [0,7r]). 


Exercises 


13.3.1 


13.3.2 


13.3.3 


13.3.4 

13.3.5 

13.3.6 

13.3.7 


Another Chebyshev generating function is 


1 — xt 

1 — 2 xt + t 2 


n =0 


How is X„(x) related to T n (x) and U n (x)l 
Given 


1*1 < 1 . 


(l — x 2 )t/"(x) — 3xil' n (x) + n(n + 2 )U n {x) = 0, 
show that V n (x) (Eq. (13.116a)) satisfies 

(]-x 2 )V''(x)-x V' (x) + n 2 V n (x) = 0, 
which is Chebyshev’s equation. 

Show that the Wronskian of T n (x) and V„ (x ) is given by 

T„ (x) V' (x) - T’ n (X) V n (x) = - n . 

(1 — X-) 

This verifies that T„ and V n (n ^ 0) are independent solutions of Eq. (13.110). Con¬ 
versely, for n = 0, we do not have linear independence. What happens at n = 0? Where 
is the “second” solution? 

Show that W n (x) — (1 — x 2 )~ 1 ^ 2 T n+ i(x) is a solution of 

(1 — x 2 ) W”(x) — 3x W' n (x) + n(n + 2)W„(x) = 0. 

Evaluate the Wronskian of U„{x) and W n (x) — (1 — x 2 ) _ 1 / 2 r„ + i(x). 

V„(x) = (1 - x 2 )V 2 U„-i(x) is not defined for n = 0. Show that a second and inde¬ 
pendent solution of the Chebyshev differential equation for 7„ (x) (n = 0) is Vo(x) = 
arccosx (or arcsinx). 

Show that Vn (x) satisfies the same three-term recurrence relation as 7„ (x) 
(Eq. (13.100)). 


13.3.8 


Verify the series solutions for T n (x) and U„ (x) (Eqs. (13.109a) and (13.119b)). 
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13.3.9 


13.3.10 


13.3.11 


13.3.12 


13.3.13 


13.3.14 


Transform the series form of T n (pc), Eq. (13.119a), into an ascending power series. 


ANS. T ln (x) = (-\) n nY j (-\) n 


m =0 


(n + m — 1 )! 
(n — m)\(2m)\ 


(2x) 2 "', n> 1 , 


T ln+ i(x) 


= ?n + l y. (—l) m+ "(w + m)! 2m+1 

2 ^ (n - m)\(2m + \)\ K 

m =0 


Rewrite the series form of JJ n (x), Eq. (13.119b), as an ascending power series. 


ANS. U 2n (x) = (-1)" ^(-1)" 


m =0 


(n + m)\ 

(n — m)!( 2 m)! 

(n + m + 1 )! 


(2x) 2m , 


(2x) 


2 m+l 


U 2 n+dx) = (-1)" £(-D -- — 

L —' (n — m)\(2m + 1)! 

m=0 

Derive the Rodrigues representation of T n (x), 

2 "(n — j)! 

Hint. One possibility is to use the hypergeometric function relation 

2 T] (a, fo; c; z) = (1 - z) _fl 2^1 (a,c-b\c\ ’ 

with z— (I — x)/2. An alternate approach is to develop a first-order differential equation 
for y — (1 — x 2 )” -1 / 2 . Repeated differentiation of this equation leads to the Chebyshev 
equation. 

(a) From the differential equation for T„ (in self-adjoint form) show that 
1 dT m (x) dT n (x) . 2 \ 1/2 


/_ 


(1 — x 2 )*^“ dx = 0 , 

/_i dx dx 
(b) Confirm the preceding result by showing that 


m y n. 


dT n (x) 

dx 


= nU n -\(x). 


The 


expansion of a power of x in a Chebyshev series leads to the integral 


-s: 


x m T n (x) 


dx 


vT 


a) Show that this integral vanishes for m < n. 

b) Show that this integral vanishes for m + n odd. 


Evaluate the integral 


-jC 


x m T n (x) 


dx 


vr 


or m > n and m + n even by each of two methods: 
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(a) Operate with x as the variable replacing T n by its Rodrigues representation. 

(b) Using x = cos 6 transform the integral to a form with 0 as the variable. 

m ! (m — n — 1 )!! 

ANS. I mn — jt -, m > n, m + n even. 

(m — n)\ (m + n)!! 

13.3.15 Establish the following bounds, — 1 < x < 1: 

(a) \U n (x)\ < n + 1, (b) — '-T„(x ) <n 2 . 

ax 

13.3.16 (a) Establish the following bound, — 1 < x < 1: \V n (x)\ < 1. 

(b) Show that W n (x) is unbounded in —1 < x < 1. 

13.3.17 Verify the orthogonality-normalization integrals for 

(a) T m (x), T n (x), (b) V m (x), V n (x), 

(c) u m (x), Unix), (d) W m (x), Wnix). 

Hint. All these can be converted to Fourier orthogonality-normalization integrals. 

13.3.18 Show whether 

(a) T m (x) and V„(x) are or are not orthogonal over the interval [—1, 1] with respect 
to the weighting factor (1 — x 2 ) -1 / 2 . 

(b) U m (x) and W n (x) are or are not orthogonal over the interval [—1, 1] with respect 
to the weighting factor (1 — x 2 ) 1 / 2 . 

13.3.19 Derive 


(a) T n+l (x)+T n _ l ( X )=2xT n (x), 

(b) T m+n (x) + r,„_„ (x) = 2 T m ix)T„ (x), 


from the “corresponding” cosine identities. 

13.3.20 A number of equations relate the two types of Chebyshev polynomials. As examples 
show that 


T n (x) = Unix) - xU n - l(x) 


and 

13.3.21 Show that 


(i -x 2 )[/„(x) = xr„+i(x) - r„ + 2 (x). 

dv n ix) T„ix) 

-= —n 

ax VI - x 2 


(a) using the trigonometric forms of V„ and T n , 

(b) using the Rodrigues representation. 
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13.3.22 Starting with x = cos 6 and T n (cos 0) — cos n6, expand 


e w + e ~ wx k 


and show that 


x A = 


2 k ~ l 


Tk(x) + ( t ) T k - 2 (x) + ( 0 I T k -4 + • 


the series in brackets terminating with ( * ) 7) (x) for k — 2m + 1 or ^ ( *) Tq for k — 2m. 

13.3.23 (a) Calculate and tabulate the Chebyshev functions V\ (x), Vi(x), and Vi(x) for x — 

-1.0(0.1)1.0. 

(b) A second solution of the Chebyshev differential equation, Eq. (13.100), for 
n = 0 is y(x) — sin~' .t. Tabulate and plot this function over the same range: 
-1.0(0.1)1.0. 

13.3.24 Write a computer program that will generate the coefficients a s in the polynomial form 
of the Chebyshev polynomial T n (x) — ^" =0 a s ;c s . 

13.3.25 Tabulate 'l'\o(x) for 0.00(0.01)1.00. This will include the five positive roots of 7)o• If 
graphics software is available, plot your results. 


13.3.26 Determine the five positive roots of T\q{x) by calling a root-finding subroutine. Use 
your knowledge of the approximate location of these roots from Exercise 13.3.25 or 
write a search routine to look for the roots. These five positive roots (and their negatives) 
are the evaluation points of the 10-point Gauss-Chebyshev quadrature method. 

Check values, x/. = cos[(2k — 1 )tt/20], k — 1,2,3,4,5. 

13.3.27 Develop the following Chebyshev expansions (for [—1, 1]): 


(a) 

(b) 


,V /2 = i 

IT 


0 < x < 1 
-1 < x < 0 


1 - 


2^(4 S 2 -1) 1 T 2s (x) 

5 = 1 


4 

IT 


£(-!)'(2* + l)- 1 r 2i+ i(x). 

s =0 


13.3.28 (a) For the interval [—1, 1] show that 




5 = 1 


;+ i (2s — 3)!! 
(25+2)!! 


(45 + l)P 2 s(x) 


2 4 L 1 

5 = 1 


(b) Show that the ratio of the coefficient of Tt, (x) to that of Pisix ) approaches (7T5) -1 
as 5 —> oo. This illustrates the relatively rapid convergence of the Chebyshev se¬ 
ries. 
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Hint. With the Legendre recurrence relations, rewrite xP n (x) as a linear combination 
of derivatives. The trigonometric substitution x — cos 0. T n (x) = cos nO is most helpful 
for the Chebyshev part. 


13.3.29 Show that 


7r- 


l+2^(4, 2 -l)- 2 . 

j=i 


Hint. Apply Parseval’s identity (or the completeness relation) to the results of Exer¬ 
cise 13.3.28. 

13.3.30 Show that 


(a) cos 1 x 

(b) sin _1 x 


A 00 1 

Tt 4 ^—> 1 

A / , 7Tj I TT? ^2n+l (•*)• 

2 n z —' ( 2 n + 1 )- 

n =0 

4 ~ 1 

tt^ (2n + iy- T2n+l(Xl 

n —0 


13.4 Hypergeometric Functions 

In Chapter 9 the hypergeometric equation 10 


x(l — x)y"{x) + [c — (a + b + l)x\y f (x) — ab y(x) — 0 


(13.124) 


was introduced as a canonical form of a linear second-order ODE with regular singularities 
at x = 0. 1, and oo. One solution is 


y(x) = 2 F\ (a , b\ c; *) 


= 1 + 


a ■ b x a{a + 1 )b(b + 1 ) x 2 


1 ! 


2 ! 


+ • 


c ^ 0, —1, —2, —3,..., 


c(c + 1) 

(13.125) 

which is known as the hypergeometric function or hypergeometric series. The range of 
convergence for c > a + b is x < 1 and x = 1, and is x = — 1 for c > a + b — 1. In terms 
of the often-used Pochhammer symbol, 

(a + n — 1)! 


( a) n = a(a + l)(fl + 2 ) • • • (a + n — 1 ) = 


(a — 1 )! 


(fl)o = 1, 

the hypergeometric function becomes 


2 -Fi {a, b\ c; x) — 


n =0 


(a)n (b)n x n 
(c)„ n\ 


(13.126) 


(13.127) 


l0 This is sometimes called Gauss’ ODE. The solutions then become Gauss functions. 
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In this form the subscripts 2 and 1 become clear. The leading subscript 2 indicates that 
two Pochhammer symbols appear in the numerator and the final subscript 1 indicates one 
Pochhammer symbol in the denominator. 11 (The confluent hypergeometric function i F\ 
with one Pochhammer symbol in the numerator and one in the denominator appears in 
Section 13.5.) 

From the form of Eq. (13.125) we see that the parameter c may not be zero or a negative 
integer. On the other hand, if a or h equals 0 or a negative integer, the series terminates and 
the hypergeometric function becomes a polynomial. Many more or less elementary func¬ 
tions can be represented by the hypergeometric function. 12 Comparing the power series we 
verify that 


ln(l +x) = x 2 Fi(1, 1; 2; -x). (13.128) 

For the complete elliptic integrals K and E, 

K(k 2 ) = J ' {l-k 2 sm 2 e)~ ll2 de = ^2Fi(^-,l;k 2 \ (13.129) 

E(k 2 ) = jT /2 (l - k 2 sm9) 1/2 d0 = | 2 Fi Q, - 1 ; 1; k 2 ^. (13.130) 

The explicit series forms and other properties of the elliptic integrals are developed in 
Section 5.8. 

The hypergeometric equation as a second-order linear ODE has a second independent 
solution. The usual form is 

y(x) = x 1 ~ c 2 Fi(a + l-c,b+l-c;2-c;x), 2,3,4 . (13.131) 


If c is an integer either the two solutions coincide or (barring a rescue by integral a or 
integral b) one of the solutions will blow up (see Exercise 13.4.1). In such a case the 
second solution is expected to include a logarithmic term. 

Alternate forms of the hypergeometric ODE include 

(1 “ * 2) h y (cr) - [<»+ b +- <«+ b + 1 - 2c) l sH 1 ?) 



c-A^.v(A 


(2a + 2b + l)z + 


1 -2c' 


—y (z 2 ) - 4ab y(z 2 ) = 0. (13.133) 


11 The Pochhammer symbol is often useful in other expressions involving factorials, for instance, 

oo 

(l- Z r a = J2^nZ n / n U \Z\ < 1 . 
n=0 


12 With three parameters, a, b, and c, we can represent almost anything. 
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Contiguous Function Relations 

The parameters a, b , and c enter in the same way as the parameter n of Bessel, Legendre, 
and other special functions. As we found with these functions, we expect recurrence rela¬ 
tions involving unit changes in the parameters a, b , and c. The usual nomenclature for the 
hypergeometric functions, in which one parameter changes by + or —1, is a “contiguous 
function.” Generalizing this term to include simultaneous unit changes in more than one 
parameter, we find 26 functions contiguous to 2 +1 ( u , /;; c; x). Taking them two at a time, 
we can develop the formidable total of 325 equations among the contiguous functions. One 
typical example is 

(1 a — b){c(a + b — 1) + 1 — a 2 — b 2 + [(a — b) 2 — l](1 — x)} 2+1 (a, b\ c; x) 

= (c — a)(a — b + 1 )b 2+1 (a — 1, b + 1; c; x) 

+ (c - b)(a -b-l)a 2 F l (a +l,b-l;c; x). (13.134) 

Another contiguous function relation appears in Exercise 13.4.10. 


Hypergeometric Representations 


Since the ultraspherical equation (13.112) in Section 13.3 is a special case of Eq. (13.124), 
we see that ultraspherical functions (and Legendre and Chebyshev functions) may be ex¬ 
pressed as hypergeometric functions. For the ultraspherical function we obtain 

o 07+28)! / l-x\ 

C " (X) = 2 Pnlfil 2Fl \~ H,n + 2/ * + 1: 1 +^ ; 2 ) < 13 - 135 ) 

upon comparing its ODE with Eq. (13.124) and the power-series solutions. For Legendre 
and associated Legendre functions we find similarly 


P?i (x) = 2 F 1 1 -n, n + 1; 1; 


1 — x 


CW = 


( n+m)\ (1 -JC 2 )"'/ 2 


(n — m)\ 2 m m\ 

Alternate forms are 

P2n(x) = (-l) 


2+1 ( m — n , m + n + 1; m + 1; 


, 1 1 

2+1 —n, n + -;-;x 


1 — x 


n ( 2 ”)! 

2 2n n\n\ 


= (-D 


Pln+l(x) = (-1) 


= (-D 


n (2n — 1 )!! 

(2 n)U 
n ( 2 n + 1 )! 
2 2,, n\n\ 

n (2n + I)!! 
(2n)H 


2 2 

, 11 z . 

+i( -«,« + -; -;x ), 

, 33 z . 

2 + 1 1 -77,u + -;x ]x 


, 3 3 

2+1 | -77 , 77 + -I ~\X 


(13.136) 

(13.137) 


(13.138) 


x. 


(13.139) 
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In terms of hypergeometric functions, the Chebyshev functions become 

/ 1 1 — x\ 

T n {x) = 2-^1 (—«, n; —-— J, (13.140) 

Unix) = (n + 1) 2 Fi ^—n, n+2\ (13.141) 

V„(x) = nVl-x 2 2 Fi {-n + 1 , n + 1 ; (13.142) 

The leading factors are determined by direct comparison of complete power series, com¬ 
parison of coefficients of particular powers of the variable, or evaluation at x — 0 or 1 , and 
so on. 

The hypergeometric series may be used to define functions with nonintegral indices. The 
physical applications are minimal. 


Exercises 


13.4.1 (a) For c, an integer, and a and b nonintegral, show that 

2 F\{a, b; c; x) and x l ~ c 2 Fi(a + 1 — c, b + 1 — c; 2 — c; x) 

yield only one solution to the hypergeometric equation. 

(b) What happens if a is an integer, say, a — — 1, and c = —21 

13.4.2 Find the Legendre, Chebyshev I, and Chebyshev II recurrence relations corresponding 
to the contiguous hypergeometric function Eq. (13.134). 

13.4.3 Transform the following polynomials into hypergeometric functions of argument x 2 . (a) 
T 2n (x ); (b)x _1 72„+i(x); (c) U 2n (x); (d) x~ l U 2fl+1 (x). 

ANS. (a) T ln (x) = (-1)" 2 Fi(—n, n; \\x 2 ). 

(b) x~ l T 2n+ i(jc) = (-l)"(2n + 1) 2 Fi(— n, n + 1; x 2 ). 

(c) U 2n (x) = (-1)" 2 Fi(-n,n + 1; \\ x 2 ). 

(d) x~ l U 2n+ i(x) = (—l)"(2n + 2) 2 Fi(-n,n + 2; x 2 ). 

13.4.4 Derive or verify the leading factor in the hypergeometric representations of the Cheby¬ 
shev functions. 


13.4.5 Verify that the Legendre function of the second kind, Q v (z), is given by 


Qviz) = 


\z\ > 1 , 


7r 1 / 2 v! / v 1 v v 

lF \2 + ~ 2'~2 + 1 '2 + r Z 

|argz|< 7 r, v ± — 1, — 2, — 3,... 


(v + i)!(2 z) v+1 


-2 


13.4.6 Analogous to the incomplete gamma function, we may define an incomplete beta func¬ 
tion by 


B x (a, b) = 


f 

Jo 
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Show that 


B x (a,b)—a l x a 2 F\{a. 1 — b\ a + 1; x). 

13 . 4.7 Verify the integral representation 

2 F l (a,b\c;z) = ^ — — f t b ~ l {\ - - tz)~ a dt. 

T{b)T{c-b) J o 

What restrictions must be placed on the parameters b and c and on the variable z? 
Note. The restriction on |z| can be dropped — analytic continuation. For nonintegral a 
the real axis in the "-plane from 1 to oo is a cut line. 

Hint. The integral is suspiciously like a beta function and can be expanded into a series 
of beta functions. 


ANS. 91(c) > mb) > 0, and |z| < 1. 


13 . 4.8 Prove that 


2 F l (a,b\c\ 1) = 


T(c)T(c — a — b) 
T(c — a)T(c — b) ’ 


c 0, — 1, — 2,... c>a + b. 


Hint. Here is a chance to use the integral representation. Exercise 13.4.7. 


13 . 4.9 Prove that 


2 F\{a, b\ c\ x) — (1 — x) a 2 F\ c — b;c\ - —— V 

Hint. Try an integral representation. 

Note. This relation is useful in developing a Rodrigues representation of 7„ (v) (compare 
Exercise 13.3.11). 

13.4.10 Verify that 

j, , , n (c~b) n 

2 F\{-n,b\ c; 1) = ———. 

(c)n 

Hint. Here is a chance to use the contiguous function relation [2 a — c + (b — «)v] • 
2 F\(a, b; c; x) — a(\ — x) 2 F\(a + 1, b\ c; x) — (c — a) 2 F\(a — 1, b; c; x) and mathe¬ 
matical induction. Alternatively, use the integral representation and the beta function. 


13.5 Confluent Hypergeometric Functions 


The confluent hypergeometric equation 13 


xy" (x) + (c — x)y'{x) — ay{x) — 0 


(13.143) 


13 This is often called Rummer’s equation. The solutions, then, are Rummer functions. 
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has a regular singularity at A' = 0 and an irregular one at x — oo. It is obtained from the hy¬ 
pergeometric equation of Section 13.4 by merging (by hand: x(l — x) —>• x in Eq. (13.124)) 
two of the latter’s three singularities. One solution of the confluent hypergeometric equa¬ 
tion is 


y(x) = iFi ( a ; c; x) — M(ci, c, x) 

ax a (a + 1) x 2 

— 1 ~F-+-+ ■ 

c 1! c(c+ 1) 2! 


c^O,-1,-2,.... (13.144) 


This solution is convergent for all finite x (or complex z). In terms of the Pochhammer 
symbols, we have 


M(a, c, x) 


oo 


E 

n =0 


( a)n x n 
( c)n n\ 


(13.145) 


Clearly, M(a,c,x ) becomes a polynomial if the parameter a is 0 or a negative integer. 
Numerous more or less elementary functions may be represented by the confluent hyper¬ 
geometric function. Examples are the error function and the incomplete gamma function 
(from Eq. (8.69)): 


erf(x) = 



2 

^72 


xM 



y(a,x) 


Jo 


dt—a 1 x“M(a,a + l,—x), 


(13.146) 
JH(fl) > 0. (13.147) 


Clearly, this coincides with the first solution for c — a. The error function and the incom¬ 
plete gamma function are discussed further in Section 8.5. 

A second solution of Eq. (13.143) is given by 

y(x) = x l ~ c M(a+ 1 -c,2-c,x), 2,3,4,.... (13.148) 


The standard form of the second solution of Eq. (13.143) is a linear combination of 
Eqs. (13.144) and (13.148): 


U(a, c, x) = — 


ix 


sin zee 


M(a , c, x) 

(a — c)!(c — 1)! 


,1-c 


M(a + 1 — c, 2 — c, x) 
( fl -l)!(l-c)! 


(13.149) 


Note the resemblance to our definition of the Neumann function, Eq. (11.60). As with our 
Neumann function, Eq. (11.60), this definition of U(a, c, x) becomes indeterminate in this 
case for c an integer. 

An alternate form of the confluent hypergeometric equation that will be useful later is 
obtained by changing the independent variable from x to x 2 : 


dx 2 


y{* 2 ) + 


'2c- 1 

X 



— y(x 2 ) - 4ay(x 2 ) — 0. 


(13.150) 


As with the hypergeometric functions, contiguous functions exist in which the para¬ 
meters a and c are changed by ±1. Including the cases of simultaneous changes in the 
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two parameters, 14 we have eight possibilities. Taking the original function and pairs of the 
contiguous functions, we can develop a total of 28 equations. 15 


Integral Representations 


It is frequently convenient to have the confluent hypergeometric functions in integral form. 
We find (Exercise 13.5.10) 


M(a, c, x ) = 


_[X£)- f 1 e xt t c-l 

r(fl)r(c-a) J 0 


(1 - dt, JH(c) > JH(fl) > 0, 


(13.151) 


i r°° 

U (a, c, x) — - / e~ x 't a -\l + t) c ~ a ~ 1 dt, M(x)>0< M(a) > 0. 

r (a) Jo 


(13.152) 


Three important techniques for deriving or verifying integral representations are as fol¬ 
lows: 


1. Transformation of generating function expansions and Rodrigues representations: The 
Bessel and Legendre functions provide examples of this approach. 

2. Direct integration to yield a series: This direct technique is useful for a Bessel function 
representation (Exercise 11.1.18) and a hypergeometric integral (Exercise 13.4.7). 

3. (a) Verification that the integral representation satisfies the ODE. (b) Exclusion of 
the other solution, (c) Verification of normalization. This is the method used in Sec¬ 
tion 11.5 to establish an integral representation of the modified Bessel function K v (z). 
It will work here to establish Eqs. (13.151) and (13.152). 


Bessel and Modified Bessel Functions 

Kummer’s first formula, 

M(a, c, x) — e x M(c — a , c, —x ), (13.153) 

is useful in representing the Bessel and modified Bessel functions. The formula may be ver¬ 
ified by series expansion or by use of an integral representation (compare Exercise 13.5.10). 

As expected from the form of the confluent hypergeometric equation and the character 
of its singularities, the confluent hypergeometric functions are useful in representing a 
number of the special functions of mathematical physics. For the Bessel functions, 

J v (x) = 

whereas for the modified Bessel functions of the first kind, 

,2v+l,2x). (13.155) 


I v (x)=—[ - 


M\v+- 


x\ ( 1 

— I M\v+ -,2v+ \,2ix 


(13.154) 


14 Slater refers to these as associated functions. 

1 "The recurrence relations for Bessel, Hermite, and Laguerre functions are special cases of these equations. 
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Hermite Functions 

The Hermite functions are given by 

Hinix) = (-1 )"~r M ( -n ’ \ ’ x2 )’ (13.156) 

,, 2{2n + 1)! / 3 ,\ 

H 2 n+\(x) = (—1) —— ~\ — —xMl—n, -,x 2 J, (13.157) 

using Eq. (13.150). 

Comparing the Laguerre ODE with the confluent hypergeometric equation (13.143), we 
have 

L n {x) = M{—n, 1, x). (13.158) 

The constant is fixed as unity by noting Eq. (13.66) for x — 0. For the associated Laguerre 
functions, 

d m (n tyi )^ 

L;"(x) = (-l) w — L n+m (x)= 1,jc). (13.159) 

dx m n\m\ 

Alternate verification is obtained by comparing Eq. (13.159) with the power-series so¬ 
lution (Eq. (13.72) of Section 13.2). Note that in the hypergeometric form, as distinct from 
a Rodrigues representation, the indices n and m need not be integers, and, if they are not 
integers, L 1 " (x) will not be a polynomial. 

Miscellaneous Cases 

There are certain advantages in expressing our special functions in terms of hypergeomet¬ 
ric and confluent hypergeometric functions. If the general behavior of the latter functions is 
known, the behavior of the special functions we have investigated follows as a series of spe¬ 
cial cases. This may be useful in determining asymptotic behavior or evaluating normaliza¬ 
tion integrals. The asymptotic behavior of M(a, c, x) and U(a, c, x) may be conveniently 
obtained from integral representations of these functions, Eqs. (13.151) and (13.152). The 
further advantage is that the relations between the special functions are clarified. For in¬ 
stance, an examination of Eqs. (13.156), (13.157), and (13.159) suggests that the Laguerre 
and Hermite functions are related. 

The confluent hypergeometric equation (13.143) is clearly not self-adjoint. For this and 
other reasons it is convenient to define 

M k ^x)=e~ x/2 x IJ - +l/2 M( f jL-k+^,2n+l,x\ (13.160) 

This new function, M^^ix), is a Whittaker function that satisfies the self-adjoint equation 

„ (l k I - M 2 \ 

+ (-4 + 7 + ^T~ = 0- (13-161) 

The corresponding second solution is 

W k/x (x) = e~ x/2 x fl+1/2 u(iJi-k+^, 2n+l,x\ (13.162) 
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Exercises 

13 . 5.1 

13 . 5.2 

13 . 5.3 


13 . 5.4 

13 . 5.5 

13 . 5.6 


13 . 5.7 

13 . 5.8 


Verify the confluent hypergeometric representation of the error function 


erf(.v) = 


2x 


n 


1/2 


, 1 3 
Ml -, -, — x“ 
’ 2 2 


Show that the Fresnel integrals C(x) and S(x) of Exercise 5.10.2 may be expressed in 
terms of the confluent hypergeometric function as 

/I 3 inx 2 

C(x) + iS(x) = xM[ - 


2 2 2 

By direct differentiation and substitution verify that 


y = ax 


1 ( e 1 t a 1 dt = 

Jo 


ax a y(a,x ) 


satisfies 


xy" + {a + 1 + x)y’ + ay — 0. 

Show that the modified Bessel function of the second kind, K v (x), is given by 

K v (x) = 7V l/2 e- x (2x) v u(v + ^,2v + 1 , 2jc 

Show that the cosine and sine integrals of Section 8.5 may be expressed in terms of 
confluent hypergeometric functions as 

Ci(x) + i si(jc) = —e ,x U( 1, 1, — ix). 

This relation is useful in numerical computation of Ci(x) and si(v ) for large values of x. 

Verify the confluent hypergeometric form of the Hermite polynomial Ih n +\ (v) 
(Eq. (13.157)) by showing that 


(a) H 2 n+i(x)/x satisfies the confluent hypergeometric equation with a — 

and argument x 2 , 

H 2 n +i(x) 2(2n + 1)! 

(b) hm-= (-l) - t-■ 

. y —^0 x n ! 


-n,c = 


Show that the contiguous confluent hypergeometric function equation 

(c — a)M(a — 1, c, x) + (2 a — c + x)M(a, c, x) — aM{a + 1, c, x) — 0 
leads to the associated Laguerre function recurrence relation (Eq. (13.75)). 
Verify the Kummer transformations: 


(a) M(a,c,x) — e x M{c — a,c, —x) 

(b) U ( a, c, x) — x l ~ c U(a — c + 1,2 — c, x). 


MU) 
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13.5.9 Prove that 

(a) - M(a,c,x) — — -M(a + n,b + n, x), 

dx n ( b) n 

d n 

(b) - U (a, c, x) — (—1 ) n (a) n U(a + n, c + n,x). 

dx" 

13.5.10 Verify the following integral representations: 


(a) 

(b) 


M(a, c, x ) 
l ( a , c, x) — 


r (c) 


r(fl)r(c — a) 
1 r°o 


[' e x, t“- '(\ - 

Jo 


t) c ~ a ~ l dt, IH(c) > IH(fl) > 0. 


r (a) 


f 


e- x, t a -\\ + tf- a ~ l dt, IH(x) > 0, IH(a) > 0. 


Under what conditions can you accept SH(x) = 0 in part (b)? 

13.5.11 From the integral representation of M(a, c, x). Exercise 13.5.10(a), show that 

M(a, c, = e x M(c — a , c, —x). 

Hint. Replace the variable of integration t by 1 — s to release a factor e x from the 
integral. 

13.5.12 From the integral representation of U(a, c, x), Exercise 13.5.10(b), show that the expo¬ 
nential integral is given by 

Ei(x) = e~ x U(l, l,x). 


Hint. Replace the variable of integration t in E\ (x) by x(l + 5 ). 


13.5.13 From the integral representations of M(a, c, x) and U (a, c, x) in Exercise 13.5.10 de¬ 
velop asymptotic expansions of 
(a )M(a,c,x), (b) U(a, c, x). 

Hint. You can use the technique that was employed with K v (z), Section 11.6. 


ANS. (a) 


F(c) e- v 

r(a) x c ~ a 


(1 — a)(c — a) 

1 H---- + 

V.x 


(1 — a)(2 — a)(c — a)(c — a + 1) 

2 !^ + 


13.5.14 


1 fl(l + a —c) a(a + 1)(1 + a — c)(2 + a — c) j 
x a 1!(— x) 2\(—x) 2 f 

Show that the Wronskian of the two confluent hypergeometric functions M (a. c, x) and 
U(a, c, x) is given by 


MU’ - M’U = - 


(c- 1)! e Y 
(a — 1)! x c ' 


What happens if a is 0 or a negative integer? 
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13 . 5.15 


The Coulomb wave equation (radial part of the Schrodinger equation with Coulomb 
potential) is 


cry 
dp 2 


+ 


2/7 L(L + 1) 


y = 0. 


Show that a regular solution y — p ) is given by 

Fl(v, p) — CL(r])p L+l e~ lp M(L + 1 - iip 2L + 2, lip). 


13 . 5.16 (a) Show that the radial part of the hydrogen wave function, Eq. (13.81), may be writ¬ 

ten as 


13 . 5.17 


e- ar ' 2 (ar) L Ll L+ L '_ ] (ar) 

(n + L)\ 

~ (n — L — 1)!(2L + 1)! 


e~ ar,2 {ar) L M(L + 1 - n, 2L + 2, ar). 


(b) It was assumed previously that the total (kinetic + potential) energy E of the elec¬ 
tron was negative. Rewrite the (unnormalized) radial wave function for the free 
electron, E > 0. 


ANS. e lar l 2 (ur) L M(L + 1 — in,2L + 2, —iar), outgoing wave. 
This representation provides a powerful alternative tech¬ 
nique for the calculation of photoionization and recombina¬ 
tion coefficients. 

Evaluate 


r°° r°° t c i x 

(a) / [M klJ ,(x)]~ dx, (b) / [M^C*)]" —, 

Jo Jo x 

r °°r i 2 dx 

(c) h [M kll (x)] 

where 2/r = 0,1, 2 ,.. ., k — p, — | = 0, 1, 2 ,... , a > —2p — 1 . 

ANS. (a) (2/x)!2 k. (b) (2/r)!. (c) {2pc)\{2k) a . 


13.6 Mathieu Functions 

When PDEs such as Laplace’s, Poisson’s, and the wave equation are solved with cylin¬ 
drical or spherical boundary conditions by separating variables in polar coordinates, we 
find radial solutions, which are the Bessel functions of Chapter 11, and angular solutions, 
which are sin nup, cos nup in cylindrical cases and spherical harmonics in spherical cases. 
Examples are electromagnetic waves in resonant cavities, vibrating circular drumheads, 
and coaxial wave guides. 

When in such cylindrical problems the circular boundary condition becomes elliptical 
we are led to the angular and radial Mathieu functions, which, therefore, might be called 
elliptic cylinder functions. In fact, in 1868 Mathieu developed the leading terms of series 
solutions of the vibrating elliptical drumhead, and Whittaker and others in the early 1900s 
derived higher-order terms as well. 
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Here our goal is to give an introduction to the rich and complex properties of Mathieu 
functions. 


Separation of Variables in Elliptical Coordinates 


Elliptical cylinder coordinates r /, z, which are appropriate for elliptical boundary condi¬ 

tions, are expressed in rectangular coordinates as 

x = ccosh£ cos t}, y = csinhf sin?;, z = Z, (13.163) 


0 < f < oo, 0 <i)< 2 tt, 


where the parameter 2c > 0 is the distance between the foci of the confocal ellipses de¬ 
scribed by these coordinates (Fig. 13.7). We want to show that in the limit c -> 0 the foci 
of the ellipses coalesce to the center of circles. We work at constant "-coordinate mostly, 
z — 0, say. Indeed for fixed radial variable £ =const. we can eliminate the angular variable 
i] to obtain from Eq. (13.163) 


+ 


c 2 cosh" § c 2 sinh" § 


= 1 , 


(13.164) 


describing confocal ellipses centered at the origin of the x, y-plane with major and minor 
half-axes 


a = ccosh£, b — c sinh (13.165) 

respectively. Since 

-=tanh£= /l- 4 - = y/l -e 2 , (13.166) 

a V cosh 2 f 

the eccentricity e — 1 / cosh § of the ellipse with 0 < e < 1, and the distance between the 
foci 2 ae = 2c, providing a geometrical interpretation of the radial coordinate § and the 
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parameter c. As § oo, e -> 0 and the ellipses become circles, which is indicated in 
Fig. 13.7. As § -> 0, the ellipse becomes more elongated until, at £ — 0, it has shrunk to 
the line segment between the foci. 

When t] =const. we eliminate f to find confocal hyperbolas 


c 2 cos 2 Tj c 2 sin 2 vj 


= 1 , 


(13.167) 


which are also plotted in Fig. 13.7. Differentiating the ellipse, we obtain 


xdx ydy 

H —-—— 0, 


cosh 2 £ sinh 2 § 


(13.168) 


which means that the tangent vector (dx, dy) of the ellipse is perpendicular to the vector 


cosh 2 £ ’ sinh 2 f 


). For the hyperbola the orthogonality condition is 


x dx ydy 
cos 2 r] sin 2 r) 


(13.169) 


so the scalar product of the ellipse and hyperbola tangent vectors at each of their intersec¬ 
tion points ( x, y ) of Eq. (13.163) obey 


y 


cosh“ £ cos 2 i] sinfr £ sin~ ?; 


= c 2 — c 2 = 0. 


(13.170) 


This means that these confocal ellipses and hyperbolas form an orthogonal coordinate 
system, in the sense of Section 2.1. To extract the scale factors h^, h n from the differentials 
of the elliptical coordinates 


dx — csinhf; cos rjd^ — ccosh£ sin rjdr], 
dy — c cosh £ sin rj d^ + c sinh £ cos r/dr/, 


(13.171) 


we sum their squares, finding 

dx 2 + dy 2 = c 2 (sinh 2 £ cos 2 ;; + cosh 2 | sin 2 ?;)(<7| 2 + </?; 2 ) 

= c 2 (cosh 2 $ - cos 2 rj) {df + di] 2 ) = h\ df + h 2 drf (13.172) 

and yielding 

h% = h tl — c(cosh 2 § — cos 2 ?;) 1/, “. (13.173) 

Note that there is no cross term involving d £ dr/, showing again that we are dealing with 
orthogonal coordinates. 

Now we are ready to derive Mathieu’s differential equations. 
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Example 13 . 6.1 elliptical drum 


We consider vibrations of an elliptical drumhead with vertical displacement z = z(x, y, t ) 
governed by the wave equation 


3 2 z d 2 z 1 3 2 z 
dx 2 3y 2 v 2 3 1 2 ’ 


(13.174) 


where the velocity squared v 2 — T/p with tension T and mass density p is a constant. We 
first separate the harmonic time dependence, writing 


z(x, y, t) — u(x, y)w(t ), 


(13.175) 


where w(t) — cos(o rt + 8), with co the frequency and 8 a constant phase. Substituting this 
function z into Eq. (13.174) yields 


1/3 2 u d 2 u\ 1 d 2 w a> 2 2 

u Va^2 + ^2 J = = = ~ ” = cons t- 


(13.176) 


that is, the two-dimensional Helmholtz equation for the displacement u. We now use Eq. 
(2.22) to convert the Laplacian V 2 to the elliptical coordinates, where we drop the z- 
coordinate. This gives 


3 2 u 3 2 u 2 1 / 3 2 u 3 2 u\ 
3^2 + 3^ + k ~ U = h 2 V W + 3^ ) 


+ k 2 u — 0, 


that is, the Helmholtz equation in elliptical rj coordinates, 


3“M 3"M 


—r- + —— + C 2 (cosh- § - cos 2 r])u = 0. 
3§- 3?? z 


Lastly, we separate § and ip writing m(|, rj) = which yields 


1 d 2 R 

~R~d^ 2 


+ c 2 k 2 cosh 2 f = c 2 k 2 cos 2 — 


1 d 2 <$> 

~r~P~T — / + 
<J> dr] 2 


-c 2 k 2 , 

2 


(13.177) 


(13.178) 


(13.179) 


where X + c 2 k 2 /2 is the separation constant. Writing cosh2§, cos2?? instead of cosh 2 £, 
cos 2 i] (which motivates the special form of the separation constant in Eq. (13.179)) we 
find the linear, second-order ODE 


d~R 1 2 2 

— y — {X — 2q cosh2£),R(£) = 0, q=-c 2 k 2 , 

4 

which is also called the radial Mathieu equation, and 

d 2 $> 

—ip + (X — 2 q cos2)?)<1>(?7) = 0, 
dr]<■ 


(13.180) 


(13.181) 


the angular, or modified, Mathieu equation. Note that the eigenvalue X (q) is a function 
of the continuous parameter q in the Mathieu ODEs. It is this parameter dependence that 
complicates the analysis of Mathieu functions and makes them among the most difficult 
special functions used in physics. ■ 
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Clearly, all finite points are regular points of both ODEs, while infinity is an essential 
singularity for both ODEs, which are of the Sturm-Liouville type (Chapter 10) with coef¬ 
ficient functions p= 1 and 

q(%) — — X + 2q cosh2§, q(q) — X — 2q cos2q. (13.182) 

(These functions q must not be confused with the parameter q.) As a consequence, their 
solutions form orthogonal sets of functions. The substitution q —> it; transforms the angular 
to the radial Mathieu ODE, so their solutions are closely related. 

Using the Lindemann-Stieltjes substitution z = cos 2 q, dz/dq — — sin2 q, the angular 
Mathieu ODE is transformed into an ODE with coefficients that are algebraic in the vari¬ 
able z (using ^ = g f z = - sin2^ and ^ = -2cos2ij£ + sin 2 2^): 

<i 2 0 d<t> r n 

4z(l -z)-^ 2 + 2(1 - 2 z)— + [7 + 2q{\ - 2 z)]cD = 0. (13.183) 

This ODE has regular singularities at z = 0 and z = 1, whereas the point at infinity is 
an essential singularity (Chapter 9). By comparison, the hypergeometric ODE has three 
regular singularities. But not all ODEs with two regular singularities and one essential 
singularity can be transformed into an ODE of the Mathieu type. 


Example 13.6.2 The Quantum Pendulum 

A plane pendulum of length / and mass m with gravitational potential V (6) = —mgl cos 0 
is called a quantum pendulum if its wave function T obeys the Schrodinger equation 

-5^5$ + CW-£]*=», (13.184) 

where the variable 0 is the angular displacement from the vertical direction. (For fur¬ 
ther details and illustrations we refer to Gutierrez-Vega et al. in the Additional Readings.) 
A boundary condition applies to 'I' so as to be single-valued; that is, + 2tt) = ^(d). 

Substituting 


9 — 2q, 


SEmI 2 

7=-^ 

h 2 


q = - 


4m 2 gl 2 
h 2 


(13.185) 


into the Schrodinger equation yields the angular Mathieu ODE for 4>(2(q + tx)) — 
4>(2 q). M 

For many other applications involving Mathieu functions we refer to Ruby in the Addi¬ 
tional Readings. 

Our main focus will be on the solutions of the angular Mathieu ODE, which has the 
important property that its coefficient function is periodic with period n. 
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General Properties of Mathieu Functions 

In physics applications the angular Mathieu functions are required to be single-valued, that 
is, periodic with period 2jt. Let us start with some nomenclature. Since Mathieu’s ODEs 
are invariant under parity (rj —*■ —rj), Mathieu functions have definite parity. Those of odd 
parity that have period 2n and, for small q, start with sin( 2 n + 1 )?; are called se 2 n +i(fi, q ), 
with n an integer, n = 0, 1,2,... (se is short for sine-elliptic). Mathieu functions of odd 
parity and period it that start with sin 2 nr\ for small q are called se 2 „ (q, q), with n — 
1,2,.... Mathieu functions of even parity, period it that start with cos 2nq for small q 
are called ce 2 n(q, q) (ce is short for cosine-elliptic), while those with period 2tc that start 
with cos(2 n + 1 n = 0,1,, for small q are called ce 2 „+i (q, q). In the limit where the 
parameter q —> 0 (and the Mathieu ODE becomes the classical harmonic oscillator ODE), 
Mathieu functions reduce to these trigonometric functions. 

The periodicity condition <J>(^ + 2n) — <^(q) is sufficient to determine a set of eigen¬ 
values A in terms of q. An elementary analog of this result is the fact that a solution of the 
classical harmonic oscillator ODE u" (r\) + Xu{rf) = 0 has period 2it if, and only if, A = n 2 
is the square of an integer. Such problems will be pursued in Section 14.7 as applications 
of Fourier series. 


Example 13 . 6.3 radial mathieu functions 

Upon replacing the angular elliptic variable i] -> if, the angular Mathieu ODE, 
Eq. (13.181), becomes the radial ODE, Eq. (13.180). This motivates the definitions of 
radial Mathieu functions as 

Ce2n+ P (t;,q) =ce2n+ P (i^,q), P — 0,1; n = 0,1,..., 

Se 2 „ +P ^,q) — -ise 2 n+ P (i^,q), P = 0,1; n = l,2,.... 

Because these functions are differentiable, they correspond to the regular solutions of the 
radial Mathieu ODE. Of course, they are no longer periodic but are oscillatory (Fig. 13.8). 

In physical problems involving elliptical coordinates, the radial Mathieu ODE, 
Eq. (13.180), plays a role corresponding to Bessel’s ODE in cylindrical geometry. Be¬ 
cause there are four families of independent Bessel functions — the regular solutions J„ 
and irregular Neumann functions N n , along with the modified Bessel functions /„ and 
K,, —we expect four kinds of radial Mathieu functions. Because of parity, the solutions 
split into even and odd Mathieu functions and so there are eight kinds. For q > 0, 

Je 2 n(%,q) = Ce 2 „(§, q), Je 2 „+ 1 (£,<?) = Ce 2n+ 1 (|, q), 

J 02 „(£, q) = Se 2 „(£, q), Jo 2 „+i (£, q) = Se 2n+ i(§, q ), regular or first kind; 

Ne„ (f, q), No„ (f, q), irregular or second kind; 

for q < 0, the solutions of the radial Mathieu ODE are denoted by 


Ie«(f , <?), Io„(£, <?), 
Ke„(|, q), Ko„(^, q), 


regular or first kind, 
irregular or second kind 
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a) b) 




Figure 13.8 Radial Mathieu functions: q = 1 (solid line), q — 2 (dashed 
line), q — 3 (dotted line). (From Gutierrez-Vega et al.. Am. J. Phys. 71 : 

233 (2003).) 


and are known as the evanescent radial Mathieu functions. Mathieu functions corre¬ 
sponding to the Hankel functions can be similarly defined. In Fig. 13.8 some of them are 
plotted. 

In applications such as a vibrating drumhead with elliptical boundary conditions (see 
Example 13.6.1), the solution can be expanded in even and odd Mathieu functions: 

ze n = Je„(£, q)ce n (q, q)cos(co n t), m >0, 

zo n =Jo n (^,q)se n (r],q)cos((o n t), m > 1. 

They obey Dirichlet boundary conditions, ze n (fo< *),t) — 0 = zo n (£o,>?, f), which hold pro¬ 
vided the radial functions satisfy Je„(§o ,q) = 0 = Jo„(§o ,q) at the elliptical boundary, 
where £ = §o- 

When the focal distance c —> 0, the angular Mathieu functions become the conventional 
trigonometric functions, while the radial Mathieu functions become Bessel functions. 

In the case of oscillations of a confocal annular elliptic lake, the modes have to include 
the Mathieu functions of the second kind and are thus given by 

ze n = [AJe„(£, q) + B Ne„(£, qj\ ce„(t?, q) cos(«„f), m > 0, 

ZO n = [AJo„ (i;,q) + £No„(§, q)]se„(r], q)cos((o„t), m > 1, 

with A, B constants. These standing wave solutions must obey Neumann boundary con¬ 
ditions at the inner (§ = §o) and outer (f = fi) elliptical boundaries; that is, the normal 
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derivatives (a prime denotes d/d%) of ze„ and zo„ vanish at each point of the boundaries. 
For even modes, we have zeJ ; (fo, '/■ t) = 0 = zej ? (fi, r;, f). The implied radial constraints 
are similar to Eqs. (11.81) and (11.82) of Example 11.3.1. Numerical examples and plots, 
also for traveling waves, are given in Gutierrez-Vega el al. in the Additional Readings. ■ 

For zeros of Mathieu functions, their asymptotic expansions, and a more complete listing 
of formulas we refer to Abramowitz and Stegun (AMS-55) in the Additional Readings, Am. 
J. Phys. 71, Jahnke and Emde and Gradshteyn and Ryzhik in the Additional Readings. 

To illustrate and support the nomenclature, we want to show 16 that there is an angular 
Mathieu function that is 

• even in i] and of period ir if and only if <f>j (jt /2) = 0; 

• odd and of period tv if and only if <$>2 (zr/ 2 ) = 0 ; 

• even and of period 2 n if and only if <T> 1 (zr/ 2 ) = 0 ; 

• odd and of period 2tt if and only if <t >' 2 (n / 2 ) = 0 , 

where <T> 1 (^ 7 ), <t> 20 ;) are two linearly independent solutions of the angular Mathieu ODE 
so that 

Oj(0) = 1, ( 0 ) = 0; cp 2 ( 0 ) = 0 , O 2 (0) = 1. (13.186) 

Since the Mathieu ODE is a linear second-order ODE, we know (Chapter 9) that these 
initial conditions are realistic. The first case just given corresponds to ce 2 „0f < 7 ), with 

<t> , 1 ( 7 r/ 2 ) = —2 n sin 2 / 7 r ;|^ =7r /2 + • • • = 0 for n — 1,2,_The second is the se 2 n (t?, q ), 

with <t> 2 ( 7 r/ 2 ) = sin 2nq |^/ 2 H-= 0. The third case is the ce 2 „+i (q.q), with 0 1 (zr/2) = 

cos(2n + 1 )jt/ 2 + • • • = 0. The fourth case is the se 2 «+i (q. q). 

The key to the proof is Floquet’s approach to linear second-order ODEs with periodic 
coefficient functions, such as Mathieu’s angular ODE or the simple pendulum (Exercise 
13.6.1). If <!> 1 ( 77 ), O 2 (? 7 ) are two linearly independent solutions of the ODE, any other 
solution <J> can be expressed as 

< t>('7) = ci<$>i(? 7 ) + C2 < t>2(»7), (13.187) 

with constants cj, C 2 . Now, <t>/, ( q + 2 jt ) are also solutions because such an ODE is invariant 
under the translation ?; —*■ i] + 2n. and in particular 

3>i(/7 + 2jr) = ai<J>i(? 7 ) +a 2 <&2(ri), 

<t>20l + 2n) — bi&i(r)) + 7 ? 2 c t > 2 (??), (13.188) 

with constants a,-, bj. Substituting Eq. (13.188) into Eq. (13.187) we get 

<t>(?7 + 2jt) — (cifli + C2 &i)3>i(?7) + (C2^2 + (13.189) 

where the constants c, can be chosen as solutions of the eigenvalue equations 

flici + b\C 2 = A.c 1 , 

aic\ +b2C2 = A.C 2 . (13.190) 

16 See Hochstadt in the Additional Readings. 
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Then Floquet’s theorem states that Oft; + 2jt) — /.Of;;), where X is a root of 


a\ — X 
02 


b\ 

bi-X 


— 0 . 


(13.191) 


A useful corollary is obtained if we define // and y by 7 = exp (2tc/ i) and yft;) = 
exp(—/u? 7 )<J>(? 7 ), so 

y (?7 + 2 tt) = e~ M e~ 2nli ^{r] + 2i r) = e~ M <l >(t?) = 37 ( 77 ). (13.192) 


Thus, Of?;) = e^yirj), with v a periodic function of ?7 with period 27t. 

Let us apply Floquet’s argument to the <to (17 + tt), which are also solutions of Mathieu’s 
ODE because the latter is invariant under the translation 
?/-*?; + n. Using the special values in Eq. (13.186) we know that 

<f> 1 (?; + 7 r) = <t>i ( 7 r)Oi (?;) + Oj ( 7 r) 0 2 (??), 

O 2 0; + 7 t) = 4 > 2 ( 7 r)Oi(» 7 ) + O^fjr)0 2 (??), (13.193) 

because these linear combinations of O^f rj) are solutions of Mathieu’s ODE with the cor¬ 
rect values <J >;(77 + tt), O'- (rj + tt) for r] = 0. Therefore, 

<t>i(ri + tt) — k; 0 ,( 77 ), (13.194) 

where the 7; are the roots of 

4>i(tt)-A. 0 2 (?r) _ 

<f>j (tt) <t>' 2 (7T)-X 

The constant term in the characteristic polynomial is given by the Wronskian 

W(3>i(>7), <D 2 (i?)) = C, 

a constant because the coefficient of <fO/c/?; in the angular Mathieu ODE vanishes, imply¬ 
ing dW/dr] — 0. In fact, using Eq. (13.186), 

VT(O|(0), O 2 (0)) = 0i(0)0f,(0) - <&i(0)O 2 (0) = 1 

= VU(Oi( 7 r), 0 2 (tt)), (13.197) 

so the eigenvalue Eq. (13.195) for X becomes 

(Oi (tt) - ^(Ojfjr) - A) - <h 2 (7r)<t>|(7r) = 0 

— X 2 — [<J>j (tt) + <J>2(7r)] A. + 1, (13.198) 

with 7i • X 2 — 1 and M + k 2 = O; (jr) + <!>(,(7r). 

If 17 1 1 = |k 2 | = 1, then X 1 = exp (i<f>) and k 2 = exp (—?0), so 7_i +7 2 = 2 cos 0■ For 0 
0, n , 2 tt, .. . this case corresponds to |<f>i(7r) + Oj( n)\ < 2, where both solutions remain 
bounded as ?; -> 00 in steps of tt using Eq. (13.194). These cases do not yield periodic 
Mathieu functions, and this is also the case when |Oi(jr) + (7r)| > 2. If 0 = 0, that 

is, A.i = 1 = X 2 is a double root, then the O, have period tt and |<$> 1 (7T) + Of, (7r)| = 2. If 
0 = tt, that is, Ai = — 1 = X 2 is again a double root, then |Oi(jr) + Of,(7r)| = —2 and the 
O, have period 2tt with O; (77 -F jr) = — O, (rj). 


(13.195) 

(13.196) 
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Because the angular Mathieu ODE is invariant under a parity transformation i] -> — q, 
it is convenient to consider solutions 

®eOl) — ^ [<&(»?) + < I > (-'7)]< = ^[<*>07) - $(-»?)] (13.199) 

of definite parity, which obey the same initial conditions as <J>,. We now relabel <t> ( , -> 
<I> 1 , <t > 0 —> <t> 2 , taking Tq to be even and <J>? to be odd under parity. These solutions of 
definite parity of Mathieu’s ODE are called Mathieu functions and are labeled according 
to our nomenclature discussed earlier. 

If <$>i (? 7 ) has period jt, then + jr) — O'^) also has period n but is odd under 
parity. Substituting rj — —tx/2 we obtain 



Conversely, if <l> , 1 ( 7 r/ 2 ) = 0, then <T>i ( 77 ) has period jt . To see this, we use 

T >1 (?; + 7r) = ci4>i (q) + c 2 ® 2 (q). 


(13.200) 


(13.201) 


This expansion is valid because 0 1 (?/ + jt) is a solution of the angular Mathieu ODE. We 
now determine the coefficients c,-, setting ;/ = — tx/2, and recall that «T> j and <!>'-, are even 
under parity, whereas <I >2 and <J>j are odd. This yields 


$1 




$ 


/ 

1 




(13.202) 


Since <i>' { (n/2) — 0, < f ,, 2 ( 7 r/ 2 ) / 0, or the Wronskian would vanish and <f > 2 ~ Oi would 
follow. Hence C 2 = 1 follows from the second equation and ci = 1 from the first. Thus, 
<I >1 (?; + jt) = <t> 10/ ). The other bulleted cases listed earlier can be proved similarly. 

Because the Mathieu ODEs are of the Sturm-Liouville type, Mathieu functions repre¬ 
sent orthogonal systems of functions. So, for m , n nonnegative integers, the orthogonality 
relations and normalizations are 



£ 


ce ; „ce„ d-q — 
ce„,se„ dr] — 0 ; 


[ce 2n ] di] 


-s: 


se„,se„ dr] — 0 , 


[se 2 «] dr] — n, 


if m ^ n; 


(13.203) 


if n > 1 ; 


/ [ce 0 (?7, q)Y 

Jo 


dr] — jt. 


If a function f(r ]) is periodic with period jt, then it can be expanded in a series of orthog¬ 
onal Mathieu functions as 


/(»?) = ce 0 (? 7 , q) + Eh ce 2 n(n,q) + b n se 2n (r],q)] 


(13.204) 


n= 1 
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with 


i r n 

a„ = — f(rj)ce 2n (ri,q)dr), n > 0; 

3T J-n 

i r n 

b„ = — f 0])se 2 „0h q) dih n> 1. 

7T 7-tt 


(13.205) 


Similar expansions exist for functions of period 2it in terms of ce 2 ;i +i and se 2 „+i. 
Series expansions of Mathieu functions will be derived in Section 14.7. 


Exercises 

For the simple pendulum ODE of Section 5.8, apply Floquet’s method and derive the 
properties of its solutions similar to those marked by bullets before Eq. (13.186). 

Derive a Mathieu function analog for the Rayleigh expansion of a plane wave for 
cos(kcosqcos0 ) and sin(£cos qcosO). 

Additional Readings 

Abramowitz, M., and I. A. Stegun, eds., Handbook of Mathematical Functions , Applied Mathematics Series- 
55 (AMS-55). Washington, DC: National Bureau of Standards (1964). Paperback edition. New York: Dover 
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Hochstadt, H., Special Functions of Mathematical Physics. New York: Holt, Rinehart and Winston (1961), 
reprinted Dover (1986). 
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Lebedev, N. N., Special Functions and their Applications (translated by R. A. Silverman). Englewood Cliffs, NJ: 
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Volume 1 is a thorough theoretical treatment of gamma functions, hypergeometric functions, confluent hy¬ 
pergeometric functions, and related functions. Volume 2 develops approximations and other techniques for 
numerical work. 

Luke, Y. L., Mathematical Functions and Their Approximations. New York: Academic Press (1975). This is 
an updated supplement to Handbook of Mathematical Functions with Formulas, Graphs and Mathematical 
Tables (AMS-55). 
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Rainville, E. D., Special Functions. New York: Macmillan (1960), reprinted Chelsea (1971). This book is a 
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Rowland, D. R., Am. J. Phys. 72: 758-766 (2004). 
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reprinted (1997). The classic text on special functions and real and complex analysis. 



Chapter 14 


Fourier Series 


14.1 General Properties 


Periodic phenomena involving waves, rotating machines (harmonic motion), or other repet¬ 
itive driving forces are described by periodic functions. Fourier series are a basic tool for 
solving ordinary differential equations (ODEs) and partial differential equations (PDEs) 
with periodic boundary conditions. Fourier integrals for nonperiodic phenomena are de¬ 
veloped in Chapter 15. The common name for the field is Fourier analysis. 

A Fourier series is defined as an expansion of a function or representation of a function 
in a series of sines and cosines, such as 


/(•*) = y + 


cos nx 


b„ si 


sin nx . 


n= 1 


n= 1 


(14.1) 


The coefficients ao,a„, and b n are related to the periodic function f(x) by definite inte¬ 
grals: 

1 r 2n 


a n — — 1 f(x)cosnxdx, 

X Jo 


(14.2) 

i r 271 

b n = — 1 f(x)sinnxdx, 

n = 0,1,2,..., 

(14.3) 


* Jo 


which are subject to the requirement that the integrals exist. Notice that «o is singled out 
for special treatment by the inclusion of the factor This is done so that Eq. (14.2) will 
apply to all a n ,n = 0 as well as n > 0. 

The conditions imposed on f(x) to make Eq. (14.1) valid are that fix.) have only a 
finite number of finite discontinuities and only a finite number of extreme values, maxima, 
and minima in the interval [0,271].* Functions satisfying these conditions may be called 


1 These conditions are sufficient but not necessary. 
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piecewise regular. The conditions themselves are known as the Dirichlet conditions. Al¬ 
though there are some functions that do not obey these Dirichlet conditions, they may well 
be labeled pathological for purposes of Fourier expansions. In the vast majority of physi¬ 
cal problems involving a Fourier series these conditions will be satisfied. In most physical 
problems we shall be interested in functions that are square integrable (in the Hilbert space 
L 2 of Section 10.4). In this space the sines and cosines form a complete orthogonal set. 
And this in turn means that Eq. (14.1) is valid, in the sense of convergence in the mean. 

Expressing cos nx and sin nx in exponential form, we may rewrite Eq. (14.1) as 

OO 

/(*)= E c " e ‘ nx ’ (14 ' 4 > 

n =—oo 


in which 


and 


Cl — ^ (an ib„), 


c—n — ^ (c n ib„), 


n > 0, 


C0 = 



Complex Variables—Abel’s Theorem 


(14.5a) 


(14.5b) 


Consider a function f(z) represented by a convergent power series 

OO OO 

/(z) = E C " z " = E C nr n e in6 . (14.6) 

n =0 n =0 

This is our Fourier exponential series, Eq. (14.4). Separating real and imaginary parts we 
get 

OO OO 

u(r, 0) — C n r n cos n0, v(r, 9) — C n r n sinnd, (14.7a) 

n =0 n— 1 

the Fourier cosine and sine series. Abel’s theorem asserts that if u( 1,0) and v ( \ .0) are 
convergent for a given 9, then 

m(1, 0) + /n(l, 9) = Um f(re ie ). (14.7b) 

An application of this appears as Exercise 14.1.9 and in Example 14.1.1. 


Example 14.1.1 Summation OF a Fourier Series 

Usually in this chapter we shall be concerned with finding the coefficients of the Fourier 
expansion of a known function. Occasionally, we may wish to reverse this process and 
determine the function represented by a given Fourier series. 
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Consider the series X],?!] ( 1 / m ) cos nx, x e (0,2 jz). Since this series is only condition¬ 
ally convergent (and diverges at x = 0), we take 


E cos nx ^\ 

-= hm > 

n r—^ 1 1— 1 


r cos nx 


(14.8) 


n =1 


n =1 


absolutely convergent for |r| < 1. Our procedure is to try forming power series by trans¬ 
forming the trigonometric functions into exponential form: 


°° r n cos nx I A r n e lnx 1 ™r n e~ inx 


E 

n= 1 




2 A —' n 
n =1 


n =1 


(14.9) 


Now, these power series may be identified as Maclaurin expansions of — ln(l ~z),z — 
re ix , re~ ix (Eq. (5.95)), and 


E 

n= 1 


, " C ° S,,t = -l[l„(l-„“) + l„ (l-re-")] 


= — ln[(l + r 2 ) — 2r cos 

Letting r — 1 and using Abel’s theorem, we see that 


(14.10) 


E 

n= 1 


cos nx 


= — ln(2 — 2cosx) 


1/2 


= — ln(2sin-), i e (0,27t). 2 


(14.11) 


Both sides of this expression diverge as x -* 0 and 2n. 


Completeness 

The problem of establishing completeness may be approached in a number of different 
ways. One way is to transform the trigonometric Fourier series into exponential form and 
to compare it with a Laurent series. If we expand f(z) in a Laurent series 3 (assuming f(z.) 
is analytic), 

OO 

/(z)= E d " z "• (14 ' 12) 

n =—oo 

On the unit circle z = e ,e and 

OO 

f(z) = f(e w )= d » e ‘ ne ■ ^ 14 - 13 ) 

n =—oo 


2 The limits may be shifted to [— n, n] (and x ^ 0) using \x\ on the right-hand side. 

3 Section 6.5. 
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Figure 14.1 Fourier 
representation of sawtooth 
wave. 


The Laurent expansion on the unit circle (Eq. (14.13)) has the same form as the complex 
Fourier series (Eq. (14.12)), which shows the equivalence between the two expansions. 
Since the Laurent series as a power series has the property of completeness, we see that the 
Fourier functions e mx form a complete set. There is a significant limitation here. Laurent 
series and complex power series cannot handle discontinuities such as a square wave or the 
sawtooth wave of Fig. 14.1, except on the circle of convergence. 

The theory of vector spaces provides a second approach to the completeness of the sines 
and cosines. Here completeness is established by the Weierstrass theorem for two variables. 

The Fourier expansion and the completeness property may be expected, for the functions 
sin nx, cos nx, e lnx are all eigenfunctions of a self-adjoint linear ODE, 

y” + n 2 y = 0. (14.14) 


We obtain orthogonal eigenfunctions for different values of the eigenvalue n for the interval 
[0, 2 jt ] that satisfy the boundary conditions in the Sturm-Liouville theory (Chapter 10). 
Different eigenfunctions for the same eigenvalue n are orthogonal. We have 


l 
f 

p2n 

Jo 


sin mx sin nx dx = 


cos mx cos nx dx — 


ft &mn > 

m ^ 0, 

o, 

3 

II 

o 

ft &mn > 

m ^ 0, 

2n , 

3 

II 

2 

II 

O 


sin mx cos nx dx — 0 for all integral m and n. 


(14.15) 

(14.16) 

(14.17) 


Note that any interval xq < x < xq + 2n will be equally satisfactory. Frequently, we shall 
use .ro = — it to obtain the interval — n < x < tt . For the complex eigenfunctions e ±,nx or¬ 
thogonality is usually defined in terms of the complex conjugate of one of the two factors. 



dx — 2 jt f}\ fi . 


(14.18) 


This agrees with the treatment of the spherical harmonics (Section 12.6). 



Sturm-Liouville Theory 
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The Sturm-Liouville theory guarantees the validity of Eq. (14.1) (for functions satis¬ 
fying the Dirichlet conditions) and, by use of the orthogonality relations, Eqs. (14.15), 
(14.16), and (14.17), allows us to compute the expansion coefficients a n , /;„, as shown in 
Eqs. (14.2), and (14.3). Substituting Eqs. (14.2) and (14.3) into Eq. (14.1), we write our 
Fourier expansion as 


1 f 2lT 

f(x) = — f(t)dt 
2 n J o 



fit) cos lit dt + sin nx 



fit) sin nt dt 


= ~f 

2n Jo 


2tt y 00 r 2tt 

— I mdt+-J2 
n J ° 


fit) cos n(t — x)clt. 


(14.19) 


the first (constant) term being the average value of fix) over the interval [0, 27r]. Equa¬ 
tion (14.19) offers one approach to the development of the Fourier integral and Fourier 
transforms. Section 15.1. 

Another way of describing what we are doing here is to say that fix) is part of an 
infinite-dimensional Hilbert space, with the orthogonal cos nx and sin nx as the basis. 
(They can always be renormalized to unity if desired.) The statement that cos nx and 
sin nx in = 0,1,2,...) span this Hilbert space is equivalent to saying that they form a 
complete set. Finally, the expansion coefficients a n and b n correspond to the projections of 
fix), with the integral inner products (Eqs. (14.2) and (14.3)) playing the role of the dot 
product of Section 1.3. These points are outlined in Section 10.4. 


Example 14.1.2 Sawtooth Wave 


An idea of the convergence of a Fourier series and the error in using only a finite number 
of terms in the series may be obtained by considering the expansion of 


fix) = 


x, 

x — 2jt, 


0 < x < n, 
it < x < 2n. 


(14.20) 


This is a sawtooth wave, and for convenience we shall shift our interval from [0, 2n] to 
[—7r, jr]. In this interval we have fix) = x. Using Eqs. (14.2) and (14.3), we show the 
expansion to be 


fix)=x — 2 


Sill A' — 


sin2^ 

2 


sin 3x 
3 


••• + (-l)" +1 


sin nx 



(14.21) 


Figure 14.1 shows fix) for 0 < x < n for the sum of 4, 6, and 10 terms of the series. Three 
features deserve comment. 


1. There is a steady increase in the accuracy of the representation as the number of terms 
included is increased. 
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2. All the curves pass through the midpoint, fix) — 0, at x = it. 

3. In the vicinity of x — jt there is an overshoot that persists and shows no sign of dimin¬ 
ishing. 

As a matter of incidental interest, setting x = n/2 in Eq. (14.21) provides an alternate 
derivation of Leibniz’ formula. Exercise 5.7.6. ■ 


Behavior of Discontinuities 

The behavior of the sawtooth wave fix) at x — n is an example of a general rule that at 
a finite discontinuity the series converges to the arithmetic mean. For a discontinuity at 
x — xq the series yields 

fix o) = \ [f{x o + 0) + fix o - 0)], (14.22) 

the arithmetic mean of the right and left approaches to x — xq. A general proof using 
partial sums, as in Section 14.5, is given by Jeffreys and Jeffreys and by Carslaw (see the 
Additional Readings). The proof may be simplified by the use of Dirac delta functions — 
Exercise 14.5.1. 

The overshoot of the sawtooth wave just before x — n in Fig. 14.1 is an example of the 
Gibbs phenomenon, discussed in Section 14.5. 


Exercises 


14.1.1 A function fix) (quadratic ally integrable) is to be represented by a finite Fourier series. 

A convenient measure of the accuracy of the series is given by the integrated square of 
the deviation. 


A p = 


/»27T " 

Jo 


fix) —-— 2-^( a n cosnx + v n sin nx) 


n =1 


dx. 


Show that the requirement that A p be minimized, that is. 


9 A p 
da ,, 


= 0, 


9 A p 
db n 


= 0 , 


for all n, leads to choosing a n and b„ as given in Eqs. (14.2) and (14.3). 

Note. Your coefficients a n and h n are independent of p. This independence is a con¬ 
sequence of orthogonality and would not hold for powers of x, fitting a curve with 
polynomials. 


14.1.2 In the analysis of a complex waveform (ocean tides, earthquakes, musical tones, etc.) it 
might be more convenient to have the Fourier series written as 


OO 

fix) = — + cos inx - 9 n ). 

n =1 
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14 . 1.3 


14 . 1.4 


14 . 1.5 


Show that this is equivalent to Eq. (14.1) with 
a n = a n cos 9 n , a~ = a 2 + b 2 , 

bn — afi sin Oyi , tan On — bn jcin • 

Aofe. The coefficients cy~ as a function of « define what is called the power spectrum. 
The importance of a 2 lies in their invariance under a shift in the phase 0„ . 

A function fix) is expanded in an exponential Fourier series 

OO 

/(*)= E c " einx - 

n= —oo 

If fix) is real, fix) — f*(pc), what restriction is imposed on the coefficients c„? 
Assuming that /^[/(x)] 2 dx is finite, show that 

lim a m =0, lim b m — 0. 

ra—>oo m—*oo 

Hint. Integrate [fix) — s„(x)] 2 , where s„(x) is the nth partial sum, and use Bessel’s 
inequality. Section 10.4. For our finite interval the assumption that fix) is square inte- 
grable ( ff \fix)\ 2 dx is finite) implies that f* \fix)\dx is also finite. The converse 
does not hold. 


Apply the summation technique of this section to show that 


E 


sin nx 
n 


\in — x), 0 <x<tt 

— jiTT+x), —7T<X<0 


(Fig. 14.2). 



Figure 14.2 Reverse sawtooth wave. 
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14.1.6 


14.1.7 


Sum the trigonometric series 


1) i,+i smwjc 

Z—' yi 


and show that it equals x/2. 
Sum the trigonometric series 


OO 


E 

n=0 


sin(2n + l)x 
2n + 1 


and show that it equals 


7T/4, 0 <X <7X 

— tv/A, —7r < x < 0. 


14.1.8 Calculate the sum of the finite Fourier sine series for the sawtooth wave, f(x) — 
x, (—7T, n), Eq. (14.21). Use 4-, 6-, 8-, and 10-term series and x jn = 0.00(0.02)1.00. 
If a plotting routine is available, plot your results and compare with Fig. 14.1. 

14.1.9 Let f(z) = ln(l + z) = l) n+1 Z n /n. (This series converges to ln(l + z) for 

\z\ < 1, except at the point z = — 1.) 


(a) From the real parts show that 


ln(2cos- ] =]T(-l) n 


+1 


cos nO 


— TC < V < TC. 


n =1 


(b) Using a change of variable, transform part (a) into 


ln (2si% ) =E 


, cos n6 


0 < 0 < 2tt. 


tl= 1 


14.2 Advantages, Uses of Fourier Series 
D iscontinuous Functions 

One of the advantages of a Fourier representation over some other representation, such as a 
Taylor series, is that it can represent a discontinuous function. An example is the sawtooth 
wave in the preceding section. Other examples are considered in Section 14.3 and in the 
exercises. 

Periodic Functions 

Related to this advantage is the usefulness of a Fourier series in representing a periodic 
function. If fix.) has a period of 2jt, perhaps it is only natural that we expand it in a series 
of functions with period 2n, 2 tc /2, 2tt/3, .... This guarantees that if our periodic /(x) is 
represented over one interval [0, 2ir] or \—n, tt], the representation holds for all finite x. 
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At this point we may conveniently consider the properties of symmetry. Using the in¬ 
terval [—71, 7 r], sin x is odd and cos.v is an even function of x. Hence, by Eqs. (14.2) and 
(14.3), 4 if fix) is odd, all a n — 0 and if fix ) is even, all b„ — 0. In other words, 

oo 

a 0 v—> 

f(x) — — + 2_^a n cos nx, fix) even, (14.23) 

n=\ 

oo 

fix) = Yb n sin/j.r, fix) odd, (14.24) 

n= 1 

Frequently these properties are helpful in expanding a given function. 

We have noted that the Fourier series is periodic. This is important in considering 
whether Eq. (14.1) holds outside the initial interval. Suppose we are given only that 

fix) — x , 0 < x < 7r (14.25) 

and are asked to represent fix) by a series expansion. Fet us take three of the infinite 
number of possible expansions. 


1. If we assume a Taylor expansion, we have 

fix)=x. 


(14.26) 


a one-term series. This (one-term) series is defined for all finite x. 

2. Using the Fourier cosine series (Eq. (14.23)), thereby assuming the function is repre¬ 
sented faithfully in the interval [0, tt) and extended to neighboring intervals using the 
known symmetry properties, we predict that 


fix) — —x, —7r < x < 0, 

fix) — 2jt — x, n < x < 2n. 

3. Finally, from the Fourier sine series (Eq. (14.24)), we have 


(14.27) 


fix)=X, — TT < X < 0, 

fix) —x— 2n, tt < x < 2tt. 


(14.28) 


These three possibilities — Taylor series, Fourier cosine series, and Fourier sine series — 
are each perfectly valid in the original interval, [0, n\. Outside, however, their behavior is 
strikingly different (compare Fig. 14.3). Which of the three, then, is correct? This question 
has no answer, unless we are given more information about fix). It may be any of the 
three or none of them. Our Fourier expansions are valid over the basic interval. Unless the 
function fix) is known to be periodic with a period equal to our basic interval or to (1 /n)th 
of our basic interval, there is no assurance whatever that the representation (Eq. (14.1)) will 
have any meaning outside the basic interval. 

In addition to the advantages of representing discontinuous and periodic functions, there 
is a third very real advantage in using a Fourier series. Suppose that we are solving the 
equation of motion of an oscillating particle subject to a periodic driving force. The Fourier 


Wi 111 the range of integration —n <x<jt. 



890 Chapter 14 Fourier Series 



Figure 14.3 Comparison of Fourier cosine series, Fourier sine series, 
and Taylor series. 


expansion of the driving force then gives us the fundamental term and a series of harmon¬ 
ics. The (linear) ODE may be solved for each of these harmonics individually, a process 
that may be much easier than dealing with the original driving force. Then, as long as the 
ODE is linear, all the solutions may be added together to obtain the final solution. 5 This is 
more than just a clever mathematical trick. 

• It corresponds to finding the response of the system to the fundamental frequency and 
to each of the harmonic frequencies. 

One question that is sometimes raised is: “Were the harmonics there all along, or were they 
created by our Fourier analysis?” One answer compares the functional resolution into har¬ 
monics with the resolution of a vector into rectangular components. The components may 
have been present, in the sense that they may be isolated and observed, but the resolution 
is certainly not unique. Hence many authors prefer to say that the harmonics were created 
by our choice of expansion. Other expansions in other sets of orthogonal functions would 
give different results. For further discussion we refer to a series of notes and letters in the 
American Journal of Physics. 6 

Change of Interval 

So far attention has been restricted to an interval of length 2n. This restriction may easily 
be relaxed. If f(x) is periodic with a period 2L, we may write 


5 One of the nastier features of nonlinear differential equations is that this principle of superposition is not valid. 

6 B. L. Robinson, Concerning frequencies resulting from distortion. Am. J. Phys. 21: 391 (1953); F. W. Van Name, Jr., Concerning 
frequencies resulting from distortion, ibid. 22: 94 (1954). 



14.2 Advantages, Uses of Fourier Series 


891 


/(*) = 


a 0 

2 



nnx 

~L 


+ b n sin 


nnx 

~r 


(14.29) 


with 


G n 


b n 



nnt 

fit) cos —j—dt, 


nnt 

fit) sin —j—dt. 


n = 0,1,2,3,..., 
n = 1,2,3,..., 


(14.30) 

(14.31) 


replacing x in Eq. (14.1) with nx/L and t in Eqs. (14.2) and (14.3) with nt/L. (For 
convenience the interval in Eqs. (14.2) and (14.3) is shifted to —n <t<n.) The choice of 
the symmetric interval (— L, L) is not essential. For fix) periodic with a period of 2 L, any 
interval (xo, xo + 2 L) will do. The choice is a matter of convenience or literally personal 
preference. 


Exercises 


14.2.1 The boundary conditions (such as fr( 0) = f (l) = 0) may suggest solutions of the form 
sininnx /1) and eliminate the corresponding cosines. 


(a) Verify that the boundary conditions used in the Sturm-Liouville theory are satis¬ 
fied for the interval (0,/). Note that this is only half the usual Fourier interval. 

(b) Show that the set of functions ip„ix) — sininnx/1), n — 1,2, 3,..., satisfies an 
orthogonality relation 

I 

<Pm ( x)(pn (x) dx — -S mn , n > 0. 

14.2.2 (a) Expand fix) = x in the interval (0, 2 L). Sketch the series you have found (right- 

hand side of Ans.) over (— 2L, 2L). 


f 


ANS. x — L 



(b) Expand fix) — x as a sine series in the half interval (0, L). Sketch the series you 
have found (right-hand side of Ans.) over (—2L,2L). 


4 L 1 

ANS. x = — V- 

n ' 2 n + 1 

n =0 


sin 


(2 n + \)nx 


14.2.3 


In some problems it is convenient to approximate sin nx over the interval [0, 1] by a 
parabola ax(l — x), where a is a constant. To get a feeling for the accuracy of this 
approximation, expand 4x(l — x) in a Fourier sine series (— 1 < x < 1): 


0 < x < 1 


— 1 < x < 0 



/(*) = 


4x(l — x), 
4x(l +x), 


sinn7rx. 
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Figure 14.4 Parabolic sine wave. 


32 1 

ANS. b„ = —r ■ —, n odd 

jx i n J 

b n = 0, n even. 

(Fig. 14.4.) 


14.3 Applications of Fourier Series 

Example 14.3.1 Square Wave— High Frequencies 

One application of Fourier series, the analysis of a “square” wave (Fig. 14.5) in terms of its 
Fourier components, occurs in electronic circuits designed to handle sharply rising pulses. 
Suppose that our wave is defined by 

f(x ) = 0, —7r < x < 0, 


f(x) = h, 0 < x 

< JT. 

(14.32) 

From Eqs. (14.2) and (14.3) we find 



1 f n 

qq — — / hdt = h, 
x Jo 


(14.33) 

i r n 

a n = — 1 h cos nt dt — 0, 

7T Jo 

n= 1,2,3,..., 

(14.34) 

1 f n h 

b„ — — / h sin nt dt — — 

7T Jo mX 

(1 — cosmtt); 

(14.35) 

2 h 

b n — —, n odd. 

nit 


(14.36) 

b„ — 0, n even. 


(14.37) 

The resulting series is 



h 2 li ( sin.t sin3x 

/(*) = - + - 

2 7T V 1 3 

sin 5x \ 

(14.38) 

+ 5 + ■ 
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Figure 14.5 Square wave. 


Except for the first term, which represents an average of fix) over the interval [—tt, tt], 
all the cosine terms have vanished. Since f{x ) — h /2 is odd, we have a Fourier sine series. 
Although only the odd terms in the sine series occur, they fall only as n~ l . This conditional 
convergence is like that of the alternating harmonic series. Physically this means that our 
square wave contains a lot of high-frequency components. If the electronic apparatus will 
not pass these components, our square-wave input will emerge more or less rounded off, 
perhaps as an amorphous blob. ■ 


Example 14.3.2 full-wave rectifier 


As a second example, let us ask how well the output of a full-wave rectifier approaches 
pure direct current (Fig. 14.6). Our rectifier may be thought of as having passed the positive 
peaks of an incoming sine wave and inverting the negative peaks. This yields 


f(t) — sincot, 0 < cot < n, 
fit) — — sincuf, — n < cot < 0. 


(14.39) 


Since fit) defined here is even, no terms of the form sin rz cot will appear. Again, from 
Eqs. (14.2) and (14.3), we have 

w 0 i r 

ciq =-/ sin cot d(cot )-\— / sm cot d (cot) 

Tt J—n ^ JO 


f»7r 4 

= — I sin cot d(cot) =—, 

Tt 


2 f 71 

= — I sir 

^ Jo 

2 r 71 

— — I sir 

Tt Jo 


(14.40) 


a n — — / sin cot cos ncot d (cot) 

Jo 

2 2 

n even, 


7i n 2 — 1 ’ 
= 0, n odd. 


(14.41) 
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fit) 



Note that [0, : r] is not an orthogonality interval for both sines and cosines together and we 
do not get zero for even n. The resulting series is 


fit) = 


2 

n 


4 

Tt 


E 


n= 2,4,6,... 


cos ncot 
n 2 — 1 


(14.42) 


The original frequency, &>, has been eliminated. The lowest-frequency oscillation is 2a>. 
The high-frequency components fall off as n -2 , showing that the full-wave rectifier does 
a fairly good job of approximating direct current. Whether this good approximation is 
adequate depends on the particular application. If the remaining ac components are objec¬ 
tionable, they may be further suppressed by appropriate filter circuits. These two examples 
bring out two features characteristic of Fourier expansions. 7 


• If f(x ) has discontinuities (as in the square wave in Example 14.3.1), we can expect 
the nth coefficient to be decreasing as 0(1 /n). Convergence is conditional only. 

• If f(x ) is continuous (although possibly with discontinuous derivatives, as in the full- 

wave rectifier of Example 14.3.2), we can expect the nth coefficient to be decreasing 
as 1 /n 2 , that is, absolute convergence. _ 


Example 14.3.3 Infinite Series, Riemann Zeta Function 

As a final example, we consider the problem of expanding x 2 . Let 

f(x)—X 2 , —7t<X<7T. 

Since f(x) is even, all b„ = 0. For the a„ we have 




- , z , 2j t~ 

ao = — / x dx=—^~, 


G. Raisbeek, Order of magnitude of Fourier coefficients. Am. Math. Mon. 62: 149-155 (1955). 


(14.43) 


(14.44) 
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From this we obtain 


= -f 

X Jo 


a n = — / a cos nx dx 


7 r 


= (-d'W- 

n A 


71 X—' 

= t +4 B- 1 )' 


, cos nx 


n= 1 


(14.45) 


(14.46) 


As it stands, Eq. (14.46) is of no particular importance. But if we set x — n, 

cos nit = (—1)" 

and Eq. (14.46) becomes 8 


or 


2 00 i 

9 7T . \—v 1 

--=t +4 £^ 

n =1 


2 00 i 

^ = £^C<2), 

6 z —‘ n~ 

n= 1 


(14.47) 


(14.48) 


(14.49) 


thus yielding the Riemann zeta function, £(2), in closed form (in agreement with the 
Bernoulli number result of Section 5.9). From our expansion of x 2 and expansions of other 
powers of x, numerous other infinite series can be evaluated. A few are included in this list 
of exercises: 


Fourier series 


Reference 


1. 

2 . 

3. 

4. 

5. 

6 . 


Y" 1 - I 

> —sin nx = { 

i n 

n= 1 l 

°° 1 1 

l) n+1 — sinrcx = -x, 


— j(7T+x), —JT<X<0 

jin — x), 0 < x < jt 


— IT < X < JT 


E °° 1 . n [ —7T/4, —7T<X< 0 

— sm(2» + l)*=| 0<x<n 

n =0 
oo 

E- 

n= 1 


= — In 


”(t) 

l) n — cosnx = — In 2 cos I — J 
n=l U 

00 1 1 

-cos(2n + 1)* = - In 

2n + \ v ' 2 


—JT < X < 7T 


. 1*1 
cot — 
2 


—7T < X < 7T 


—7T < X < 7T 


Exercise 14.1.5 
Exercise 14.3.3 

Exercise 14.1.6 
Exercise 14.3.2 

Exercise 14.1.7 
Eq. (14.38) 

Eq. (14.11) 
Exercise 14.1.9(b) 

Exercise 14.1.9(a) 


Note that the point x = n is not a point of discontinuity. 
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The square-wave Fourier series from Eq. (14.38) and item (3) in the table, 

E °° sin(2n + l)x 

\ ’ =(-l) m ~, rmt <x < (m + \)n, (14.50) 

2n + 1 4 

n=0 

can be used to derive Riemann’s functional equation for the zeta function. Its defining 
Dirichlet series can be written in various forms: 


oo oo oo 

C (s ) = y ' n s — 1 + y ' (2 n) ,v + y ' (2 n + 1) ' s 
n= 1 n=l n= 1 

oo 

= 2-^Cs) + £(2/1+1)-* 

«=0 

implying that the function 1(5) defined in Section 5.9 (along with 77 ( 5 )) satisfies 

OO 

1(5) = £(2« + l )~ S = (! - 2"*)?(s). (14.51) 

n= 0 

Here 5 is a complex variable. Both Dirichlet series converge for cr = JH5 > 1. Alternatively, 
using Eq. (14.51), we have 


,,(5) = ^(-l)"- 1 n-* = £(2n + “ E (2w) “ S = ( ! - ( 14 - 52 ) 




n =0 




which converges already for iH.v > 0 using the Leibniz convergence criterion (see Sec¬ 
tion 5.3). 

Another approach to Dirichlet series starts from Euler’s integral for the gamma function, 

/•OO n OO 

I y s ~ l e~ ny dy = n~ s f e~ y y s ~ { dy— n~ s T{s), (14.53) 

Jo 'Jo 

which may be summed using the geometric series 

OO 


«=1 


p-y 


-ny _ 


1 - e~y c- v - 1 


to yield the integral representation for the zeta function: 



- 1 


dy = f(5)r(5). 


If we combine the alternative forms of Eq. (14.53), 



dy = n~ s r(s)e~ i7Ts/2 , 


(14.54) 


y s - 1 e iny dy = n~ s r(s)e i7rs/2 



14.3 Applications of Fourier Series 


897 


we obtain 

y J_1 sin(ny) dy — n _i r(,s) sin (14.55) 

Dividing both sides of Eq. (14.55) by n and summing over all odd n yields, for a — ;){ (.v) > 
0, 

C TC S 

/ g(j)y s-1 dy = (1 — 2 _i_1 )^(s + l)r(i) sin —, (14.56) 

Jo 2 - 

using Eqs. (14.50) and (14.51). Here, the interchange of summation and integration is jus¬ 
tified by uniform convergence. This relation is at the heart of the functional equation. If we 
divide the integration range into intervals mn < y < (in + \)tc and substitute Eq. (14.50) 
into Eq. (14.56) we find 




7T 

4 


oo . 

£(-»" / 
n ” IT! 

m—0 


(m + l)7T 


y s ~ l dy 


7r 


s+i 


4s 


oo » 

£(-l) m [(m+l) s — m*] + l 

m =1 


7T 


s+1 


2s 


-(l-2* +1 )(;(-s). 


(14.57) 


using Eq. (14.52). The series in Eq. (14.57) converges for IHs < 1 to an analytic func¬ 
tion. Comparing Eqs. (14.56) and (14.57) for the common area of convergence to analytic 
functions, 0 < a — SKs < 1, we get the functional equation 


^(1 - 2 i+1 )C(-s) = (1 - 2- s -')C(,S' + l)T(s) sin ™, 
which can be rewritten as 

7T S 

U 1 - S) = 2(27r)- s S(s)r(s)cos —. (14.58) 

This functional equation provides an analytic continuation of C, (s) into the negative half¬ 
plane of s. For s -* 1 the pole of / (s) and the zero of cos(its/2) cancel in Eq. (14.58), so 
£(0) = —1/2 results. Since cos(tts/2 ) = 0 for s = 2m + 1 = odd integer, Eq. (14.58) gives 

£(—2m) = 0, the trivial zeros of the zeta function for m = 1,2,_All other zeros must lie 

in the “critical strip” 0 < a — JHs < 1. They are closely related to the distribution of prime 
numbers because the prime number product for f (s) (see Section 5.9) can be converted 
into a Dirichlet series over prime powers for /'// = d \n t; (s) / ds. From here on we sketch 
ideas only, without proofs. Using the inverse Mellin transform (see Section 16.2) yields the 
relation 

1 

In p = - 

2jti 

p m <x,p= prime 

m= 1 , 2 ,... 



/ 

Jo- 




x s ds 


(14.59) 


for a > 1, which is a cornerstone of analytic number theory. Since zeros of / (,v) become 
simple poles of <■'//, the asymptotic distribution of prime numbers is directly related by 
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Eq. (14.59) to the zeros of the Riemann zeta function. Riemann conjectured that all zeros 
lie on the line cr = 1/2, that is, have the form 1/2 + it with real t. If so, one could shift the 
line of integration to the left to cr = 1/2 + e, the simple pole of / (,y) at s = 1 giving rise to 
the residue x, while the integral along the line cr — 1/2 + e is of order 0(x 1 / 2 + e ). Hence, 
the remarkably small remainder in the asymptotic estimate 

Em*~* + 0(x l ^ 2+e ), x -» oo 

p<x 

would result for arbitrarily small s. This is equivalent to the estimate for the number of 
primes below x, 

n{x) — Y, 1 = f (lnt) -1 dt + 0(x 1/,2+e ), x -* oo. 

p<x ”' 2 

In fact, numerical studies have shown that the first 300 x 10 9 zeros are simple and lie 
all on the critical line a = 1/2. For more details the reader is referred to the classic text 
by E. C. Titchmarsh and D. R. Heath-Brown, The Theory of the Riemann Zeta Function, 
Oxford, UK: Clarendon Press (1986); H. M. Edwards, Riemann’s Zeta Function, New 
York: Academic Press (1974) and Dover (2003); J. Van de Lune, H. J. J. Te Riele, and 
D. T. Winter, On the zeros of the Riemann zeta function in the critical strip. IV. Math. 
Comput. 47: 667 (1986). Popular accounts can be found in M. du Sautoy, The Music of the 
Primes: Searching to Solve the Greatest Mystery in Mathematics, New York: HarperCollins 
(2003); J. Derbyshire, Prime Obsession: Bernhard Riemann and the Greatest Unsolved 
Problem in Mathematics. Washington, DC: Joseph Henry Press (2003); K. Sabbagh, The 
Riemann Hypothesis: The Greatest Unsolved Problem in Mathematics, New York: Farrar, 
Straus and Giroux (2003). 

More recently the statistics of the zeros p of the Riemann zeta function on the critical 
line played a prominent role in the development of theories of chaos (see Chapter 18 for 
an introduction). Assuming that there is a quantum mechanical system whose energies 
are the imaginary parts of the p, then primes determine the primitive periodic orbits of 
the associated classically chaotic system. For this case Gutzwiller’s trace formula, which 
relates quantum energy levels and classical periodic orbits, plays a central role and can be 
better understood using properties of the zeta function and primes. For more details see 
Sections 12.6 and 12.7 by J. Keating, in The Nature of Chaos (T. Mullin, ed.), Oxford, UK: 
Clarendon Press (1993), and references therein. ■ 


Exercises 


14.3.1 Develop the Fourier series representation of 

0 , 


/(*) = 


sin cot, 


—7r < cat < 0, 
0 < cot < IT. 


This is the output of a simple half-wave rectifier. It is also an approximation of the solar 
thermal effect that produces “tides” in the atmosphere. 


11 2 °°, 

ANS. f(t ) =-P - sin&>f- Y 

Tt 2 it L —' 


cosnwt 


it A —' n- 

n= 2,4,6,... 


1 



14.3.2 


14.3.3 


14.3.4 


14.3.5 
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fix) 



A sawtooth wave is given by 


Show that 


f(x)—X, — 7X < X < 7t. 


t! \ o Y'' 1)" 

j(x) = 2> -sin nx. 

' n 
n= 1 

A different sawtooth wave is described by 

I —i(j r+x), —jt<x<0 

; 

+ t( 7T—x), 0<X<7 r. 

Show that f(x) = ^^t(sinnx/n). 

A triangular wave (Fig. 14.7) is represented by 

x, 0 < x < 7r 


/(*) = 

l 

Represent /(x) by a Fourier series. 


-X, —7T < X < 0. 


7T 4 x 
ANS. /(x) = - - - 


cos nx 


n= 1 , 3 , 5 , 


Expand 


fix) = 


1. ^ 2 <^o 

0, x 2 > x 2 


in the interval [—tt, jt] . 

Note. This variable-width square wave is of some importance in electronic music. 
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Figure 14.8 Cross section 
of split tube. 


14.3.6 A metal cylindrical tube of radius a is split lengthwise into two nontouching halves. The 
top half is maintained at a potential + V, the bottom half at a potential —V (Fig. 14.8). 
Separate the variables in Laplace’s equation and solve for the electrostatic potential for 
r < a. Observe the resemblance between your solution for r — a and the Fourier series 
for a square wave. 

14.3.7 A metal cylinder is placed in a (previously) uniform electric field, Eo, with the axis of 
the cylinder perpendicular to that of the original field. 


(a) Find the perturbed electrostatic potential. 

(b) Find the induced surface charge on the cylinder as a function of angular position. 


14.3.8 Transform the Fourier expansion of a square wave, Eq. (14.38), into a power series. 

Show that the coefficients of x 1 form a divergent series. Repeat for the coefficients 
of v 3 . 

A power series cannot handle a discontinuity. These infinite coefficients are the result 
of attempting to beat this basic limitation on power series. 


14.3.9 (a) Show that the Fourier expansion of cos ax is 


2a sin an 

cos ax = - 

n 


1 

2a 2 


cosjc cos2x 

^\ 2 + ^¥ 


On = (-D" 


2a sin an 
n(a 2 — n 2 ) 


(b) From the preceding result show that 


oo 

an cotan = 1—2 £(2 p)a 2p . 

p= 1 


This provides an alternate derivation of the relation between the Riemann zeta function 
and the Bernoulli numbers, Eq. (5.152). 
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14.3.10 


14.3.11 


14.3.12 


14.3.13 


Derive the Fourier series expansion of the Dirac delta function 8 (x) in the interval —n< 
x < 7t. 


(a) What significance can be attached to the constant term? 

(b) In what region is this representation valid? 

(c) With the identity 


N 

^^cos nx — 

n =1 


sin(7Vx/2) 

sin(.r/2) 



2 


show that your Fourier representation of 8{x) is consistent with Eq. (1.190). 

Expand S(x — t) in a Fourier series. Compare your result with the bilinear form of 
Eq. (1.190). 


Verify that 


ANS. 8(x-t) = 


1 

2 7T 


1 
7r 


OO 

y^(cos nx cos nt + sin nx sin nt) 

n= 1 


i 

2jt 


OO 

^cos n(x — /). 

n =1 




a im((pi-(p 2 ) 


is a Dirac delta function by showing that it satisfies the definition of a Dirac delta func¬ 
tion: 



OO 

e im ^-^d n = f(<P2). 

m=—o o 


Hint. Represent f (<p\) by an exponential Fourier series. 

Note. The continuum analog of this expression is developed in Section 15.2. The most 
important application of this expression is in the determination of Green’s functions. 
Section 9.7. 


(a) Using 


f(x)=x~ 


-71 < X < 7T, 


show that 


E 

n= 1 


(- 1 ) 


n+l IT 2 


= — = 77(2). 
12 


(b) Using the Fourier series for a triangular wave developed in Exercise 14.3.4, show 
that 


E 


i 

(2 n - l) 2 


7 r~ 


= M2). 
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n =1 


(c) Using 


show that 


(d) Using 


derive 


and show that 


f(x)=x 4 


— 7T < X < 7X, 


v—> 1 7T v—\ 

E^r=w=f( 4 >' £ 


(- 1 ) 


n+1 


n =1 


in 4 

— -= ?;(4). 

720 


/(*) = 


x(7r — ;r), 
x(n + .r), 


0 <X <7X, 
7X < X < 0, 


™ = H £ 


sin nx 


n= 1,3,5,... 


E 


(_l)(n-t)/2J_ j _ j_ + i-L 

V ^ n 3 3 3 5 3 7 3 


7T J 


n=l,3,5,... 

(e) Using the Fourier series for a square wave, show that 

1 1 

n 3 5 7 


V (-1)0.-^! = 1 1 

Z_—/ n 

w=l,3,5,... 


■ = — = >8(3). 
32 


= i = W 


This is Leibniz’ formula for n, obtained by a different technique in Exercise 5.7.6. 
Note. The 2), ??(4), 7.(2), /S(l), and /3(3) functions are defined by the indicated 
series. General definitions appear in Section 5.9. 


14.3.14 


(a) Find the Fourier series representation of 

f(x)= { 0 x, 

(b) From the Fourier expansion show that 

,2 1 


— 7T <X <0 

0< X <7X. 


Tt“ 1 1 

^ = 1 + 3^ 


14.3.15 A symmetric triangular pulse of adjustable height and width is described by 

/(*) = 


fl(l — x/b), 

0, 


0<\x\<b 
b < \x\ < Jt. 


(a) Show that the Fourier coefficients are 

ab 2 ab 

a 0 =—, a n — (1-cos nb). 

7 r jt(nb) z 

Sum the finite Fourier series through /? = 10 and through n = 100 for x/tt — 
0(1/9)1. Take a = 1 and b = n/2. 



14.4 Properties of Fourier Series 


903 


(b) Call a Fourier analysis subroutine (if available) to calculate the Fourier coefficients 
of f(x), ao through aiq. 


14.3.16 (a) Using a Fourier analysis subroutine, calculate the Fourier cosine coefficients ao 

through flio of 


/(*) = 




2 - 11/2 


x e [—7r, tt]. 


(b) Spot-check by calculating some of the preceding coefficients by direct numerical 
quadrature. 

Check values, ao = 0.785, a 2 — 0.284. 

14.3.17 Using a Fourier analysis subroutine, calculate the Fourier coefficients through a\ o and 
7>io for 


(a) a full-wave rectifier. Example 14.3.2, 

(b) a half-wave rectifier. Exercise 14.3.1. Check your results against the analytic forms 
given (Eq. (14.41) and Exercise 14.3.1). 


14.4 Properties of Fourier Series 
C onvergence 

It might be noted, first, that our Fourier series should not be expected to be uniformly con¬ 
vergent if it represents a discontinuous function. A uniformly convergent series of continu¬ 
ous functions (sinn.r, cos nx) always yields a continuous function (compare Section 5.5). 
If, however, 

(a) f(x) is continuous, — n <x<tc, 

(b) /(—7T) = /(+7T), and 

(c) fix) is sectionally continuous, 

the Fourier series for fix) will converge uniformly. These restrictions do not demand that 
f{x) be periodic, but they will be satisfied by continuous, differentiable, periodic functions 
(period of 2 jt). For a proof of uniform convergence we refer to the literature. 9 With or 
without a discontinuity in fix ), the Fourier series will yield convergence in the mean. 
Section 10.4. 


®See, for instance, R. V. Churchill, Fourier Series and Boundary Value Problems, 5th ed.. New York: McGraw-Hill (1993), 
Section 38. 
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Integration 


Term-by-term integration of the series 

f(x)= y + ^2 a n 

yields 


cos nx + o n sin nx 

n= 1 n= 1 


■ bn sir 


/' 

*'.*0 


f(x)dx = 


, V - ' a " ■ x bn 

+ > — sin nx — > — 

vo i n -*o , « 

VO «—1 /I —1 


cos nx 


(14.60) 


(14.61) 


Clearly, the effect of integration is to place an additional power of n in the denominator 
of each coefficient. This results in more rapid convergence than before. Consequently, a 
convergent Fourier series may always be integrated term by term, the resulting series con¬ 
verging uniformly to the integral of the original function. Indeed, term-by-term integration 
may be valid even if the original series (Eq. (14.60)) is not itself convergent. The func¬ 
tion fix) need only be integrable. A discussion will be found in Jeffreys and Jeffreys, 
Section 14.06 (see the Additional Readings). 

Strictly speaking, Eq. (14.61) may not be a Fourier series; that is, if ciq / 0, there will be 
a term ^ciqx. However, 

f x 1 

I f(x)dx — -aox (14.62) 

Jx o 2 

will still be a Fourier series. 


Differentiation 


The situation regarding differentiation is quite different from that of integration. Here the 
word is caution. Consider the series for 


fix) = X, —7T<X<7t. (14.63) 

We readily find (compare Exercise 14.3.2) that the Fourier series is 

OO 

E „ , i smnx 

(— 1) + -, —71<X<7T. (14.64) 

n 

n= 1 

Differentiating term by term, we obtain 

OO 

1 =2^(-l)" +1 cosnx, (14.65) 

n =1 


which is not convergent. Warning: Check your derivative for convergence. 

For a triangular wave (Exercise 14.3.4), in which the convergence is more rapid (and 
uniform). 


fix) = 


7X 
2 


A 

4 ^ cos nx 

n n 2 

/t=l,odd 


(14.66) 
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Differentiating term by term we get 


/'(*) 



n=l,odd 


sin nx 
n 


which is the Fourier expansion of a square wave. 


fix) 


1, 0 < X < 71, 

— 1, — 7t < X < 0. 


(14.67) 


(14.68) 


Inspection of Fig. 14.7 verifies that this is indeed the derivative of our triangular wave. 


• As the inverse of integration, the operation of differentiation has placed an additional 
factor n in the numerator of each term. This reduces the rate of convergence and may, 
as in the first case mentioned, render the differentiated series divergent. 

• In general, term-by-term differentiation is permissible under the same conditions listed 
for uniform convergence. 


Exercises 

14.4.1 Show that integration of the Fourier expansion of f(x) — x, —tt < x < tt, leads to 

7r 2 ^ (_i)»+i l l l 

n _ E _1_ 4 + 9 _ 16 + "' ■ 

n=\ 

14.4.2 Parseval’s identity. 


(a) Assuming that the Fourier expansion of f(x) is uniformly convergent, show that 

i pit „2 °° 

- I [f(x)]~dx= ^ + J^( a Z + bl). 

^ Z n= 1 

This is Parseval’s identity. It is actually a special case of the completeness relation, 
Eq. (10.73). 

(b) Given 




(—1)" cos nx 


n=l 


— 7X <X<7T, 


apply Parseval’s identity to obtain f (4) in closed form. 

(c) The condition of uniform convergence is not necessary. Show this by applying the 
Parseval identity to the square wave 


fix) = j 


—7r < x < 0 
0 < X < 7T 


4 

Tt 


E 


sin(2n — l)x 


2 n - 1 
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Figure 14.9 Rectangular pulse. 


14.4.3 


14.4.4 


14.4.5 


Show that integrating the Fourier expansion of the Dirac delta function (Exer¬ 
cise 14.3.10) leads to the Fourier representation of the square wave, Eq. (14.38), with 
h = 1. 

Note. Integrating the constant term (l/27t) leads to a term x/27r. What are you going 
to do with this? 


Integrate the Fourier expansion of the unit step function 



—7X < X < 0 
0 <x <jt. 


Show that your integrated series agrees with Exercise 14.3.14. 


In the interval (— n, n). 


(Fig. 14.9). 


S„ (x) — 


n, 

0 , 


for |x| < 
for |*| > 


(a) Expand S„ (x) as a Fourier cosine series. 

(b) Show that your Fourier series agrees with a Fourier expansion of 8(x) in the limit 
as n —>• oo. 


14.4.6 


14.4.7 


Confirm the delta function nature of your Fourier series of Exercise 14.4.4 by showing 
that for any fix) that is finite in the interval [— n, 7r] and continuous at x = 0, 

/ /(x)[Fourier expansion of <5ooC*)] dx = /(0). 

-7T 

(a) Show that the Dirac delta function S(x — a ), expanded in a Fourier sine series in 
the half-interval (0, L)(0 < a < L), is given by 


2 x ^ 

5(x — a) = — y sir 


Note that this series actually describes 

— S(x + a) + S(x — a) in the interval (— L,L). 
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14.4.8 

14.4.9 


14.4.10 


(b) By integrating both sides of the preceding equation from 0 to x, show that the 
cosine expansion of the square wave 


is 


fix) = 


0, 

1 , 


0 <x<a 
a < x < L, 


z, x^ / nn (2 \ 

fix ) = - E - sin — 

7i “ n \ L J 


nna \ 


n =1 




for 0 < x < L. 

(c) Verify that the term 



is (fix)). 

Verify the Fourier cosine expansion of the square wave. Exercise 14.4.7(b), by direct 
calculation of the Fourier coefficients. 


(a) A string is clamped at both ends x = 0 and x = L. Assuming small-amplitude 
vibrations, we find that the amplitude y(x. t) satisfies the wave equation 

3 2 y 1 3 2 y 
dx- v 2 3 1 2 

Here v is the wave velocity. The string is set in vibration by a sharp blow at x — a. 
Hence we have 

dy(x, t) 

y(x,0) = 0, - — LvoS(x — a) at t = 0. 

at 

The constant L is included to compensate for the dimensions (inverse length) of 
S(x — a). With S(x — a) given by Exercise 14.4.7(a), solve the wave equation 
subject to these initial conditions. 


2i>oT 1 mta nirx nnvt 

ANS. y(x,t)— - > - sin-sin-sin-. 

7tv x—i n L L L 

n=l 

(b) Show that the transverse velocity of the string 3 y(x, t)/dt is given by 

oy(x,t) v—' • n7Ta • nnx nnvt 

-= 2un / sin-sin-cos-. 

dt ^ L L L 

n =1 

A string, clamped at x — 0 and at x = 1, is vibrating freely. Its motion is described by 
the wave equation 

3 2 u(x,t) 2 d 2 uix,t) 
dt 2 dx 2 
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Assume a Fourier expansion of the form 


oo 

E mvx 

b n (?) sin —— 

n= 1 


and determine the coefficients b n (t). The initial conditions are 

3 

u(x,0 ) = f(x) and — u(x.O) — g(x). 

3 1 


Note. This is only half the conventional Fourier orthogonality integral interval. However, 
as long as only the sines are included here, the Sturm-Liouville boundary conditions are 
still satisfied and the functions are orthogonal. 


tlTCVt MZVt 

ANS. b n (?) — A n cos —--F B n sin —-—, 

2 f 1 nnx 2 f 1 njix 

A n — - I /(A')sin- clx, B n — - / g(x)sin- dx. 

I Jo I njt v Jo I 

14.4.11 (a) Let us continue the vibrating string problem. Exercise 14.4.10. The presence of a 

resisting medium will damp the vibrations according to the equation 


3 2 u(x,t) 2 " M ( x ’ ? ) 3 u(x,t) 

3 1 2 dx 2 ' 3 1 

Assume a Fourier expansion 


OO 

E nnx 

b n (t) sin —— 

n =1 


and again determine the coefficients b n (t). Take the initial and boundary condi¬ 
tions to be the same as in Exercise 14.4.10. Assume the damping to be small. 

(b) Repeat, but assume the damping to be large. 


ANS. (a ) b n (t) = e kt ^ 2 {A„ cosco n t + B n sin&>„f}, 

2 f 1 nnx 

A n = t / /(x)sin—— dx, 

1 Jo 1 

2 f 1 nnx k 

B n - —: / g(x) sin —— dx + -— A n , 
nl Jo l ZcO/i 
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(b) b n (t) — e la / 2 {A n cosha„r + B n sinh<r„r}, 


A n — 



mcx 

——dx, 


2 f 1 nnx k 

B n = —- g(x) sin —— dx + — A n , 

G n l Jo l ^(7 n 



14.4.12 Find the charge distribution over the interior surfaces of the semicircles of Exer¬ 
cise 14.3.6. 

Note. You obtain a divergent series and this Fourier approach fails. Using conformal 
mapping techniques, we may show the charge density to be proportional to esc 0. Does 
esc 0 have a Fourier expansion? 


n =1 


14.4.13 Given 

OO 

<p\ (x) = ^2 
show by integrating that 

OO 

<pi(x)=^2 

14.4.14 Given 


sin nx 


cos nx 


n =1 


fl.six) = ^2 


sin nx 

s 


-3(7 r +x), 

— TT < X < 0, 

3(7 r — x), 

0 <X <7T, 

( 7 T +x) 2 - 33, 

—TT < X < 0 

(tt -x) 2 - 33, 

0 <X <TT. 


OO 

v-v cos nx 


V—V tub AtA 

fe+iW = L^Ti’ 


n =1 


n= 1 


develop the following recurrence relations: 


(a) ^ 2 s(x)— I if 2 s-i(x)dx 

do 

(b) f 2 s+l(x) = K (2s + 1) - / f2s(x) dx. 

Jo 

Note. The functions i// s (x) and the <p s (x) of the preceding two exercises are known as 
Clausen functions. In theory they may be used to improve the rate of convergence of a 
Fourier series. As with the series of Chapter 5, there is always the question of how much 
analytical work we do and how much arithmetic work we demand that the computer do. 
As computers become steadily more powerful, the balance progressively shifts so that 
we are doing less and demanding that they do more. 


f(x) = J2 

n =1 


cos nx 
n + 1 


14.4.15 


Show that 
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may be written as 


E cos nx 

-27—rry- 

n A (n + 1) 

n =1 

Note, ij/] (x) and <p 2 (x ) are defined in the preceding exercises. 

14.5 Gibbs Phenomenon 

The Gibbs phenomenon is an overshoot, a peculiarity of the Fourier series and other eigen¬ 
function series at a simple discontinuity. An example is seen in Fig. 14.1. 


Summation of Series 

In Section 14.1 the sum of the first several terms of the Fourier series for a sawtooth wave 
was plotted (Fig. 14.10). Now we develop analytic methods of summing the first r terms 
of our Fourier series. 

From Eq. (14.19), 


i r 

a n cosnx + b n sinnx = — / fit) cos n(t — x)dt. 
n J-7c 

Then the rth partial sum becomes 10 

r 

a 0 ^—> 

s r (x ) = — + » cosnx + b n sin nx) 


(14.69) 


n =1 


l r n l ^ , 

m - + Y.e- 

n =1 


a —i(t—x)n 


dt. 


(14.70) 


Summing the finite series of exponentials (geometric progression), 11 we obtain 

1 sin[(r + i)(t — x)] 

s r (x ) = — J fit )-— r 21 - ~dt. 


sin I (t — x ) 


(14.71) 


This is convergent at all points, including t — x. The factor 

sin[(r + \)(t - x )] 

2jt sin I (t — x) 


is the Dirichlet kernel mentioned in Section 1.15 as a Dirac delta distribution. 


10 It is of some interest to note that this series also occurs in the analysis of the diffraction grating (r slits). 
^Compare Exercise 6.1.7 with initial value n = 1. 
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For convenience of numerical calculation we consider the behavior of the Fourier series 
that represents the periodic square wave 


/(*) = 


0 < X < 7T, 
—7r < x < 0. 


(14.72) 


This is essentially the square wave used in Section 14.3, and we immediately see that the 
solution is 


2/z / sin.r 

/(*) = - — 
jr \ 1 


sin 3x 
3 



(14.73) 


Applying Eq. (14.71) to our square wave (Eq. (14.72)), we have the sum of the first r terms 
(plus which is zero here): 


s r (x) — 



sin[(r+ \)it-x)] 

- 1 - dt 

sin j(r — x) 

sin[(r + \)it-x )] 

-- dt 

sin j(r — x) 


h_ r° sin[(r + \){t - x)] ^ 
4 it J-iT sin \ (t — x) 

h f n sin[(r + \){t +x)] 

7 — / -- dt. 

4?r Jo sin^O + x) 


(14.74) 


This last result follows from the transformation 


t - t 


in the second integral. Replacing t — x in the first term with s and t + x in the second term 
with s, we obtain 


Sr(x) = — 


4?r J_ 


71 x sin(r + i)s h 

- t—— ds - 

sin 4 5 47r 


l 


n+x sin(r + 


ds. 


(14.75) 


The intervals of integration are shown in Fig. 14.10(top). Because the integrands have 
the same mathematical form, the integrals from x to 7r — x cancel, leaving the integral 
ranges shown in the bottom portion of Fig. 14.10: 


* w = 477 


h f x sin(r + 4)s 


L 


h r 

ds ~^L 


n+x sin(r + ^)s 


ds. 


(14.76) 


Consider the partial sum in the vicinity of the discontinuity at x = 0. As x —> 0, the sec¬ 
ond integral becomes negligible, and we associate the first integral with the discontinuity 
at x — 0. Using r + ^ — p and ps — § we obtain 


li C px sin£ d% 
2?r Jo sin(f/2 p) p ' 


(14.77) 
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Figure 14.10 Intervals of integration — Eq. (14.75). 


Calculation of Overshoot 


Our partial sum s r (x ) starts at zero when x = 0 (in agreement with Eq. (14.22)) and in¬ 
creases until f = ps — jt, at which point the numerator, sin£, goes negative. For large r, 
and therefore for large p, our denominator remains positive. We get the maximum value of 
the partial sum by taking the upper limit px — n. Right here we see that x, the location of 
the overshoot maximum, is inversely proportional to the number of terms taken: 

Jt JT 

x — — —. 

p r 

The maximum value of the partial sum is then 


h 1 r n sinfiif 
2 jt Jo sin(|/2 p)p 


h 2 
2 jt 


f 


sin £ 


d%. 


(14.78) 


In terms of the sine integral, si(x) of Section 8.5, 


f 


sin £ jt 

— -d£= - 
£ 2 


■ si(7T). 


The integral is clearly greater than jt/ 2, since it can be written as 


(14.79) 



(14.80) 


We saw in Example 7.1.4 that the integral from 0 to oo is jt/2. From this integral we are 
subtracting a series of negative terms. A Gaussian quadrature or a power-series expansion 
and term-by-term integration yields 

2 r sinF 

- ——= 1.1789797..., (14.81) 

n Jo % 

which means that the Fourier series tends to overshoot the positive corner by some 18 per¬ 
cent and to undershoot the negative corner by the same amount, as suggested in Fig. 14.11. 
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Figure 14.11 Square wave — Gibbs phenomenon. 


The inclusion of more terms (increasing r) does nothing to remove this overshoot but 
merely moves it closer to the point of discontinuity. The overshoot is the Gibbs phenom¬ 
enon, and because of it the Fourier series representation may be highly unreliable for pre¬ 
cise numerical work, especially in the vicinity of a discontinuity. 

The Gibbs phenomenon is not limited to the Fourier series. It occurs with other eigen¬ 
function expansions. Exercise 12.3.27 is an example of the Gibbs phenomenon for a Legen¬ 
dre series. For more details, see W. J. Thompson, Fourier series and the Gibbs phenomenon. 
Am. J. Phys. 60: 425 (1992). 


Exercises 

14 . 5.1 With the partial sum summation techniques of this section, show that at a discontinuity 
in fix) the Fourier series for f(x ) takes on the arithmetic mean of the right- and left- 
hand limits: 

fix o) = \\.f(x o + 0) + f(x o - 0)]. 

In evaluating lim, -^oo s r (xq) you may find it convenient to identify part of the integrand 
as a Dirac delta function. 

14 . 5.2 Determine the partial sum, s„, of the series in Eq. (14.73) by using 

sin mx f x sin2«y 

(a)-= / cos mydy, (b) > cos(2/i—l)v =-—. 

m Jo “J '2 sin y 

Do you agree with the result given in Eq. (14.79)? 

14 . 5.3 Evaluate the finite step function series, Eq. (14.73), h — 2, using 100, 200, 300, 400, 
and 500 terms for x — 0.0000(0.0005)0.0200. Sketch your results (five curves) or, if a 
plotting routine is available, plot your results. 
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14 . 5.4 (a) Calculate the value of the Gibbs phenomenon integral 

2 f 71 sinf 
I — — - dt 

x Jo t 

by numerical quadrature accurate to 12 significant figures. 

(b) Check your result by (1) expanding the integrand as a series, (2) integrating term 
by term, and (3) evaluating the integrated series. This calls for double precision 
calculation. 


ANS. /= 1.178979744472. 


14.6 Discrete Fourier Transform 

For many physicists the Fourier transform is automatically the continuous Fourier trans¬ 
form of Chapter 15. The use of digital computers, however, necessarily replaces a contin¬ 
uum of values by a discrete set; an integration is replaced by a summation. The continuous 
Fourier transform becomes the discrete Fourier transform and an appropriate topic for this 
chapter. 


Orthogonality over Discrete Points 


The orthogonality of the trigonometric functions and the imaginary exponentials is ex¬ 
pressed in Eqs. (14.15) to (14.18). This is the usual orthogonality for functions: integration 
of a product of functions over the orthogonality interval. The sines, cosines, and imaginary 
exponentials have the remarkable property that they are also orthogonal over a series of 
discrete, equally spaced points over the period (the orthogonality interval). 

Consider a set of 2 N time values 


T 2 T (2N — \)T 

t k = 0, —, —,.... --— 

2N 2N 2N 


for the time interval (0, T). Then 

kT 


r A - =—, A' = 0,1,2,..., 2N — 1. 
2 N 


(14.82) 


(14.83) 


We shall prove that the exponential functions &xp(2jtipt k /T) and exp(2jtiqt k /T) satisfy 
an orthogonality relation over the discrete points t k : 


2N-1 

E 


exp 


k =0 


2nipt k 

T 


* 

exp 


2ixiqtk \ 

T ) 


— 2NS p q±2,iN- 


(14.84) 


Here n, p, and q are all integers. 

Replacing q — p by s, we find that the left-hand side of Eq. (14.84) becomes 


2N 1 '2nist k x 2N ‘ 


E ex p 

k =0 


= E ex p 

k=0 


2n isk\ 

2N )’ 



14.6 Discrete Fourier Transform 


915 


This right-hand side is obtained by using Eq. (14.83) to replace T. This is a finite geometric 
series with an initial term 1 and a ratio 


From Eq. (5.3), 


r = exp 



2N—1 

E exp 

k=0 


2nist] < \ 

T ) 


1 -r 2N 
1 -r 


= 0 , 


2N, 


'•/l 

r = 1 , 


(14.85) 


establishing Eq. (14.84), our basic orthogonality relation. The upper value, zero, is a con¬ 
sequence of 

r 2N = exp(2nis ) = 1 


for s an integer. The lower value, 2N , for r — 1 corresponds to p — q. The orthogonality 
of the corresponding trigonometric functions is left as Exercise 14.6.1. 


Discrete Fourier Transform 


To simplify the notation and to make more direct contact with physics, we introduce the 
(reciprocal) &>-space, or angular frequency, with 


co p = 


2 np 

~Y ~’ 


p = 0, 1,2, ...,21V- 1. 


(14.86) 


We make p range over the same integers as k. The exponential exp(±2 niptk/T) of 
Eq. (14.84) becomes exp(±iu> p tk). The choice of whether to use the + or the — sign is 
a matter of convenience or convention. In quantum mechanics the negative sign is selected 
when expressing the time dependence. 

Consider a function of time defined (measured) at the discrete time values 4 . Then we 
construct 


1 2N—1 

E f^e U °” ,k . 

k =0 

Employing the orthogonality relation, we obtain 

1 2 N -1 

_ ( e i» P t m y e i» P t k = Smkt 
* p =0 


(14.87) 


(14.88) 


and then replacing the subscript m by k, we find that the amplitudes fitk) become 


2N—\ 

f(tk)= E F (<Op) e ~ i<0ptk - (14.89) 

p =0 

The time function /(4), k = 0, 1,2,..., 2/V — 1, and the frequency function F ( o > p ). p — 
0,1,2,..., 2N — 1, are discrete Fourier transforms of each other . 12 Compare Eqs. (14.87) 


12 The two transform equations may be symmetrized with a resulting (IN) 1 F in each equation if desired. 
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and (14.89) with the corresponding continuous Fourier transforms, Eqs. (15.22) and 
(15.23) of Chapter 15. 


Limitations 

Taken as a pair of mathematical relations, the discrete Fourier transforms are exact. We 
can say that the IN 2/V-component vectors exp (—ico p tk), k = 0,1,2,, 2 N — 1, form 
a complete set 13 spanning the 4 -space. Then /( 4 ) in Eq. (14.89) is simply a particular 
linear combination of these vectors. Alternatively, we may take the 2 N measured compo¬ 
nents /(4) as defining a 2/V-component vector in 4 -space. Then, Eq. (14.87) yields the 
2/V-component vector F(a) p ) in the reciprocal 04 ,-space. Equations (14.87) and (14.89) 
become matrix equations, with exp(ico p tk)/(2Ny^ 2 the elements of a unitary matrix. 

The limitations of the discrete Fourier transform arise when we apply Eqs. (14.87) and 
(14.89) to physical systems and attempt physical interpretation and the limit F(co p ) —» 
F(co). Example 14.6.1 illustrates the problems that can occur. The most important precau¬ 
tion to be taken to avoid trouble is to take N sufficiently large so that there is no angular 
frequency component of a higher angular frequency than con = 2tcN/T. For details on 
errors and limitations in the use of the discrete Fourier transform we refer to Hamming in 
the Additional Readings. 


Example 14.6.1 Discrete Fourier Transform —Aliasing 


Consider the simple case of T — 2i r, N — 2, and /( 4 ) = cos 4 . From 

kT kic 

4 =— = —, k = 0, 1,2,3, 

4 2 

/( 4 ) = cos ( 4 ) is represented by the four-component vector 

/ ( 4 ) = ( 1 , 0 , — 1 , 0 ). 


The frequencies, co p , are given by Eq. (14.86): 

2np 

a P = — = P- 

Clearly, cos 4 implies a p = 1 component and no other frequency components. 
The transformation matrix 


becomes 


exp(/&> p 4 ) txp{ipkn/2) 
2 N ~~ 2TV 


(1 
1 1 
4 1 

V 1 


1 1 
i —l 
-1 1 
—i — 1 


1 \ 


-/ 


(14.90) 

(14.91) 


(14.92) 


(14.93) 


13 By Eq. (14.85) these vectors are orthogonal and are therefore linearly independent. 
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Note that the 2 N x 2 N matrix has only 2 N independent components. It is the repetition 
of values that makes the fast Fourier transform technique possible. 

Operating on column vector /( 4 ), we find that this matrix yields a column vector 

F(co p ) = { 0,^,0, 2 ). (14.94) 

Apparently, there is a p — 3 frequency component present. We reconstruct / ( 4 ) by 
Eq. (14.89), obtaining 


/(fit)=2«" i * + 5« _3i *- (14.95) 

Taking real parts, we can rewrite the equation as 


91/(4) = 5 cos 4 + j cos 34 . (14.96) 

Obviously, this result, Eq. (14.96), is not identical with our original /( 4 )cos 4 . But 
cos 4 = 1 cos 4 + ^ cos 34 at 4 = 0, jr/2, 7 r; and 37 r/ 2 . The cos 4 and cos 34 mimic 
each other because of the limited number of data points (and the particular choice of data 
points). This error of one frequency mimicking another is known as aliasing. The problem 
can be minimized by taking more data points. ■ 


Fast Fourier Transform 

The fast Fourier transform is a particular way of factoring and rearranging the terms in 
the sums of the discrete Fourier transform. Brought to the attention of the scientific com¬ 
munity by Cooley and Tukey , 14 its importance lies in the drastic reduction in the number 
of numerical operations required. Because of the tremendous increase in speed achieved 
(and reduction in cost), the fast Fourier transform has been hailed as one of the few really 
significant advances in numerical analysis in the past few decades. 

For N time values (measurements), a direct calculation of a discrete Fourier transform 
would mean about N 2 multiplications. For N a power of 2, the fast Fourier transform tech¬ 
nique of Cooley and Tukey cuts the number of multiplications required to ( N/2) log 2 N. 
If N — 1024 (= 2 10 ), the fast Fourier transform achieves a computational reduction by a 
factor of over 200. This is why the fast Fourier transform is called fast and why it has rev¬ 
olutionized the digital processing of waveforms. Details on the internal operation will be 
found in the paper by Cooley and Tukey and in the paper by Bergland . 15 


4l. W. Cooley and J. W. Tukey, Math. Comput. 19: 297 (1965). 

I5 G. D. Bergland. A guided tour of the fast Fourier transform, IEEE Spectrum, July, pp. 41-52 (1969); see also, W. H. Press, 
B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, Numerical Recipes, 2nd ed., Cambridge, UK: Cambridge University Press 
(1996), Section 12.3. 
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Exercises 


14 . 6.1 


Derive the trigonometric forms of discrete orthogonality corresponding to Eq. (14.84): 



= 0 



0 , 

p^q 

N, 

p = q^0.N 

2N, 

p — q = 0, N 

0 , 

p^q 

N, 

p = q^0,N 

0 , 

p = q — 0, N. 


Hint. Trigonometric identities such as 

sin A cos B — j [sin( A + B) + sin( A — £)] 


are useful. 


14 . 6.2 


14 . 6.3 


14 . 6.4 


Equation (14.84) exhibits orthogonality summing over time points. Show that we have 
the same orthogonality summing over frequency points 

2 N — I 

— (e i0) P tm )*e ia) p^=8 mk . 

* p =o 

Show in detail how to go from 

1 2N—1 

p^p) = ^ E mv artk 


/(&) = E F(co p )e~ iM P ,k . 
p =o 

The functions f(t k ) and F ( u > p ) are discrete Fourier transforms of each other. Derive the 
following symmetry relations: 


(a) If /(4) is real, F(co p ) is Hermitian symmetric; that is, 

i = fA 4,,n 


F (o2 p ) = 


V T 


(b) If f(t k ) is pure imaginary. 


F(co p ) = -F* 


4nN 

T 



Note. The symmetry of part (a) is an illustration of aliasing. The frequency 4-itN/T — 
(D p masquerades as the frequency co p . 
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14 . 6.5 Given A — 2, T = 2i r, and /( 4 ) — sin 4 , 


(a) find F(cop ), p — 0,1,2, 3, and 

(b) reconstruct /( 4 ) from F(w p ) and exhibit the aliasing of w\ — 1 and u >3 = 3. 


14 . 6.6 


ANS. (a) F(w p ) = (0, i/2, 0, -i/2) 
(b) f (4) = \ sin t k - 5 sin 34- 

Show that the Chebyshev polynomials T m (x) satisfy a discrete orthogonality relation 


1 

2 


AT—1 

T m {— !)?«(— 1) + T m (x s )T n (x s ) + 

s=l 


1 

2 


r m (i)r„(i) 


0, 7^ n 

N/ 2 , /« = «/ 0 

A, m = n — 0 . 


Here, x v = cos 4 , where the (A + 1 )4 are equally spaced along the 0-axis: 

S7T 

d<=—, s = 0, 1,2,..., A. 

A 


14.7 Fourier Expansions of Mathieu Functions 

As a realistic application of Fourier series we now derive first integral equations satisfied 
by Mathieu functions, from which subsequently their Fourier series are obtained. 


Integral Equations and Fourier Series for Mathieu 
Functions 


Our first goal is to establish Whittaker’s integral equations that Mathieu functions satisfy, 
from which we then obtain their Fourier series representations. 

We start from an integral representation 

V(r)= f f(z + ixcos6 + iysm9,9)d9 (14.97) 

J —Jt 

of a solution V of Laplace’s equation with a twice differentiable function /( v, 9). Apply¬ 
ing V 2 to V we verify that it obeys Laplace’s PDE. Separating variables in Laplace’s PDE 
suggests choosing the product form f(v, 9) — e kv <p(9). Substituting the elliptical variables 
of Eq. (13.163) we rewrite V as 

R($)<P(lj)e kz = P 0 ( 0 ) e <--L-Hrcoshfco Sf; cos(?+ i Vsinhfsin )) sin 0 )^ (14.98) 


with normalization R( 0) = 1. Since £ and i] are independent variables we may set f = 0, 
which leads to Whittaker’s integral representation 

r 

cp(rj)— / </>(0)exp (ickcos9cos rj)d9. 


(14.99) 



920 Chapter 14 Fourier Series 


where ck — 2 ^fq from Eq. (13.180). Clearly, <l> is even in the variable r\ and periodic with 
period n. In order to prove that <p ~ <t> we check how <p(9) is constrained when <t> ( i ]) is 
taken to obey the angular Mathieu ODE 


— + (A — 2q cos2?;)<1>(?7) 


= I 4> (9)exp(ick cos 0 cosq) 

J —71 

• [A — 2 q cos 2?? + (ick cos 6 sin ;;) 2 — ick cos 6 cos q\d9. (14.100) 

Here we integrate the last term on the right-hand side by parts, obtaining 

d 2 <t> 

—rr + (A. - 2 q cos2rj)<t>(rj) 
dq z 

71 

— <p {9)(—ick cos q sin$) cxp(ickcos9 cos r ]) 

8=-tt 

r 

+ / 4>(9) exp (ick cos 9 cos r/)[X — 2q cosl-q — ickcos9 cos rj] d9 

J—71 

+ / \—<p'(9)(—ick cos rj sin0) + cp (9)ick cos r; cos 9] exp (ick cos 9 cos r/) d9 

J —IT 

= f exp ick cos 9 cos i][cf>(9)(X — 2q cos 2rj) + (p'(9)ick cos rj sin 9] d9, (14.101) 

J — 71 

where the integrated term vanishes if <p(—jt) = <p(jx ), which we assume to be the case. 
Integrating once more by parts yields 

d 2 <t> . * 

— + (X — 2q cos2rj)(£>(ri) — —(p (9) exp ick cos 9 cos 
drj z e=-K 

+ f exp (ickcos9 cos q)\<p(9)(X — 2q cos2?;) + <p"(9)\ d9, (14.102) 

J —71 


where the integrated term vanishes if <p' is periodic with period 7r, which we assume is 
the case. Therefore, if <p(9) obeys the angular Mathieu ODE, so does the integral <t>(>/), in 
Eq. (14.99). As a consequence, <p(9) ~ <J>(0), where the constant may be a function of the 
parameter q. 

Thus, we have the main result that a solution <T> ( 77 ) of Mathieu’s ODE that is even in the 
variable i] satisfies the integral equation 

(14.103) 

When these Mathieu functions are expanded in a Fourier cosine series and normalized so 
that the leading term is cos nr], they are denoted by ce„(q, q). 
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Similarly, solutions of Mathieu’s ODE that are odd in q with leading term sin nq in a 
Fourier series are denoted by se„ (q, q ), and they can similarly be shown to obey the integral 
equation 

(14.104) 

We now come to the Fourier expansion for the angular Mathieu functions and start 
with 

oo oo 

sei(? 7 , q) — sin q + f$ v {q) sin(2u + l)q, fi v {q) = P^q^ (14.105) 

i.'—I l>—v 

as a paradigm for the systematic construction of Mathieu functions of odd parity. Notice 
the key point that the coefficient p v of sin(2v + 1 )q in the Fourier series depends on the 
parameter q and is expanded in a power series. Moreover, sei is normalized so that the 
coefficient of the leading term, sin;;, is unity, that is, independent of q. This feature will 
become important when sei is substituted into the angular Mathieu ODE to determine the 
eigenvalue X(q). 

The fact that the /),, power series in q starts with exponent v can be proved by a simpler 
but similar series for sei (q, q): 

OO OO 

se l (q,q) = ^2y v (q)sin 2v+l q, y v (q) = 'Y^,Y ^ ) ^> (14.106) 

v=0 /i=0 

which is useful for this demonstration alone. However, since we need to expand 

sin 2y+1 q = B v>» sin(2m + l)q (14.107) 

m= 0 

with Fourier coefficients 

1 f n (—l) m /2 v+l\ 

B V m — ~ / sin 2l;+l q sin(2w + l)qdq = ( “ ) (14.108) 

7t J-n 2- v \ v - m ) 

that we can look up in a table of integrals (see Gradshteyn and Ryzhik in the Additional 
Readings of Chapter 13), this proof gives us an opportunity to introduce the B vm that are 
nonzero only if m < v and are important ingredients of the recursion relations for the lead¬ 
ing terms of sei (and all other Mathieu functions of odd parity). Substituting Eq. (14.107) 
into Eq. (14.106) we obtain 

OO V 

sei(??, q) — ^ ^2 BvmYv(q) sin(2m + 1));. (14.109) 

y=0 m= 0 

Comparing this expression for sei with Eq. (14.105) we find 

OO 

Pv(q) = ^2 B mvVm(q)■ (14.110) 

m=v 



Here, the sum starts with m — v because B mv — 0 for m < v. 
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Next we substitute Eq. (14.106) into the integral Eq. (14.104) for n = 1, where we insert 
the power series for sm(2i^/q sin q sin0). This yields 


sei (?;, q) 1 
2ns\(q) 


i r n ^ 

= — I sm(2i^/qsi 

277 J — Jl 


sin?; sin 0 )sei( 0 , q)d0 


J oo 

=- > y m (q) si 

2nsi(q) 

m= 0 


sin 2m+1 q 


= iy/d E q m Yv(q) sin 2 " ,+1 ?; 


22 m+l j nn 


m,v =0 


(2m + 1 )! 2 ?r 


r ■ 

/ sin 

J — 71 


2v+2m+2 


6d9, 


(14.111) 


from which we obtain the recursion relations 

22 m+1 °° nn 

Ym(q)= , . . q m is/qs\(q)'Yyv(q) / s in 2l ’ +2m+2 0 6?0, (14.112) 

(2m + 1 )! “ J-n 

v=0 

upon comparing coefficients of sin 2 "' +1 ?;. This shows that the power series for y m (q) starts 
with q m . Using Eq. (14.110) proves that the power series for fi m (q) also starts with q m , 
and this confirms Eq. (14.105). The integral in Eq. (14.112) can be evaluated analytically 
and expressed via the beta function (Chapter 8 ) in terms of ratios of factorials, but we do 
not need this formula here. 

Our next goal is to establish a recursion relation for the leading term of sei, in 
Eq. (14.105). We substitute Eq. (14.105) into the integral Eq. (14.104) for n = 1, where we 
insert the power series for sin( 2 ? ^/q sin q sind) again, along with the expansion 


1 

2ns\ (q) 


= i Y2 ot m q m+l/2 . 

m= 0 


(14.113) 


Here, the extra factor, iJq, cancels the corresponding factor from the sine in the integral 
equation. This yields 

00 o2v+l 1 /* 71 

y YYq^ +V sin 2v+1 q — - / sin 2v+2x+2 6 dO 

yy 1 1 (2 v + \)\2jt ]_ n 

v =0 

oo 

= y «?«9 m+ ^^ l ’ ) sin(2v+l)?7. (14.114) 

m,n=0 


Here, we replace sin 2l+1 q by sin(2??? + 1 )77 using Eq. (14.107). Upon comparing the co¬ 
efficients of q N sin(2v + 1)?; for N = fi + v we obtain the recursion relation 


N N—v 

EE<- 


v=n 1=0 


2 2v 

(2v+l)! 


N—n 

E a «^N-, 


m =0 


(14.115) 
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Now we substitute Eq. (14.108) to obtain the main recursion relation for the leading 
coefficients fiv >) of sei: 


N N-v 

EE 


v=n A=0 


(jW 

J N-v 


2 2v (2v + 1)! 



(14.116) 


Example 14.7.1 Leading Coefficients of sej 


We evaluate Eq. (14.116) starting with N — 0, n — 0. For this case we find j8q 0> — o/qj3^ 0> , 
or ao = 1 because the coefficient of sini? in sei, /3q 0> = 1, by normalization. For N — 1, 
n = 0 Eq. (14.116) yields 


«o r+^c=r+ 


i 


4- 3! VI 




(14.117) 


where yS ( j 1 * = 0 and /3j 0) drops out, a general feature. Of course, /l| 0) = 0 because sin rj in 
sei has coefficient unity. This yields a\ — 3/8. 

The case N = 1, n = 1 yields 


-1 

4^3! 



= ao ^ 1 


(i) 


(14.118) 


or = —1/8. The leading term is obtained from the general case n — N, 


(-i y 


2 1n (2N + 1)! V 0 


2 N- 




V N 


■ a 0 P 


(AO 
N ’ 


(14.119) 


as 



(-1)* /21V + 1\ 

2 2N (2N+ 1)! V N )' 


(14.120) 


which was first derived by Mathieu. For N — 1 this formula reproduces our earlier result, 
/ 6 1 (1) = -l/8. ■ 

In order to determine the first nonleading term of sei, Eq. (14.105), and the 

eigenvalue ai (q) we substitute sei into the angular Mathieu ODE, Eq. (13.181), using 
the trigonometric identities 

2 cos 2?; sin(2v + 1 )rj — sin(2u + 3)?7 + sin(2v — \)rj 


<i 2 sin(2v + 1 )r] 
cli ] 2 


= — (2v + l) 2 sin(2u + l)rj. 


and 
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This yields 


d 2 sei 

0 = -«—h (A, — 2q cos2)])sei = g(sin ?? — sin 3??) + Aj sin — sin /) 

dr) 1 


^[M-(2v+l) 2 ] 


V =1 


(-w + ^y + i + ... 

2 2 v v!(v + 1 )! 


sin( 2 v + 1 )rj 


OO 


— r (-q) v 


' ^I2 2v v\(v + ly. 

y=l 

= I A.i - 1 + q - q 


o ,,+i + 


(sin(2t> + 3)q + sin(2v — l)q) 


■ sin 3?? 


-q-q 


q , o(i) 2 
2 2 2 ! + ^ q 

q 2 


sin 77 


2 4 2!3! 


+ + (*1 - 3 2 ) f-z|t7 + P { 2 } q 2 


+ sin(2v + 1)» ? [M - (2v + l) 2 ] + p^ q 

(~q) v+l 


2 2 2 ! 

00 y+I 


— q sin( 2 t> + l)r/ 


— q sin( 2 t> + l)r/ 


2 2 ( v +l)(v + l)!(v + 2)! 

(- q) v ~ l 

2 2 ( v “i)(v — l)!v! 


o(l’+i) y+ 2 

p v +2 q 


+ 4 v “V) + 


(14.121) 


In this series the coefficient of each power of q within different sine terms must vanish; 
that of sin i] being zero yields the eigenvalue 


Xl (q) = l-q- ^ q 2 + p^q 3 -f-, 


(14.122) 


with p\ {) — 1/2 6 coming from the vanishing coefficient of q 2 in sin 3q. Setting the coeffi¬ 
cient of (—q) v in sin( 2 t> + 1 )?? equal to zero yields the identity 


[1 - (2v + l) 2 ] 


1 


+ 


1 


2 2v v!(v + 1)! 2 2 ( v_1 )(y — l)!v! 


= 0 , 


(14.123) 


which verifies the correct determination of the leading terms p[!' ] in Eq. (14.120). The 
vanishing coefficient of q v+i in sin( 2 v + 1)?7 yields 


(-D 


V'+l 


+ [1 - (2v + l) 2 ]^! - p[r l) = 0, (14.124) 


2 2y v!(v + 1 )! 

which implies the main recursion relation for nonleading coefficients, 

(-l ) y+1 


4v(v+ 1 ) p { :\=-pi v ~ l) + 


J V+1 - Hy 

for the first nonleading terms. We verify that 


2 2 v v!(v + 1 )! ’ 


.04 = 

p i'+i 2 2u+2 (v + l)! 2 


(14.125) 


(14.126) 
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satisfies this recursion relation. Higher nonleading terms may be obtained by setting to 
zero the coefficient of q v+2 , etc. Altogether we have derived the Fourier series for 


sej(? 7 , q) — sin ?; + 


OO 

E 

y=i L 


i-q) v 


■ + 


i-q) 


y+l, 


2 2 v v\(y + 1)! 2 2v+2 {y + l)! 2 


sin( 2 v + 1 ) ? 7 . 


(14.127) 


A similar treatment yields the Fourier series for se 2 „+i (q, q ) and se 2 „ (??, q). An invariance 
of Mathieu’s ODE leads to the symmetry relation 

ce 2 „+i(J 7 , q) = (—l)"se 2 n +i(»7 + Jr/2, ~q), (14.128) 

which allows us to determine the ce 2 „+i of period 2n from se 2 n + 1 . Similarly, 

ce 2 « 0 ; + 7 r/ 2 , — q ) = se 2 „(/?, q) relates these Mathieu functions of period n to each other. 

Finally, we briefly outline a derivation of the Fourier series for 

OO OO 

ceo(q,q) = i + '^ / Pn(q)cos2nq, Pn(q)='^ / Pm ) q m ’ (14.129) 

n =1 m=n 

as a paradigm for the Mathieu functions of period tt. Note that this normalization agrees 
with Whittaker and Watson and with Hochstadt in the Additional Readings of Chapter 13, 
whereas in AMS-55 (for the full reference see footnote 4 in Chapter 5) ceo differs by a 
factor of 1 j\fl. The symmetry relation from the Mathieu ODE, 

ce 0 ^ - q, -q^j =ce 0 (»?,< 7 ), (14.130) 

implies 

= (-!)" A,(9); (14.131) 

that is, P 2 n contains only even powers of q and P 211 +] only odd powers. 

The fact that the power series for p n (q) in Eq. (14.129) starts with q " can be proved by 
the similar expansion 

OO OO 

ce 0 (q,q) = ^ (<?) cos 2 " )/, y n (q) = ^ Y^q 1 *, (14.132) 

n =0 fi=0 

as for sej in Eqs. (14.105) to (14.112). Substituting Eq. (14.132) into the integral equation 
ce 0 (? 7 , q) — co(q) [ e 2i ^ cos<>cos,1 ce(0,q)dd, (14.133) 

J —71 

inserting the power series for the exponential function (odd powers cos 2m+1 6 drop out) 
and equating the coefficients of cos 2 '" q yields 

22 m °° pit 

Ym(q) = ci(q)(-q) m ——'£2y fl (q) cos 2m+2 ^ l edd. (14.134) 

\ZfYl). J —71 
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This recursion relation shows that the power series for y m (q ) starts with q m . We expand 


22 n 


— y^ A nm cos 2m rj 


m =0 


with Fourier coefficients 


2 C 71 ! 2 

= -/ ‘ 
ft J— 7r/2 


A nm — — j cos 2 " r]cos2mr]dr] 


1 / 2n 

2 2 " - 1 In — m 


(14.135) 


(14.136) 


which are nonzero only when m < n. Using this result to replace the cosine powers in 
Eq. (14.132) by cos2 mr] we obtain 


i ( d ) — ^ ' A mn y m (q\ 


(14.137) 


confirming Eq. (14.129). 

Proceeding as for sej in Eqs. (14.113) to (14.120) we substitute Eq. (14.129) into the 
integral Eq. (14.133) and obtain 


-)2m 


^2 (-!)'" ~nm)\ qfl+m Amv cos ( 2vr l)AmX 

m,fi,v,k=0 u=0 


with 


= *22 u m pjj! ) q m+li cos(2vri), 

m,ii,v =0 


1 oo 

-= T u m q n 

2nc\{q) ^ 

m =0 


(14.138) 


(14.139) 


Upon comparing the coefficient of q N cos(2 vrf) with N — m + /£, we extract the recursion 

(n) 

relation for leading coefficients p n of ceo 


N 


-)2m m 


T, ( (2 m \\ Amv y.^N-m A mk ~ y, 

m=v 7 ’’ X=0 m =0 


(14.140) 


with A nm in Eq. (14.136). 


Example 14.7.2 Leading Coefficients FOR ceo 

The case N — 0, v = 0 of Eq. (14.140) yields 

A 2 ooC = a ‘ oC’ (14.141) 

with Aoo = 1 and @2 — 1 from normalizing the leading term of ceo to unity so that »o = 1 
results. 

The case N = 1, v — 0 yields 

AqqP[ 0> Aqo — 2Aio[/lo 0, ^io + tfAn] = «o/6j 0> + o;i/3q 0 \ 


(14.142) 
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with J3g — 0 by Eq. (14.129). This simplifies to 


,( 0 ) 1 «( 0 ) o( 0 ) , o( 0 ) 

j i ~ = “iPo +Pi - 


(14.143) 


where /lj 0) drops out. We know already that / s[ 0) = 0 from the leading term unity of ceo. 
Therefore, a\ = — 1/2. 

For the case N — 1, v — 1 we obtain 


-2A 11 ^ 0) A 10 = ao< ) , 


(14.144) 


with Aio = 1/2 = An, from which = — 1/2 follows. For the case N = 2, v = 2 we 
find 


^>A 20 = a Q fc 


(14.145) 


with A 20 = 3/8, from which /j^ 2) = 2 4 follows. The general case N, v = N yields 


(- 1 )^ AnnP^Ano = a 0 p { ^\ 


(14.146) 


withA^^ = 2 2jV+1 , Ajv o = o 2 jv-i Cn )* from which the leading term 


o ( n ) = (-1 r (-ir 

w 2 2A,_1 ( 2 A 1 )! \ jV / 2 2 A '- 1 A ?! 2 


(14.147) 


follows. ■ 

The nonleading terms of ceo are best determined from the angular Mathieu ODE 
by substitution of Eq. (14.129), in analogy with sei, Eqs. (14.121) to (14.127). Using the 
identities 

2 cos(2 nrj) coslr] — cos(2 n + 2 )r] + cos(2 n —2 )r/ 1 


—yCOs( 2 n? 7 ) = — (2n) z cos( 2 n? 7 ), 
dry 2 


(14.148) 


we obtain 


— + (A.q(< j) — 2 q cos 2?;)ceo = 0 


= (q) ~q (~| + + • 


' - 4 " 2 ) cos ( 2n? /) ^ + ^b+ 2?" +2 

72=1 ^ 


i-q) n 

q 2 2,!_1 n! 

72=1 L 


__l a n + 2 

-1„\2 ^ Pn+2% 


x [cos(2n + 2)/; + cos(2n — 2 )jj], 


(14.149) 
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Setting the coefficient of cos(2 nrj) for n — 0 to zero yields the eigenvalue 

,0 = -^ + |, 4 + -. (14.150) 

The coefficient of cos(2 nrj)q n yields an identity. 


(-D 


n +1 


4 n 1 


+ 


(- 1 )" 


2 2 «-!„! 2 2 2 " _3 (« — l )! 2 


= 0 , 


(14.151) 


which shows that the leading term in Eq. (14.147) was correctly determined. The coeffi¬ 
cient of q n+2 cos( 2 n? 7 ) yields the recursion relation 


p, 1+2 V „ + 1 


(n-D | (~D n+1 | 

1 .O 4 


(- 1 )" 


It is straightforward to check that 

o(") 


= (-!)' 


2 2 "n ! 2 2 2,,+1 (n + l )! 2 

„ +1 n(3n+4) 


= 0 . 


r "+2 ' - 2 2 "+3(« + l )! 2 

satisfies this recursion relation. Altogether we have derived the formula 


(14.152) 


(14.153) 


ceo(» 7 , q) — 1 + cos 2 )? 


+ cos 4); 


q~_ 

2 5 


= 1 + y^cos (2 nq) 
n =1 


+■ 

- cos 6)7 

(-?)” 

2 2 "- 1 /?! 2 


<7 




2 7 3 2 

(— l)" + 1 n(3n + 4 )^ ,?+2 
2 2 "+3(n + l)! 2 


(14.154) 


Similarly one can derive 


OO 

cej(? 7 , </) = cos ?7 + ^^cos( 2 n + 1 )?; 

n =1 


(-g)” 

2 2 "/?!()) + 1 )! 


(—q) n+l n 

2 2 "+ 2 (« + l)l 2 + "' 


(14.155) 


whose eigenvalue is given by the power series 


1 , 1 , 

kl( 9 ) = l+ 4 --c/--^ q + 


(14.156) 
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ce 0 (ii;q) 


ca ,(i;q) 



se 2 (n;q) 



« 2 (n; q) 



se 3 (ti; q) 


Figure 14.12 Angular Mathieu functions. (From Gutierrez-Vega et al.. 
Am. J. Phys. 71 : 233 (2003).) 




Exercises 

(n) 

14 . 7.1 Determine the nonleading coefficients /f +2 for sej. Derive a suitable recursion relation. 

(n) 

14 . 7.2 Determine the nonleading coefficients /r +4 for ceo- Derive the corresponding recursion 
relation. 

14 . 7.3 Derive the formula for cei, Eq. (14.155), and its eigenvalue, Eq. (14.156). 

Additional Readings 


Carslaw, H. S., Introduction to the Theory of Fourier's Series and Integrals, 2nd ed. London: Macmillan (1921); 
3rd ed., paperback, New York: Dover (1952). This is a detailed and classic work; includes a considerable 
discussion of Gibbs phenomenon in Chapter IX. 

Hamming, R. W., Numerical Methods for Scientists and Engineers, 2nd ed. New York: McGraw-Hill (1973), 
reprinted Dover (1987). Chapter 33 provides an excellent description of the fast Fourier transform. 

Jeffreys, H., and B. S. Jeffreys, Methods of Mathematical Physics, 3rd ed. Cambridge, UK: Cambridge University 
Press (1972). 

Kufner, A., and J. Kadlec, Fourier Series. London: Iliffe (1971). This book is a clear account of Fourier series in 
the context of Hilbert space. 
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Lanczos, C., Applied Analysis, Englewood Cliffs, NJ: Prentice-Hall (1956), reprinted Dover (1988). The book 
gives a well-written presentation of the Lanczos convergence technique (which suppresses the Gibbs phenom¬ 
enon oscillations). This and several other topics are presented from the point of view of a mathematician who 
wants useful numerical results and not just abstract existence theorems. 

Oberhettinger, F., Fourier Expansions, A Collection of Formulas. New York, Academic Press (1973). 

Zygmund, A., Trigonometric Series. Cambridge, UK: Cambridge University Press (1988). The volume contains 
an extremely complete exposition, including relatively recent results in the realm of pure mathematics. 



Chapter 15 


Integral T ransforms 


15.1 Integral Transforms 

Frequently in mathematical physics we encounter pairs of functions related by an expres¬ 
sion of the form 

g(a)= [ b f(t)K(a,t)dt. (15.1) 

J a 

The function g(a) is called the (integral) transform of /(f) by the kernel K(a,t). 
The operation may also be described as mapping a function f(t) in t -space into another 
function, g(a), in a-space. This interpretation takes on physical significance in the time- 
frequency relation of Fourier transforms, as in Example 15.3.1, and in the real space- 
momentum space relations in quantum physics of Section 15.6. 


Fourier Transform 


One of the most useful of the infinite number of possible transforms is the Fourier trans¬ 
form, given by 

1 f°° 

g(co) = — f(t)e' wt dt. (15.2) 

v 2 jt J —oo 

Two modifications of this form, developed in Section 15.3, are the Fourier cosine and 
Fourier sine transforms: 


[2 r°° 

8c(oj) = ^I~J f (t) coscot dt. 

(15.3) 

[2 r°° 


g s (co) = J- f(t)smootdt. 

V 7T Jo 

(15.4) 
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The Fourier transform is based on the kernel e' mt and its real and imaginary parts taken sep¬ 
arately, cos cot and sin cot. Because these kernels are the functions used to describe waves, 
Fourier transforms appear frequently in studies of waves and the extraction of information 
from waves, particularly when phase information is involved. The output of a stellar in¬ 
terferometer, for instance, involves a Fourier transform of the brightness across a stellar 
disk. The electron distribution in an atom may be obtained from a Fourier transform of the 
amplitude of scattered X-rays. In quantum mechanics the physical origin of the Fourier 
relations of Section 15.6 is the wave nature of matter and our description of matter in terms 
of waves. 


Example 15.1.1 Fourier Transform OF Gaussian 


The Fourier transform of a Gaussian function e ,rr 

1 


g(o) = 


£ 


—at a cot 


e l0)l dt , 


-Jin J —oo 

can be done analytically by completing the square in the exponent. 


— a 2 t 2 + icot — — a A \t -r I- 

2 a 2 ) 4a 2 


ico\~ 


which we check by evaluating the square. Substituting this identity we obtain 


g(a>) = 


1 c -m 2 /4a 2 

~J2tt 



dt , 


upon shifting the integration variable t —*■ t + jrj- This is justified by an application of 
Cauchy’s theorem to the rectangle with vertices —T, T, T + — T + ^ for T -> 

oo, noting that the integrand has no singularities in this region and that the integrals over 
the sides from ±T to ±T + become negligible for T —> oo. Finally we rescale the 
integration variable as | = at in the integral (see Eqs. (8.6) and (8.8)): 




dt; = 


■sftt 

a 


Substituting these results we find 


1 / co 2 \ 

s( " )= ^r xi V 5 ?> 

again a Gaussian, but in «-space. The bigger a is, that is, the narrower the original Gaussian 
e~ a -'~ is, the wider is its Fourier transform ~ e~ w ~/ 4cr . ■ 
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Laplace, Mellin, and Hankel Transforms 

Three other useful kernels are 


e 


—at 


tJ„(at), t a 1 . 


These give rise 
g(a) 
g(a) 
g(ot) 


to the following transforms 

f dt, Laplace transform 

f(t)tJ n (at) dt, Hankel transform (Fourier-Bessel) 
Mellin transform. 


f 

f 


/*oo 

/ f(t)t a ~ l dt, 
Jo 


(15.5) 

(15.6) 

(15.7) 


Clearly, the possible types are unlimited. These transforms have been useful in mathemati¬ 
cal analysis and in physical applications. We have actually used the Mellin transform with¬ 
out calling it by name; that is, g(a) — (a — 1)! is the Mellin transform of f(t) = e~’. See 
E. C. Titchmarsh, Introduction to the Theory of Fourier Integrals, 2nd ed.. New York: Ox¬ 
ford University Press (1937), for more Mellin transforms. Of course, we could just as well 
say g(a) = n\/a n+l is the Laplace transform of fit) — t". Of the three, the Laplace trans¬ 
form is by far the most used. It is discussed at length in Sections 15.8 to 15.12. The Hankel 
transform, a Fourier transform for a Bessel function expansion, represents a limiting case 
of a Fourier-Bessel series. It occurs in potential problems in cylindrical coordinates and 
has been applied extensively in acoustics. 


Linearity 


All these integral transforms are linear; that is, 

f*b 


f [c\f\(t)+c 2 f 2 (t)]K(a,t)dt 
J a 




t)dt + C 2 I f2(t)K(a, t) dt 


f 


f 


cf(t)K(a,t)dt = c f(t)K(a,t)dt, 


f 


(15.8) 

(15.9) 


where ci and o are constants and f\ (t) and f 2 (t) are functions for which the transform 
operation is defined. 

Representing our linear integral transform by the operator £, we obtain 


g{ot) = Cf(f). 


(15.10) 
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Figure 15.1 Schematic integral transforms. 


We expect an inverse operator C 1 exists such that 1 

f(f) = C- 1 g(a). (15.11) 

For our three Fourier transforms £ _1 is given in Section 15.3. In general, the determination 
of the inverse transform is the main problem in using integral transforms. The inverse 
Laplace transform is discussed in Section 15.12. For details of the inverse Hankel and 
inverse Mellin transforms we refer to the Additional Readings at the end of the chapter. 

Integral transforms have many special physical applications and interpretations that 
are noted in the remainder of this chapter. The most common application is outlined in 
Fig. 15.1. Perhaps an original problem can be solved only with difficulty, if at all, in the 
original coordinates (space). It often happens that the transform of the problem can be 
solved relatively easily. Then the inverse transform returns the solution from the trans¬ 
form coordinates to the original system. Example 15.4.1 and Exercise 15.4.1 illustrate this 
technique. 


Exercises 


15 . 1.1 The Fourier transforms for a function of two variables are 

r»QO 


F(u, V )=^~ f°° [ f(x,y)e i(ux+vy) dxdy, 
2tt J-ooJ 

f{x,y) — -— f f F{u,v)e~ l(jix+Vy ^ dudv. 
2tt J-ooJ 


Using f(x, y) = f([x 2 + y 2 ] 1 / 2 ), show that the zero-order Hankel transforms 

/»OO 

F(p)= / rf(r)J Q (pr)dr , 


/(r)= / pF(p)J 0 (pr)dp , 

Jo 

are a special case of the Fourier transforms. 


L 

-r 


1 Expectation is not proof, and here proof of existence is complicated because we are actually in an infinite-dimensional Hilbert 
space. We shall prove existence in the special cases of interest by actual construction. 
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15 . 1.2 


15 . 1.3 


15 . 1.4 


This technique may be generalized to derive the Hankel transforms of order v = 
0, j, 1, j,... (compare I. N. Sneddon, Fourier Transforms , New York: McGraw-Hill 
(1951)). A more general approach, valid for v > — is presented in Sneddon’s The Use 
of Integral Transforms (New York: McGraw-Hill (1972)). It might also be noted that 
the Hankel transforms of nonintegral order v — ± \ reduce to Fourier sine and cosine 
transforms. 


Assuming the validity of the Hankel transform-inverse transform pair of equations 


g(«) 


fit) 


-f 

-r 

Jo 


f(t)J n (at)tdt, 


g(a)J n (at)a da, 


show that the Dirac delta function has a Bessel integral representation 


S(t 


-t') = t f 

Jo 


J„ ( at)J n (at')a da. 


This expression is useful in developing Green’s functions in cylindrical coordinates, 
where the eigenfunctions are Bessel functions. 

From the Fourier transforms, Eqs. (15.22) and (15.23), show that the transformation 

t -> In x 


leads to 


and 


a — y 


poo 

G(a) = / F{x)x a ~ l dx 

Jo 


1 m 

Fix) = — / 

ZlCl Jy — i 


y+ioo 


G(a)x~ ot da. 


y—ioo 


These are the Mellin transforms. A similar change of variables is employed in Sec¬ 
tion 15.12 to derive the inverse Laplace transform. 

Verify the following Mellin transforms: 


C JT Ot 

(a) / x a ~ 1 sin(kx) dx = k~ a (a — 1)! sin —, 

Jo 2 

(b) / cos (kx) dx — k~ 0l (a — 1)! cos —, 

Jo 2 


— 1 < a < 1. 

0 < a < 1. 


Hint. You can force the integrals into a tractable form by inserting a convergence factor 
e~ hx and (after integrating) letting b —»• 0. Also, cos kx + i sin kx — exp ikx. 
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15.2 Development of the Fourier Integral 


In Chapter 14 it was shown that Fourier series are useful in representing certain func¬ 
tions (1) over a limited range [0, 2 tt], [— L, L], and so on, or (2) for the infinite interval 
(—oo, oo), if the function is periodic. We now turn our attention to the problem of rep¬ 
resenting a nonperiodic function over the infinite range. Physically this means resolving a 
single pulse or wave packet into sinusoidal waves. 

We have seen (Section 14.2) that for the interval [— L,L] the coefficients a„ and b„ 
could be written as 


a n 

b n 

The resulting Fourier series is 



(15.12) 

(15.13) 


/(*) = 


1 

2L 


r L i 00 

J f(t)dt- h-^\ 

—L n=1 


mxx 

~L 



njrt 

cos- clt 

L 



njrt 

fit) sin —j—dt, 


(15.14) 


or 

1 f L 1 ^4 f L nix 

fix) = — j f(t)dt+-J2j f(t)cos-(t-x)dt. (15.15) 

We now let the parameter L approach infinity, transforming the finite interval [— L, L] into 
the infinite interval (—oo, oo). We set 
hjt 7r 

— —co, — = A co, with L -> oo. 

L L 

Then we have 


or 


fix) 



f(t)cosco(t — x)dt, 


(15.16) 


fix) = 



f(t)cosco(t — x)dt. 


(15.17) 


replacing the infinite sum by the integral over co. The first term (corresponding to af) has 
vanished, assuming that f_ f(t)dt exists. 

It must be emphasized that this result (Eq. (15.17)) is purely formal. It is not intended 
as a rigorous derivation, but it can be made rigorous (compare I. N. Sneddon, Fourier 
Transforms, Section 3.2). We take Eq. (15.17) as the Fourier integral. It is subject to the 
conditions that fix) is (1) piecewise continuous, (2) piecewise differentiable, and (3) ab¬ 
solutely integrable — that is, \fix)\ dx is finite. 
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Fourier Integral — Exponential Form 


Our Fourier integral (Eq. (15.17)) may be put into exponential form by noting that 


1 r°° f 

= ~ d(a 

J —oo J —oo 


fix) = z- 


f(t) cos co{t — x)clt, 


whereas 


1 f 

0 — / d «> / 
J —OO J — 


fit) sin wit — x)dt — 0; 


(15.18) 


(15.19) 


oo J —OO 


cos w{t — x) is an even function of o> and sin o>(t — x) is an odd function of o>. Adding 
Eqs. (15.18) and (15.19) (with a factor i), we obtain the Fourier integral theorem 


-±r 

2n 


fix) = — 


duo / f(t)e l0J 'dt. 


(15.20) 


The variable u> introduced here is an arbitrary mathematical variable. In many physical 
problems, however, it corresponds to the angular frequency to. We may then interpret 
Eq. (15.18) or (15.20) as a representation of fix) in terms of a distribution of infinitely 
long sinusoidal wave trains of angular frequency to, in which this frequency is a continu¬ 
ous variable. 

Dirac Delta Function Derivation 

If the order of integration of Eq. (15.20) is reversed, we may rewrite it as 


r°° 1 f 

'=L m kL 


— / e ico(, - x) d(o\dt. 


(15.20a) 


Apparently the quantity in curly brackets behaves as a delta function Sit — x). We might 
take Eq. (15.20a) as presenting us with a representation of the Dirac delta function. Alter¬ 
natively, we take it as a clue to a new derivation of the Fourier integral theorem. 

From Eq. (1.171b) (shifting the singularity from t — 0 to t — x). 


fix) — lim / f(t)8„it - x)dt, 


(15.21a) 


where S n it — x) is a sequence defining the distribution Sit — x). Note that Eq. (15.21a) 
assumes that fit) is continuous at t — x. We take <5„(r — x) to be 


Snit — x) = 


sin nit — x) 1 f n 

nit — x) 2n 


using Eq. (1.174). Substituting into Eq. (15.21a), we have 

j r oo pn 

fix0= lim — / fit) / e lw{f ~ x) d(Ddt. 
n ^ oo 2n J_oo J-n 


(15.21b) 


(15.21c) 
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Interchanging the order of integration and then taking the limit as h oo, we have 
Eq. (15.20), the Fourier integral theorem. 

With the understanding that it belongs under an integral sign, as in Eq. (15.21a), the 
identification 

(15.2 Id) 

provides a very useful representation of the delta function. 



15.3 Fourier Transforms — Inversion Theorem 


Let us define g(o>), the Fourier transform of the function /(f), by 


1 r °° 

g{w) = -= / f(t)e la>, dt. 
v 2jt J— oo 


(15.22) 


Exponential Transform 


Then, from Eq. (15.20), we have the inverse relation. 


fit) = 


\Fht J-c 


(15.23) 


Note that Eqs. (15.22) and (15.23) are almost but not quite symmetrical, differing in the 
sign of i. 

Here two points deserve comment. First, the 1 j\ffjz symmetry is a matter of choice, 
not of necessity. Many authors will attach the entire 1/2 jt factor of Eq. (15.20) to one 
of the two equations: Eq. (15.22) or Eq. (15.23). Second, although the Fourier integral, 
Eq. (15.20), has received much attention in the mathematics literature, we shall be primar¬ 
ily interested in the Fourier transform and its inverse. They are the equations with physical 
significance. 

When we move the Fourier transform pair to three-dimensional space, it becomes 


g( k) = 


fir) = 


(2jt) 3 / 2 


(27r) 3 / 2 


I f (r)e ik r d 3 r, 

J g(k)e~' kr d 3 k. 


(15.23a) 


(15.23b) 


The integrals are over all space. Verification, if desired, follows immediately by substitut¬ 
ing the left-hand side of one equation into the integrand of the other equation and using the 
three-dimensional delta function. 2 Equation (15.23b) may be interpreted as an expansion 
of a function /(r) in a continuum of plane wave eigenfunctions; g ( k) then becomes the 
amplitude of the wave, exp(—/k • r). 


2 <5(ri — r 2 > = S(x\ -X2)S(y\ - y2)S(zi - Zl) with Fourier integral S(xi -xn)= - xi)] dk\ , etc. 
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Cosine Transform 


If fix) is odd or even, these transforms may be expressed in a somewhat different 
form. Consider first an even function f c with f c (x) = f c (—x). Writing the exponential 
of Eq. (15.22) in trigonometric form, we have 


gdo>) = 


j: 

/; 


1 

y/2n J-c 

2 
7r 


f c (t )(cos cot + i sin cot)dt 


f c {t) cos cot dt. 


(15.24) 


the sin cot dependence vanishing on integration over the symmetric interval (— 00 , 00 ). 
Similarly, since cos cot is even, Eqs. (15.23) transforms to 


[2 r°° 

fc(x) = ,/ / g c (a>) cos cox dco. (15.25) 

V 7X Jo 

Equations (15.24) and (15.25) are known as Fourier cosine transforms. 


Sine Transform 

The corresponding pair of Fourier sine transforms is obtained by assuming that f s (x) — 
— f s (—x ), odd, and applying the same symmetry arguments. The equations are 

gs(co) = ^J f s (t) sin cot dt, 3 

[2 f°° 

fsix) — , — I g s (ft>) sin cox d co 

V ?t J 0 

From the last equation we may develop the physical interpretation that fix) is being 
described by a continuum of sine waves. The amplitude of sin cox is given by *J2/tx g s (co), 
in which g s ico) is the Fourier sine transform of fix). It will be seen that Eq. (15.27) is the 
integral analog of the summation (Eq. (14.24)). Similar interpretations hold for the cosine 
and exponential cases. 

If we take Eqs. (15.22), (15.24), and (15.26) as the direct integral transforms, de¬ 
scribed by C in Eq. (15.10) (Section 15.1), the corresponding inverse transforms, L~ x 
of Eq. (15.11), are given by Eqs. (15.23), (15.25), and (15.27). 

Note that the Fourier cosine transforms and the Fourier sine transforms each involve 
only positive values (and zero) of the arguments. We use the parity of fix) to establish the 
transforms; but once the transforms are established, the behavior of the functions / and g 
for negative argument is irrelevant. In effect, the transform equations themselves impose 
a definite parity: even for the Fourier cosine transform and odd for the Fourier sine 
transform. 


3 Note that a factor — i has been absorbed into this g(a>). 


(15.26) 

(15.27) 
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Figure 1 5.2 Finite wave train. 


Example 15.3.1 


Finite Wave Train 


An important application of the Fourier transform is the resolution of a finite pulse into 
sinusoidal waves. Imagine that an infinite wave train sin wot is clipped by Kerr cell or 
saturable dye cell shutters so that we have 


fit) = 


sina>oT 

0 , 


\t\ < 
\t\ > 


Njt 

a>o 

Njt 

co o 


(15.28) 


This corresponds to N cycles of our original wave train (Fig. 15.2). Since f{t) is odd, we 
may use the Fourier sine transform (Eq. (15.26)) to obtain 


gsico) = 


L 


2 

n Jo 


Njt/coq 


sinft>o/ sin&>r dt. 


Integrating, we find our amplitude function: 


(15.29) 


gs (co) = 



sin[(a>o — co)(Njt/coo)] 
2(&>o — co) 


sin[(&>o + co)(Njt/coo)] 
2 ( 0*0 + co) 


(15.30) 


It is of considerable interest to see how g s (co) depends on frequency. For large co o and 
co ~ o*o, only the first term will be of any importance because of the denominators. It is 
plotted in Fig. 15.3. This is the amplitude curve for the single-slit diffraction pattern. 
There are zeros at 


o*o — co Ao> 1 2 

-=-= ± —, ± —, and so on. 

o*o o*o N N 


(15.31) 


For large N, g s (co) may also be interpreted as a Dirac delta distribution, as in Section 1.15. 
Since the contributions outside the central maximum are small in this case, we may take 


Ao> = —- (15.32) 

N 

as a good measure of the spread in frequency of our wave pulse. Clearly, if N is large 
(a long pulse), the frequency spread will be small. On the other hand, if our pulse is clipped 
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&(<*>) 



Figure 15.3 Fourier transform 
of finite wave train. 


short, N small, the frequency distribution will be wider and the secondary maxima are more 
important. ■ 
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Exercises 


15.3.1 (a) Show that gi—co) = g*(o>) is a necessary and sufficient condition for /(r) to be 

real. 

(b) Show that g(—co) = —g*(co) is a necessary and sufficient condition for fix) to be 
pure imaginary. 

Note. The condition of part (a) is used in the development of the dispersion relations of 
Section 7.2. 


15.3.2 


15.3.3 


Let F(co) be the Fourier (exponential) transform of fix) and G(co) be the Fourier trans¬ 
form of g(x) — f(x + a). Show that 

G(co) = e~ iaM F(co). 


The function 


/(*) = 


1, 

0, 


is a symmetrical finite step function. 


1*1 < 1 
1*1 > 1 


15.3.4 


15.3.5 


(a) Find the g c (co), Fourier cosine transform of f(x). 

(b) Taking the inverse cosine transform, show that 


fix) = - 

7T 


f 


sin co cos cox 


(c) From part (b) show that 


f 

Jo 


sin co cos cox 


-dco = 


co 

0 , 

;r 
4 ’ 
7r 
2 ’ 


-dco. 


1*1 > 1 , 
1*1 = 1 . 
1*1 < 1 . 


gsico)=J~ 


gciO0) =J~ 


•, 2 ' 


n co z + a z V 7r co- + a- 

Hint. Each of the transforms can be related to the other by integration by parts, 
(b) Show that 


&> sin car n _ nr 

/ ^5-7<ia>= —e ax , 

Jo co- +a- 2 

f°° cos cur , 7T _ nr 

/ - xdco= —e a x , 

Jo co- + 2a 


x > 0, 


r > 0. 


These results are also obtained by contour integration (Exercise 7.1.14). 
Find the Fourier transform of the triangular pulse (Fig. 15.4). 


fix) = 


h(l-a\x\), |*| <\, 

| 0 . 1*1 >1 

Note. This function provides another delta sequence with h — a and a —> oo. 
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15.3.6 


15.3.7 


15.3.8 


15.3.9 



Figure 15.4 Triangular pulse. 


Define a sequence 


8n(x) = 


n, 

0 , 


1*1 < 5T> 


(This is Eq. (1.172).) Express 8 n (x) as a Fourier integral (via the Fourier integral theo¬ 
rem, inverse transform, etc.). Finally, show that we may write 


<$(*) = lim 8„{x) = — 

n—>oo 


l r° 

nL 


e~' kx dk. 


Using the sequence 


show that 


Yl / 2 2 \ 

& n (x) = —— expl — n x~), 

y/Tt 


i r c 


e~ ikx dk. 


Note. Remember that S(x) is defined in terms of its behavior as part of an integrand 
(Section 1.15), especially Eqs. (1.178) and (1.179). 

Derive sine and cosine representations of 8 (t — x) that are comparable to the exponential 
representation, Eq. (15.2Id). 


2 2 /*°° 

ANS. — / sin&>rsina>;t</<y, — / cos cot cos cox dm. 

Jn X Jo 


In a resonant cavity an electromagnetic oscillation of frequency co o dies out as 
A(t) = A 0 e~ cootl2Q e- imot , t> 0. 


(Take A(t) — 0 t'oi 't < 0.) The parameter Q is a measure of the ratio of stored energy to 
energy loss per cycle. Calculate the frequency distribution of the oscillation, a* (o))a((o), 
where a (a)) is the Fourier transform of A(t). 

Note. The larger Q is, the sharper your resonance line will be. 


ANS. a*(co)a(co) = 


2jt (co - wo) 2 + (<wo/2Q) 2 ’ 
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15.3.10 Prove that 

h r°° e~ iM, dw _ |exp(-^)exp(-^), t> 0, 

2ni Loo E 0 - iT/2 - hco [ o, t < 0. 

This Fourier integral appears in a variety of problems in quantum mechanics: WKB 
barrier penetration, scattering, time-dependent perturbation theory, and so on. 

Hint. Try contour integration. 

15.3.11 Verify that the following are Fourier integral transforms of one another: 


(a) 

(b) 

(c) 
fd) 


V tv V a 2 — x 2 
0, 
o, 


1 


n Vx 2 + a 2 


\x\<ci, and Jq( ay), 

\x\ > a, 

\x\ < a, 

|x| > a, and Vo(fl|y|), 


1 


and 


^o(fl|y|). 


2 Vx 2 + a 2 

Can you suggest why Io(ay) is not included in this list? 


Hint. Jq, Nq, and Kq may be transformed most easily by using an exponential repre¬ 
sentation, reversing the order of integration, and employing the Dirac delta function 
exponential representation (Section 15.2). These cases can be treated equally well as 
Fourier cosine transforms. 

Note. The Kq relation appears as a consequence of a Green’s function equation in Ex¬ 
ercise 9.7.14. 

15.3.12 A calculation of the magnetic field of a circular current loop in circular cylindrical 
coordinates leads to the integral 

nOO 

/ cos kzkK\(kci)dk. 

Jo 

Show that this integral is equal to 

na 

2 (z 2 + a 2 ) 3 / 2 

Hint. Try differentiating Exercise 15.3.11(c). 

15.3.13 As an extension of Exercise 15.3.11, show that 

1 * 0 O 1 * 0 O 1 * 0 O Jj, 

(a)/ Jo(y') dy = 1, (b) / N 0 (y)dy = 0, (c) / K Q (y)dy=-. 

Jo Jo Jo l 

15.3.14 The Fourier integral, Eq. (15.18), has been held meaningless for f(t) — cos at. Show 
that the Fourier integral can be extended to cover / (?) = cos a? by use of the Dirac delta 
function. 
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15.3.15 


15.3.16 


15.3.17 


15.3.18 


15.3.19 


15.3.20 


Show that 



sinA:a Jo(kp) elk = 


(i a 2 

0, 


P 2 ) 


- 1/2 


p < a, 
p > a. 


Here a and p are positive. The equation comes from the determination of the distribution 
of charge on an isolated conducting disk, radius a. Note that the function on the right 
has an infinite discontinuity at p — a. 

Note. A Laplace transform approach appears in Exercise 15.10.8. 

The function f(r) has a Fourier exponential transform. 


g(k) = 


1 


(27T) 3 / 2 


/ 


f(r)e ikr d 3 r = 


1 

(27r) 3 / 2 A: 2 


Determine /(r). 

Hint. Use spherical polar coordinates in fc-space. 

ANS. / (r) = —. 

4jrr 

(a) Calculate the Fourier exponential transform of fix) — e~ a ^. 

(b) Calculate the inverse transform by employing the calculus of residues (Sec¬ 
tion 7.1). 

Show that the following are Fourier transforms of each other 


i n J n {t) and 


J-T„(x){ 1-x 2 ) 1/2 , |*| <1, 

V Tt 

0 , 1*1 > 1 . 


T n (x) is the nth-order Chebyshev polynomial. 

Hint. With T n (cosd) — cos nO. the transform of T„(*)( 1 — x 2 ) -1 / 2 leads to an integral 
representation of J„(t). 

Show that the Fourier exponential transform of 


/(M) = 


Pnip), 

0, 


N<1, 

M > i 


is {2i n /2jt)jn{kr). Here P n (p-) is a Legendre polynomial and j n (kr) is a spherical 
Bessel function. 

Show that the three-dimensional Fourier exponential transform of a radially symmetric 
function may be rewritten as a Fourier sine transform: 


1 

( 27 r ) 3 / 2 



f(r)e 


ikr 




sin kr dr. 
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15.3.21 (a) Show that f{x) — x 12 is a self-reciprocal under both Fourier cosine and sine 

transforms; that is, 


M 


— x 1 / 2 cos xtdx = t ly/2 , 


x 1 / 2 sin xtds = t 1 ^ 2 . 


(b) Use the preceding results to evaluate the Fresnel integrals / 0 °° cosfv 2 ) dy and 
f™sin(y 2 )dy. 


15.4 Fourier Transform of Derivatives 

In Section 15.1, Fig. 15.1 outlines the overall technique of using Fourier transforms and 
inverse transforms to solve a problem. Here we take an initial step in solving a differential 
equation — obtaining the Fourier transform of a derivative. 

Using the exponential form, we determine that the Fourier transform of fix) is 

i r°° 

g(co)= — f (x)e ,c0X dx (15.37) 

V Z7T J —oo 

and for df(x)/dx 

gi (<w) = ~7f = dx. (15.38) 

V27T J—oo dx 

Integrating Eq. (15.38) by parts, we obtain 

giaix oo i(jj 

gl (co)=—=f(x) ~^= f(x)e ,cox dx. (15.39) 

V27T -oo v27T J — oo 

If f(x) vanishes 4 as x -> ±oo, we have 

glico) — -icogico); (15.40) 

that is, the transform of the derivative is i—ico) times the transform of the original function. 
This may readily be generalized to the nth derivative to yield 

g n (co) = (-ico) n g(co), (15.41) 

provided all the integrated parts vanish as x -> ±oo. This is the power of the Fourier 
transform, the reason it is so useful in solving (partial) differential equations. The operation 
of differentiation has been replaced by a multiplication in space. 

4 Apart from cases such as Exercise 15.3.6. fix) must vanish as x -x ±oo in order for the Fourier transform of fix) to exist. 
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This technique may be used to advantage in handling PDEs. To illustrate the technique, let 
us derive a familiar expression of elementary physics. An infinitely long string is vibrating 
freely. The amplitude y of the (small) vibrations satisfies the wave equation 


3 2 y 1 3 2 y 
dx 2 v 2 3 1 2 

We shall assume an initial condition 


(15.42) 


y(.r, 0) = f(x). 


(15.43) 


where / is localized, that is, approaches zero at large x. 

Applying our Fourier transform in x, which means multiplying by e lax and integrating 
over x , we obtain 



3 2 y(x, t) 
dx 2 


e iax 




3 2 y(x,t) 
3 1 2 


e iax 


dx 


or 


Here we have used 


(— ia) 2 Y(a, t) 


1 d 2 Y(a,t) 
v 2 3 1 2 


Y(a, t ) = 



(15.44) 


(15.45) 


(15.46) 


and Eq. (15.41) for the second derivative. Note that the integrated part of Eq. (15.39) van¬ 
ishes: The wave has not yet gone to ±oo because it is propagating forward in time, and 
there is no source at infinity because /(±oo) = 0. Since no derivatives with respect to 
a appear, Eq. (15.45) is actually an ODE — in fact, the linear oscillator equation. This 
transformation, from a PDE to an ODE, is a significant achievement. We solve Eq. (15.45) 
subject to the appropriate initial conditions. At 1 — 0, applying Eq. (15.43), Eq. (15.46) 
reduces to 


i r°° 

Y(a, 0) = —= / f(x)e' ax dx = F(a). 
V 2.71 J — oo 

The general solution of Eq. (15.45) in exponential form is 


(15.47) 


Y(a, t ) = F(a)e 


±ivcit 


(15.48) 


Using the inversion formula (Eq. (15.23)), we have 


y(x,t) 



Y(a, t)e mx da, 


and, by Eq. (15.48), 


y(x,t) = 



(15.49) 


F(a)e- ia ^ vt) da. 


(15.50) 
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Since f(x) is the Fourier inverse transform of F(a), 

y(x,t) = f(xTvt), (15.51) 

corresponding to waves advancing in the +x- and —x -directions, respectively. 

The particular linear combinations of waves is given by the boundary condition of 
Eq. (15.43) and some other boundary condition, such as a restriction on dy/dt. ■ 

The accomplishment of the Fourier transform here deserves special emphasis. 

• Our Fourier transform converted a PDE into an ODE, where the “degree of transcen¬ 
dence” of the problem was reduced. 

In Section 15.9 Laplace transforms are used to convert ODEs (with constant coefficients) 
into algebraic equations. Again, the degree of transcendence is reduced. The problem is 
simplified — as outlined in Fig. 15.1. 


Example 15.4.2 Heat Flow PDE 


To illustrate another transformation of a PDE into an ODE, let us Fourier transform the 
heat flow partial differential equation 


3i jr ,3“i jr 

— = a ~— 

3 1 dx 2 

where the solution \(/ (x, t ) is the temperature in space as a function of time. By taking the 
Fourier transform of both sides of this equation (note that here only w is the transform 
variable conjugate to x because t is the time in the heat flow PDE), where 


q/fcy, t) 


\ ' ■ J~, 


j: 


i/f(x, t)e' mx dx, 


this yields an ODE for the Fourier transform 4> of x[r in the time variable t, 


34'(<w,f) , 9 

-= — fl 2 ftr4'(&>, t). 

3 1 


Integrating we obtain 


In 4> = —a 2 art + In C, 


or 


4> = Ce _ 


where the integration constant C may still depend on a> and, in general, is determined 
by initial conditions. In fact, C = T (o>, 0) is the initial spatial distribution of T. so it is 
given by the transform (in x) of the initial distribution of i/r, namely, i Jr(x, 0). Putting this 
solution back into our inverse Fourier transform, this yields 

1 r °° . 22 

iAO, t) = —= / C(co)e~ ,(OX e~ a dco. 
s/ 2,71 J — oo 

For simplicity, we here take C cu-independent (assuming a delta-function initial temper¬ 
ature distribution) and integrate by completing the square in a>, as in Example 15.1.1, 
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making appropriate changes of variables and parameters ( a 2 —»■ a 2 t. co —> x, t —> —co). 
This yields the particular solution of the heat flow PDE, 

which appears as a clever guess in Chapter 8. In effect, we have shown that i/r is the inverse 
Fourier transform of C exp (—a 2 art). ■ 


Example 15.4.3 inversion of pde 

Derive a Fourier integral for the Green’s function Go of Poisson’s PDE, which is a solution 
of 


V 2 G 0 (r,r') = -<5(r-r'). 
Once Go is known, the general solution of Poisson’s PDE, 

V 2 <t> = —47rp(r) 


of electrostatics, is given as 

<D(r) = J G 0 (r,r')47rp(rVV. 

Applying V 2 to and using the PDE the Green’s function satisfies, we check that 
V 2 0(r) = J V 2 G 0 (r, r')47rp(r')d 3 r' = - J S(r - r')4jrp(r') d 3 r' = -4np(r). 

Now we use the Fourier transform of Gq, which is go, and of that of the S function, writing 


7 


go(pV 


,ip-(r—r') d3 P = _ J ^/p (r-r') _^P_ 


(2jr) 3 


(2 n ) 2 


Because the integrands of equal Fourier integrals must be the same (almost) everywhere, 
which follows from the inverse Fourier transform, and with 


Ve <p-(r-r') = ipe 'P(r-r') ) 


this yields — p 2 go(p) = — 1. Therefore, application of the Faplacian to a Fourier integral 
/(r) corresponds to multiplying its Fourier transform g(p) by —p 2 . Substituting this solu¬ 
tion into the inverse Fourier transform for Go gives 


G 0 (r,r') 


f J P (r—Q d3 P 

J (27r) 3 p 2 


1 

4n\r-r'\ 


We can verify the last part of this result by applying V 2 to Go again and recalling from 
Chapter 1 that V 2 r _^ r , = —^4 tt< 5 (r — r'). 
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The inverse Fourier transform can be evaluated using polar coordinates, exploiting the 
spherical symmetry of p 2 . For simplicity, we write R = r — r' and call 0 the angle between 
R and p. 




poo 

r 1 

pin 



dp / e ipRcoae dcos0 / 

dcp 

Jo 

7-1 

Jo 


2tt 

f JP ppR cos 0 

1 

4 71 

Jr . 

!o p 

cos Q— —1 

R 

471 

r°° sin dR 

lit 2 


— 

— ——d(pR) — 



sin pR 


dp 


where 9 and q> are the angles of p and ^j^dx — j, from Example 7.1.4. Dividing by 
(27r) 3 , we obtain Gq(R) = 1 /(An R). as claimed. An evaluation of this Fourier transform 
by contour integration is given in Example 9.7.2. ■ 


Exercises 


15.4.1 The one-dimensional Fermi age equation for the diffusion of neutrons slowing down in 
some medium (such as graphite) is 

d 2 q(x,r ) 3 q{x,x) 

dx 2 dr 

Here q is the number of neutrons that slow down, falling below some given energy per 
second per unit volume. The Fermi age, r, is a measure of the energy loss. 

If q(x, 0) = SS (x), corresponding to a plane source of neutrons at x = 0, emitting S 
neutrons per unit area per second, derive the solution 

-* 2 /4r 

q = S ~K=- 

\j4lZX 


Hint. Replace q(x,x) with 


P(k, r) = 


\Fhi J- 


£ 


q(x, r)e' kx dx. 


This is analogous to the diffusion of heat in an infinite medium. 


15.4.2 Equation (15.41) yields 


gl(oj) = -co 2 g(w) 


for the Fourier transform of the second derivative of f(x). The condition fix) —> 0 for 
x -> ±oo may be relaxed slightly. Find the least restrictive condition for the preceding 
equation for g 2 (a >) to hold. 


dfix) 

dx 


- iwf(x) 


= 0 . 


ANS. 


—oo 
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15.4.3 


15.4.4 


15.4.5 


15.5 


The one-dimensional neutron diffusion equation with a (plane) source is 

d 2 w(x) t 

~ D ^r- + K D( P(x) = QS(x ), 


where (p(x ) is the neutron flux, Q8(x) is the (plane) source at x = 0, and D and K 2 are 
constants. Apply a Fourier transform. Solve the equation in transform space. Transform 
your solution back into x-space. 


ANS. <p(x) = 


Q e ~\Kx\ 
2 KD 


For a point source at the origin, the three-dimensional neutron diffusion equation be¬ 
comes 


—DN 2 (p{ r) + K 2 D(p( r) = Q8( r). 

Apply a three-dimensional Fourier transform. Solve the transformed equation. Trans¬ 
form the solution back into r-space. 

(a) Given that F(k) is the three-dimensional Fourier transform of /(r) and F\ (k) is 
the three-dimensional Fourier transform of V/(r), show that 

fi(k) = (-ik)F(k). 

This is a three-dimensional generalization of Eq. (15.40). 

(b) Show that the three-dimensional Fourier transform of V • V/(r) is 

F 2 (k) = (-zk) 2 F(k). 

Note. Vector k is a vector in the transform space. In Section 15.6 we shall have 
hk = p, linear momentum. 

Convolution Theorem 

We shall employ convolutions to solve differential equations, to normalize momentum 
wave functions (Section 15.6), and to investigate transfer functions (Section 15.7). 

Let us consider two functions fix) and g(x) with Fourier transforms Fit) and Git), 
respectively. We define the operation 

f*g=-^=f°° g(y)f(x - y)dy (15.52) 

V ATT J —oo 

as the convolution of the two functions / and g over the interval (—oo, oo). This form of 
an integral appears in probability theory in the determination of the probability density of 
two random, independent variables. Our solution of Poisson’s equation, Eq. (9.148), may 
be interpreted as a convolution of a charge distribution, p(r 2 ), and a weighting function, 
(47reo|ri — r 2 |) _1 . In other works this is sometimes referred to as the Faltung, to use the 
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German term for “folding.” 5 We now transform the integral in Eq. (15.52) by introducing 
the Fourier transforms: 



g(y)f(x - y)dy = 


1 


VZtt J- 

1 

s/Tjz J- 


f°° g(y ) f 

J —oo J - 

/>[/ 


F(t)e 


-it(x-y) 


dt dy 


—OO 
OO 


g(y)e ,ty dy \e l,x dt 



F(t)G{t)e~ itx dt, 


(15.53) 


interchanging the order of integration and transforming g(y). This result may be inter¬ 
preted as follows: The Fourier inverse transform of a product of Fourier transforms is the 
convolution of the original functions, / * g. 

For the special case i = 0we have 

/ oo /»oo 

F(t)G(t)dt = I f{—y)g{y)dy. (15.54) 

-OO J —OO 

The minus sign in —y suggests that modifications be tried. We now do this with g* instead 
of g using a different technique. 


Parseval’s Relation 

Results analogous to Eqs. (15.53) and (15.54) may be derived for the Fourier sine and co¬ 
sine transforms (Exercises 15.5.1 and 15.5.3). Equation (15.54) and the corresponding sine 
and cosine convolutions are often labeled Parseval’s relations by analogy with Parseval’s 
theorem for Fourier series (Chapter 14, Exercise 14.4.2). 


For f(y) = e ?, f(y) and fix — v) are plotted in Fig. 15.5. Clearly, f(y) and f{x — y ) are mirror images of each other in 
relation to the vertical line y — x /2, that is, we could generate fix — y) by folding over f(y) on the line y = x/2. 
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The Parseval relation 6 7 



F(co)G*(co)dco 





(15.55) 


may be derived elegantly using the Dirac delta function representation, Eq. (15.2Id). We 
have 

/ oo p co | p co j p co 

f(t)g*(t)dt = —= F(co)e~ ic0t dco ■ —j= I G*(x)e ixt dxdt, 

-oo J —co v 27T J —co v 271 J—oo 

(15.56) 

with attention to the complex conjugation in the G*(x) to g*(t) transform. Integrating over 
/ first, and using Eq. (15.21d), we obtain 



f(t)g*(t)dt 




G*(x)S(x — co) dx dco 


F (co)G* (co) dco, 


(15.57) 


our desired Parseval relation. If /(f) = g(t), then the integrals in the Parseval relation are 
normalization integrals (Section 10.4). Equation (15.57) guarantees that if a function /(f) 
is normalized to unity, its transform F(co) is likewise normalized to unity. This is extremely 
important in quantum mechanics as developed in the next section. 

It may be shown that the Fourier transform is a unitary operation (in the Hilbert space L 2 , 
square integrable functions). The Parseval relation is a reflection of this unitary property — 
analogous to Exercise 3.4.26 for matrices. 

In Fraunhofer diffraction optics the diffraction pattern (amplitude) appears as the trans¬ 
form of the function describing the aperture (compare Exercise 15.5.5). With intensity 
proportional to the square of the amplitude the Parseval relation implies that the energy 
passing through the aperture seems to be somewhere in the diffraction pattern — a state¬ 
ment of the conservation of energy. Parseval’s relations may be developed independently 
of the inverse Fourier transform and then used rigorously to derive the inverse transform. 
Details are given by Morse and Feshbach, 8 Section 4.8 (see also Exercise 15.5.4). 


Exercises 


15.5.1 Work out the convolution equation corresponding to Eq. (15.53) for 


(a) Fourier sine transforms 


1 

2 



g(y)[f(y 


+ x) + f(y - x 


)]dy= f 

Jo 


F s (s)G s (s ) cos sx ds, 


where / and g are odd functions. 


'"'Note that all arguments are positive, in contrast to Eq. (15.54). 

7 Some authors prefer to restrict Parseval's name to series and refer to Eq. (15.55) as Rayleigh’s theorem. 
8 P. M. Morse and H. Feshbach, Methods of Theoretical Physics, New York: McGraw-Hill (1953). 
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(b) Fourier cosine transforms 


^ j g(y)[f(y + x) + f(x - 



F c (s)G c (s ) cos sx ds, 


where / and g are even functions. 


15.5.2 F{p ) and G i p ) are the Hankel transforms of fir) and g(r), respectively (Exer¬ 

cise 15.1.1). Derive the Hankel transform Parseval relation: 


15.5.3 


15.5.4 


15.5.5 



F*(p)G(p)pdp = 



f(r)g(r)rdr. 


Show that for both Fourier sine and Fourier cosine transforms Parseval’s relation has 
the form 



F(t)G(t)dt = 



f(y)g(y)dy. 


Starting from Parseval’s relation (Eq. (15.54)), let g(y) = 1, 0 < y < a, and zero else¬ 
where. From this derive the Fourier inverse transform (Eq. (15.23)). 

Hint. Differentiate with respect to a. 


(a) A rectangular pulse is described by 

fix) = 

Show that the Fourier exponential transform is 


x\ <a, 
x\ > a. 


/ 2 sinur 

-— ■ 

7 r t 

This is the single-slit diffraction problem of physical optics. The slit is described 
by fix). The diffraction pattern amplitude is given by the Fourier transform Fit). 
(b) Use the Parseval relation to evaluate 



sin 2 1 

"T 2- 


dt. 


This integral may also be evaluated by using the calculus of residues. Exer¬ 
cise 7.1.12. 


ANS. (b) tc. 

15.5.6 Solve Poisson’s equation, V7// (r) = —p(r)/eo, by the following sequence of opera¬ 
tions: 

(a) Take the Fourier transform of both sides of this equation. Solve for the Fourier 
transform of i//(r). 

(b) Carry out the Fourier inverse transform by using a three-dimensional analog of the 
convolution theorem, Eq. (15.53). 
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15.5.7 


15.5.8 


(a) Given fix) = 1 — |x/2|, —2 < x < 2, and zero elsewhere, show that the Fourier 
transform of fix) is 

p2 ( sin t x 2 

Fm =h(- 


(b) Using the Parseval relation, evaluate 


£ 


sinr 

t 


dt. 


2n 

ANS. (b) —. 
3 


With Fit) and G (t) the Fourier transforms of fix) and g(x), respectively, show that 

r°° if 00 o 

/ \f(x)-g(x)\ 2 dx= \F(t) — G{t)\ dt. 

J —oo J —oo 

If g(x) is an approximation to fix), the preceding relation indicates that the mean 
square deviation in f-space is equal to the mean square deviation in x-space. 


15.5.9 Use the Parseval relation to evaluate 


(a) 


£ 


dco 


(b) 


L 


00 ordm 


-00 (« 2 + a 2 ) 2 J-o o (o > 2 + a 2 ) 2 

Flint. Compare Exercise 15.3.4. 


ANS. (a) ^ 3 , (b) 71 . 
Za D la 


15.6 Momentum Representation 


In advanced dynamics and in quantum mechanics, linear momentum and spatial position 
occur on an equal footing. In this section we shall start with the usual space distribution 
and derive the corresponding momentum distribution. For the one-dimensional case our 
wave function fix) has the following properties: 


1 . f*{x)f{x) dx is the probability density of finding a quantum particle between x and 

x +dx ,and 


2 . 



f*(x)fix) dx — 1 


3. 


corresponds to probability unity. 
In addition, we have 


(x) = 



f*ix)xf{x) dx 


(15.58) 


(15.59) 


for the average position of the particle along the x-axis. This is often called an expec¬ 
tation value. 

We want a function g(p) that will give the same information about the momentum: 
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1 . 

2 . 


g*(p)g(p)dp is the probability density that our quantum particle has a momentum 
between p and p + dp. 



g*(p)g(p)dp=\. 


(15.60) 


3. 


(P) = 



g*(p)pg(p)dp. 


(15.61) 


As subsequently shown, such a function is given by the Fourier transform of our space 
function i jr{x). Specifically , 9 


g(p) = 


— ! 

+J2jih J- 


i [r(x)e 


—ipx/h 


dx. 


OO 

OO 


g*(p)=—= r(x)e ip - x/tl dx. 

v In h J —oo 

The corresponding three-dimensional momentum function is 

OO 

1 


g(P) = 


( 27 T ^) 3 / 2 


iff l ^ r ^ e !r p/ ^ c ^ r - 


(15.62) 

(15.63) 


To verify Eqs. (15.62) and (15.63), let us check on properties 2 and 3. 

Property 2, the normalization, is automatically satisfied as a Parseval relation, 
Eq. (15.55). If the space function t// (x) is normalized to unity, the momentum function 
g(p) is also normalized to unity. 

To check on property 3, we must show that 


(P) 


= / g*(p)pg(p)dp = f 
J — OO J - 


00 h d 

x/s*(x)— — , jf(x)dx, 

— OO 


i dx 


(15.64) 


where (h/i)(d/dx) is the momentum operator in the space representation. We replace 
the momentum functions by Fourier-transformed space functions, and the first integral 
becomes 


1 

2nh 


CXJ 

J J J pe~ lp(x ~ x ' > ! h (x')ijf(x) dp dx' dx. (15.65) 


Now we use the plane-wave identity 


pe 


-ip(x—x')/h _ a 

dx 


,_ e -ip{x-x')/h 


^The h may be avoided by using the wave number k, p = kh (and p = kh), so 


<p(k) = 


(2tt)1/2 / 


\js(x)e ikx dx. 


(15.66) 


An example of this notation appears in Section 16.1. 
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with p a constant, not an operator. Substituting into Eq. (15.65) and integrating by parts, 
holding x' and p constant, we obtain 

oo 

«■// 

—OO 

Here we assume i j/(x) vanishes as x -> ±oo, eliminating the integrated part. Using the 
Dirac delta function, Eq. (15.21c), Eq. (15.67) reduces to Eq. (15.64) to verify our mo¬ 
mentum representation. 

Alternatively, if the integration over p is done first in Eq. (15.65), leading to 

/ OO 

pe -i P (x-x')lh dp = 2ni h 2 8'(x - x'), 

-OO 

and using Exercise 1.15.9, we can do the integration over x, which causes i jr(x) to become 
—d\lr(x')/dx'. The remaining integral over x is the right-hand side of Eq. (15.64). 


— f 

2nh J_ ( 


e -ip(x-x')/h dp 


. , h d , 

■ x[r (x)—— xjf(x)dxdx. 
i dx 


(15.67) 


Example 15.6.1 hydrogen atom 


The hydrogen atom ground state 10 may be described by the spatial wave function 


i/Ur) = ( --t 

TflA 


1/2 


p-r/ao 


(15.68) 


no being the Bohr radius, Arc eoh 2 / me 2 . We now have a three-dimensional wave function. 
The transform corresponding to Eq. (15.62) is 

1 


g(P) = 


/ 


i/r (r)e 


(2 Tzh) 2 ’! 2 

Substituting Eq. (15.68) into Eq. (15.69) and using 


-ipr/h .3 


dr. 


/ 


— ar+ib r j3 


dr = 


8jtci 


(a 2 + b 2 ) 2 ’ 

we obtain the hydrogenic momentum wave function, 

2 3 / 2 al /2 li 5/2 


g(p) = 


7T (alp 2 + h 2 ) 2 ' 


(15.69) 


(15.70) 


(15.71) 


Such momentum functions have been found useful in problems like Compton scattering 
from atomic electrons, the wavelength distribution of the scattered radiation, depending on 
the momentum distribution of the target electrons. 

The relation between the ordinary space representation and the momentum representa¬ 
tion may be clarified by considering the basic commutation relations of quantum mechan¬ 
ics. We go from a classical Hamiltonian to the Schrodinger wave equation by requiring that 
momentum p and position x not commute. Instead, we require that 


[p, x] = px — xp — —ih. 


(15.72) 


l0 Sec E. V. Ivash, A momentum representation treatment of the hydrogen atom problem. Am. J. Phys. 40: 1095 (1972) for 
a momentum representation treatment of the hydrogen atom 1 = 0 states. 
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For the multidimensional case, Eq. (15.72) is replaced by 

[Pi,xj] = -ihSij. 

The Schrodinger (space) representation is obtained by using 

9 


x: 


Pi 


— ih- 


dxi 


replacing the momentum by a partial space derivative. We see that 

[p,x]ij/(x) = —itujr (x). 

However, Eq. (15.72) can equally well be satisfied by using 

9 


p: xj 


ih - 


dpj 


This is the momentum representation. Then 

[p,x]g(p) = -ihg(p). 


(15.73) 


(15.74) 


(15.75) 


Hence the representation (x) is not unique; ( p) is an alternate possibility. 

In general, the Schrodinger representation (x) leading to the Schrodinger wave equation 
is more convenient because the potential energy V is generally given as a function of 
position V(x,y,z). The momentum representation ( p) usually leads to an integral equation 
(compare Chapter 16 for the pros and cons of the integral equations). For an exception, 
consider the harmonic oscillator. ■ 


Example 15.6.2 Harmonic Oscillator 


The classical Hamiltonian (kinetic energy + potential energy = total energy) is 

p 2 1 2 

H(p,x) = j- -h -kx 2 = E, (15.76) 

2m 2 

where k is the Hooke’s law constant. 

In the Schrodinger representation we obtain 

h 2 d 2 \lr(x) 1 2 

--= (15.77) 

lm ax A 2 

For total energy E equal to V( k/m)h/2 there is an unnormalized solution (Section 13.1), 

i/,(x) = e- (V ™ ic/2h)x2 . (15.78) 

The momentum representation leads to 


p 2 h 2 k d 2 g(p ) 

2 m 8{P) 2 dp 2 


= Eg(p). 


(15.79) 


Again, for 
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the momentum wave equation (15.79) is satisfied by the unnormalized 

g(p) = e- p2/( (15.81) 

Either representation, space or momentum (and an infinite number of other possibilities), 
may be used, depending on which is more convenient for the particular problem under 
attack. 

The demonstration that g(p) is the momentum wave function corresponding to 
Eq. (15.78) — that it is the Fourier inverse transform of Eq. (15.78) — is left as Exer¬ 
cise 15.6.3. ■ 


Exercises 

15.6.1 The function e ,k r describes a plane wave of momentum p = hk normalized to unit 
density. (Time dependence of e~ ,0>t is assumed.) Show that these plane-wave functions 
satisfy an orthogonality relation 

J (e ,kr )’V k r dxdydz — (27r) 3 <5(k — k'). 

15.6.2 An infinite plane wave in quantum mechanics may be represented by the function 

f(x) = e ip ' xlh . 

Find the corresponding momentum distribution function. Note that it has an infinity and 
that ij/(x) is not normalized. 

15.6.3 A linear quantum oscillator in its ground state has a wave function 

*(* ) = crV 2 n^ 4 e-* 2 '^. 

Show that the corresponding momentum function is 

g(p)=a l ' 2 n-^ 4 h-^ 2 e- a2 P 2 ^ 2 . 

15.6.4 The nth excited state of the linear quantum oscillator is described by 

if n (x) = a~ 1/2 2 - "/ 2 7t - ! / 4 (n\)~ ll2 e~ x2/2al H n (x/a), 

where H n (x/a) is the nth Hermite polynomial. Section 13.1. As an extension of Exer¬ 
cise 15.6.3, find the momentum function corresponding to i// n (x ). 

Hint. i lr n (x) may be represented by (o ')" lAoC*), where a* is the raising operator. Exer¬ 
cise 13.1.14 to 13.1.16. 

15.6.5 A free particle in quantum mechanics is described by a plane wave 

X,h(x, t ) = e ^x-(nk 2 /2m)t]_ 

Combining waves of adjacent momentum with an amplitude weighting factor (p(k), we 
form a wave packet 

q/(x, t ) = f°° <p(k)e i[kx - {hk2/2m),] dk. 

J —OO 
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(a) Solve for cpik ) given that 

*(.*, 0 ) = e -* 2 / 2fl2 . 

(b) Using the known value of (p(k), integrate to get the explicit form of ( x, t). Note 
that this wave packet diffuses or spreads out with time. 


ANS. V(x,t) = 


e ~{x 2 /2[a 2 +(ih/m)t]} 
[1 + (iht / fflfl 2 )] 1 / 2 


Note. An interesting discussion of this problem from the evolution operator point of 
view is given by S. M. Blinder, Evolution of a Gaussian wave packet. Am. J. Phys. 36: 
525 (1968). 


15.6.6 Find the time-dependent momentum wave function g(k, t) corresponding to T(x. t) of 
Exercise 15.6.5. Show that the momentum wave packet g*(k. t)g(k , t) is independent 
of time. 


15.6.7 The deuteron. Example 10.1.2, may be described reasonably well with a Hulthen wave 
function 

t/r(r) = A[e~ ar -e~ Pr ]/r, 


with A, a, and ji constants. Find g (p) , the corresponding momentum function. 

Note. The Fourier transform may be rewritten as Fourier sine and cosine transforms or 
as a Laplace transform. Section 15.8. 


15.6.8 The nuclear form factor F(k) and the charge distribution p(r) are three-dimensional 
Fourier transforms of each other: 

F(t,= (5T72 

If the measured form factor is 

F(k) = (2jrr 3/2 (i + K) , 

find the corresponding charge distribution. 

a 2 e~ ar 

ANS. p(r) — - -. 

An r 

15.6.9 Check the normalization of the hydrogen momentum wave function 

2 3 / 2 ciQ 2 h 5 / 2 
g(P) 7t (OqP 2 + h 2 ) 2 

by direct evaluation of the integral 

J g*(p)g(p)d 3 p. 

15.6.10 With i//(r) a wave function in ordinary space and (pip) the corresponding momentum 
function, show that 
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(2jr/i) 3 / 2 


(27 T / z ) 3 / 2 


J n//(r)<? ,r ' p / fi d 2 r = ih V p <p(p), 

J r 2 \l/(r)e~ r ' p ^ h d 3 r — (ih V P ) 2 (p( p). 


Note. V p is the gradient in momentum space: 

„ 3 ,3 ,3 

x-h y-F z-. 

dp x dp y 3 p z 

These results may be extended to any positive integer power of r and therefore to any 
(analytic) function that may be expanded as a Maclaurin series in r. 

15.6.11 The ordinary space wave function i/fir.t) satisfies the time-dependent Schrodinger 
equation 


. 3iA(r, t ) 


=-V“i // + V (r )i/ f - 

2m 


Show that the corresponding time-dependent momentum wave function satisfies the 
analogous equation, 

3<p(p,r) p 2 

ih —--= — cp+ V (ih V P )(p. 

at 2m 

Note. Assume that V(r) may be expressed by a Maclaurin series and use Exer¬ 
cise 15.6.10. V(ih Vp) is the same function of the variable ih V p that E(r) is of the 
variable r. 

15.6.12 The one-dimensional time-independent Schrodinger wave equation is 

h 2 d 2 \l/(x) 

-x- J\^ + V(x)f(x) = ExKx). 

2m dx A 

For the special case of V (x) an analytic function of x, show that the corresponding 
momentum wave equation is 


v [ ih— )g(p)+ —g(p) = Eg(p). 

\ dp J 2m 

Derive this momentum wave equation from the Fourier transform, Eq. (15.62), and its 
inverse. Do not use the substitution x —»• ih(d/dp) directly. 


15.7 Transfer Functions 

A time-dependent electrical pulse may be regarded as built-up as a superposition of plane 
waves of many frequencies. For angular frequency o> we have a contribution 

F(co)e imt . 

Then the complete pulse may be written as 

1 f °° 

f(t)=— F((d)e l<ot dco. 

J _oo 


(15.82) 
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,f(t) ( - 

Input 


Output 


g(t) 


Figure 1 5.6 Servomechanism or a stereo amplifier. 


Because the angular frequency co is related to the linear frequency v by 

co 

2jt ’ 

it is customary to associate the entire 1 /2tt factor with this integral. 

But if &) is a frequency, what about the negative frequencies? The negative co may be 
looked on as a mathematical device to avoid dealing with two functions (cos cot and sin cot) 
separately (compare Section 14.1). 

Because Eq. (15.82) has the form of a Fourier transform, we may solve for F(co) by 
writing the inverse transform, 

/ OO 

f{t)e~ ib>t dt. (15.83) 

-OO 

Equation (15.83) represents a resolution of the pulse f(t) into its angular frequency com¬ 
ponents. Equation (15.82) is a synthesis of the pulse from its components. 

Consider some device, such as a servomechanism or a stereo amplifier (Fig. 15.6), with 
an input /(f) and an output g(t). For an input of a single frequency co, f m (t) — e l0>t , the 
amplifier will alter the amplitude and may also change the phase. The changes will proba¬ 
bly depend on the frequency. Hence 

g 0 ,(t) = <p(co)f (0 (t). (15.84) 

This amplitudes- and phase-modifying function tp(co) is called a transfer function. It usu¬ 
ally will be complex: 

<p(co) = u(co) + iv(co), (15.85) 


where the functions ufoo) and v(co) are real. 

In Eq. (15.84) we assume that the transfer function <p(o>) is independent of input ampli¬ 
tude and of the presence or absence of any other frequency components. That is, we are 
assuming a linear mapping of f(t ) onto git). Then the total output may be obtained by 
integrating over the entire input, as modified by the amplifier 

1 f °° 

git) = — / <p(co)F(co)e lo), dco. (15.86) 

J — OO 

The transfer function is characteristic of the amplifier. Once the transfer function is 
known (measured or calculated), the output git) can be calculated for any input fit). 
Let us consider (pico) as the Fourier (inverse) transform of some function <t> (f): 

/ OO 

<S>{t)e~ i0>, dt. 

-OO 


(15.87) 
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Then Eq. (15.86) is the Fourier transform of two inverse transforms. From Section 15.5 we 
obtain the convolution 

/ oo 

/(r)4>(f-r)dr. (15.88) 

-oo 

Interpreting Eq. (15.88), we have an input — a “cause”— /(t), modified by <J>(f — r), 
producing an output — an “effect” — g(t). Adopting the concept of causality — that the 
cause precedes the effect — we must require r < t. We do this by requiring 

<D(f-r) = 0, r >t. (15.89) 


Then Eq. (15.88) becomes 

8(t)= f f(r)<t>(t-r)dr. (15.90) 

J — OO 

The adoption of Eq. (15.89) has profound consequences here and equivalently in disper¬ 
sion theory. Section 7.2. 


Significance of $0) 


To see the significance of <t>, let /(r) be a sudden impulse starting at r = 0, 

f(r) = 8(z). 


where 8(r) is a Dirac delta distribution on the positive side of the origin. Then Eq. (15.90) 
becomes 


g(t) 



<5(r)d>(r — r)d r, 


git) 


<t>(r), t > 0, 

0, t < 0. 


(15.91) 


This identifies <J>(r) as the output function corresponding to a unit impulse at t — 0. Equa¬ 
tion (15.91) also serves to establish that <t>(r) is real. Our original transfer function gives 
the steady-state output corresponding to a unit-amplitude single-frequency input. <t>(r) and 
tp(u>) are Fourier transforms of each other. 

From Eq. (15.87) we now have 

/•OO 

<p{(o)= / <S>it)e~ icat dt, (15.92) 

Jo 


with the lower limit set equal to zero by causality (Eq. (15.89)). With <S>(/) real from 
Eq. (15.91) we separate real and imaginary parts and write 


u(co) — 



<J>(f)cos cot dt , 


v(co) = — 



(15.93) 


<t>(f) sin cat dt. 


co > 0. 
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From this we see that the real part of cp(co), u(a>), is even, whereas the imaginary part of 
i p(co ), v(co ), is odd: 

u(—co) — u{co), v(—co) = —v(co). 


Compare this result with Exercise 15.3.1. 

Interpreting Eq. (15.93) as Fourier cosine and sine transforms, we have 

2 

<t>(t) = — I u (o>) cos cot doo 

Tt Jo 
2 r°° 

=-/ v(co) sin cot dco, t > 0. (15.94) 

n Jo 

Combining Eqs. (15.93) and (15.94), we obtain 


v(ca) = 


r°° 12 r 

— I sin cot — I 

Jo [n Jo 


Li (co r ) cos co't dco'l dt 


(15.95) 


showing that if our transfer function has a real part, it will also have an imaginary part (and 
vice versa). Of course, this assumes that the Fourier transforms exist, thus excluding cases 
such as 4>(t) = 1. 

The imposition of causality has led to a mutual interdependence of the real and imagi¬ 
nary parts of the transfer function. The reader should compare this with the results of the 
dispersion theory of Section 7.2, also involving causality. 

It may be helpful to show that the parity properties of a (oo) and v(co) require 4>(f) to 
vanish for negative t. Inverting Eq. (15.87), we have 


1 

<P(t )=— / [u(co) + (i>(&>)][cosa>f + i sina>f] dco. (15.96) 

2tt J— oo 


With u(co) even and v(co) odd, Eq. (15.96) becomes 
1 f°° 1 

4>(f) = — / u (co) cos cot dco -/ v(co) sin cot doo. 

It Jo It Jo 

From Eq. (15.94), 

n OO nOO 

I u {co} cos cot dco — — / v(a>) sin cot dco, t> 0. 

Jo Jo 

If we reverse the sign of t, sin cot reverses sign and, from Eq. (15.97), 


(15.97) 


(15.98) 


4>(t) = 0, t < 0 


(demonstrating the internal consistency of our analysis). 


Exercise 


g(t ) = 



/(T)<J>(f — x)dr. 


15.7.1 Derive the convolution 
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15.8 Laplace Transforms 


Definition 


The Laplace transform f(s ) or £ of a function Fit) is defined by 11 

pa poo 

f(s) = C{F(t )}= lim / e~ st F(t)dt = / e~ s, F{t)dt. (15.99) 

fl ^°° J o J o 

A few comments on the existence of the integral are in order. The infinite integral of Fit), 

Fit) dt, 


r 

Jo 


need not exist. For instance. Fit) may diverge exponentially for large t. However, if there 
is some constant jq such that 


e~ sot F(t) \ < M, 


(15.100) 


a positive constant for sufficiently large t,t > to, the Laplace transform (Eq. (15.99)) will 

2 

exist for s > sq: F(t) is said to be of exponential order. As a counterexample, F(t) = e r 

2 

does not satisfy the condition given by Eq. (15.100) and is not of exponential order. £{e' } 
does not exist. 

The Laplace transform may also fail to exist because of a sufficiently strong singularity 
in the function Fit) as t -> 0; that is, 

pOO 

/ e~ s, t n dt 
Jo 

diverges at the origin for n < — 1. The Laplace transform £{£'} does not exist for n < — 1. 
Since, for two functions Fit) and Git), for which the integrals exist 

C{aF{t) + bG{t)}=aC{F{t)}+bC{G{t)}, (15.101) 

the operation denoted by £ is linear. 


Elementary Functions 

To introduce the Laplace transform, let us apply the operation to some of the elementary 
functions. In all cases we assume that F(t) = 0 for t < 0. If 

F(t)= 1, t>0, 


11 This is sometimes called a one-sided Laplace transform; the integral from —oo to +oo is referred to as a two-sided Laplace 
transform. Some authors introduce an additional factor of s. This extra s appears to have little advantage and continually gets 
in the way (compare Jeffreys and Jeffreys, Section 14.13 — see the Additional Readings — for additional comments). Generally, 
we take .9 to be real and positive. It is possible to have ^ complex, provided 31(5) > 0. 
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then 


Again, let 


C{\} = 



for s > 0. 


F(t) = e k ', t > 0. 


(15.102) 


The Laplace transform becomes 


rK'l -f 


e~ st e k, dt = 


1 


s — k 


for s > k. 


(15.103) 


Using this relation, we obtain the Laplace transform of certain other functions. Since 

cosh kt =-(e kt + e~ kl ), sinh kt =-(e kt — e~ kt> ), (15.104) 

we have 


1 / 1 

£{coshfcf} = - 


1 


2 Vs — k s+k) s 2 — k 2 


1 ( 1 

CfsinhA't} = - I 


1 


2 \s-k s + k) s 2 — k 2 ’ 
both valid for s > k. We have the relations 

cos kt — cosh ikt, sin kt — —i sinh/£f. 


(15.105) 


(15.106) 


Using Eqs. (15.105) with k replaced by ik, we find that the Laplace transforms are 


£{cos kt] = -r- — 

s- + k z 


(15.107) 


both valid for s > 0. Another derivation of this last transform is given in the next sec¬ 
tion. Note that lim^o £{sin/:r} = 1 /k. The Laplace transform assigns a value of 1 /k to 
sin kt dt. 

Finally, for F(t) = t n , we have 


poo 

£{t n }= e~ sl t n dt, 

Jo 

which is just the factorial function. Hence 

C{t") = -^, s > 0, n > — 1. (15.108) 


Note that in all these transforms we have the variable s in the denominator — negative 
powers of s. In particular, lim^oo f(s) — 0. The significance of this point is that if /Tv) 
involves positive powers of .v (lims_ >00 f(s) -> oo), then no inverse transform exists. 
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Inverse Transform 

There is little importance to these operations unless we can carry out the inverse transform, 
as in Fourier transforms. That is, with 

C{F(t)} = f(s), 

then 

£- 1 {/W} = F(0. (15.109) 

This inverse transform is not unique. Two functions F\ (t) and h'i(t) may have the same 
transform, f(s). However, in this case 

Fi(t)-F 2 (t) = N(t), 

where N(t) is a null function (Fig. 15.7), indicating that 

rto 

I N(t)dt = 0, 

Jo 

for all positive tQ. This result is known as Lerch’s theorem. Therefore to the physicist 
and engineer N(t) may almost always be taken as zero and the inverse operation becomes 
unique. 

The inverse transform can be determined in various ways. (1) A table of transforms can 
be built up and used to carry out the inverse transformation, exactly as a table of logarithms 
can be used to look up antilogarithms. The preceding transforms constitute the beginnings 
of such a table. For a more complete set of Laplace transforms see upcoming Table 15.2 
or AMS-55, Chapter 29 (see footnote 4 in Chapter 5 for the reference). Employing partial 
fraction expansions and various operational theorems, which are considered in succeeding 
sections, facilitates use of the tables. 

• There is some justification for suspecting that these tables are probably of more value 
in solving textbook exercises than in solving real-world problems. 

• (2) A general technique for 1 will be developed in Section 15.12 by using the cal¬ 
culus of residues. 


N(t) 


• (single point) 


t 


Figure 15.7 A possible null 
function. 
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• (3) For the difficulties and the possibilities of a numerical approach — numerical inver¬ 

sion— we refer to the Additional Readings. 


Partial Fraction Expansion 


Utilization of a table of transforms (or inverse transforms) is facilitated by expanding f(s ) 

in partial fractions. 

Frequently f(s), our transform, occurs in the form g(s)/h(s), where g(s ) and h(s) are 
polynomials with no common factors, g(s) being of lower degree than h(s). If the factors 
of h{s) are all linear and distinct, then by the method of partial fractions we may write 

c I ci c n 

f(s )=——+ + (15.110) 

S G\ S ^ 

where the c, are independent of s. The a, are the roots of h(s). If any one of the roots, say, 
fli, is multiple (occurring m times), then f(s) has the form 


m = 


Cl jn Cl,m — 1 

(s — a\) m (s - 


n 



(15.111) 


Finally, if one of the factors is quadratic, (s 2 + ps + q), then the numerator, instead of 
being a simple constant, will have the form 

as + b 
s 2 + ps +q 

There are various ways of determining the constants introduced. For instance, in 
Eq. (15.110) we may multiply through by (s — a{) and obtain 


c,= lim(s-a/)/(s). (15.112) 

j-s-a, 

In elementary cases a direct solution is often the easiest. 


Example 15.8.1 

Let 


Partial Fraction Expansion 


f(s) = 


c as + b 
= - + 


s(s 2 + k 2 ) s s 2 + k 2 


(15.113) 


Putting the right side of the equation over a common denominator and equating like powers 
of .v in the numerator, we obtain 

k 2 _c(s 2 + k 2 ) + s(as + b ) 

s(s 2 + k 2 )~ s(s 2 + k 2 ) ’ 1 ^ 

c + a = 0, s 2 \ b — 0, j 1 ; ck 2 — k 2 , s°. 

Solving these (.s' / 0), we have 

c — 1 , b = 0, a — — 1 , 
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giving 


and 


/ 0 ) = - 


s s 2 + k 2 ’ 


£ 1 {/Cs)} = 1 — cos kt 


(15.115) 


(15.116) 


by Eqs. (15.102) and (15.106). 


Example 15.8.2 


A Step Function 


As one application of Laplace transforms, consider the evaluation of 


F{t) = 


-f 


sin tx 


-dx. 


) 0 X 

Suppose we take the Laplace transform of this definite (and improper) integral: 


(15.117) 


£ 


fV»f 

Jo x J Jo Jo 


sin tx 


-dx dt. 


X | Jl) Jo X 

Now, interchanging the order of integration (which is justified), 12 we get 

° 1 r°° dx 

e sin tx dt dx = I — 

to x ljo J 


r °° 1 r r 

Jo x J 0 


o s- + x z 


(15.118) 


(15.119) 


since the factor in square brackets is just the Laplace transform of sin tx. From the integral 
tables. 


L 


dx 


1 


, »■ = - tan - 

0 s-+x z s \s 


= 2s= f(S) - 


By Eq. (15.102) we carry out the inverse transformation to obtain 

t > 0, 


it 


(15.120) 


(15.121) 


in agreement with an evaluation by the calculus of residues (Section 7.1). It has been as¬ 
sumed that t > 0 in Fit). For F(—t) we need note only that sin(— tx) = — sin tx, giving 
F(—t ) = —F(t). Finally, if t — 0, F( 0) is clearly zero. Therefore 


r°° sinf.r 7t r 

/ - dx — —[2 u(t) — l] = 

Jo x 2 


‘ ZL 
2 ’ 


t > 0 
, t — 0 

f < o. 


(15.122) 


Note that JJ(smtx/x)dx, taken as a function of t, describes a step function (Fig. 15.8), 
a step of height jt at t = 0. This is consistent with Eq. (1.174). ■ 

The technique in the preceding example was to (1) introduce a second integration — 
the Laplace transform, (2) reverse the order of integration and integrate, and (3) take the 


12 


See — in the Additional Readings — Jeffreys and Jeffreys (1966), Chapter 1 (uniform convergence of integrals). 
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F(t) 


K 

2 


f 


Figure 15.8 F(t) = /“ ^dx, 
a step function. 


inverse Laplace transform. There are many opportunities where this technique of reversing 
the order of integration can be applied and proved useful. Exercise 15.8.6 is a variation of 
this. 


Exercises 

15.8.1 Prove that 


lim sf(s ) = lim F(t). 
00 f-s-+0 


Hint. Assume that F(t) can be expressed as F(t) — '}2T=o a " tn ■ 

15.8.2 Show that 


— lim £{cosA'f} = <5 (.t). 

Jt s —>-0 


15.8.3 Verify that 


C 


cosat — cos bt 


b 2 — a 2 J (s 2 + a 2 )(s 2 + b 2 ) ’ 


a 2 ^ b 2 . 


15.8.4 Using partial fraction expansions, show that 

(a) C~ l 1 

(b) £-‘J 


Cs + a)(s + &)J b — a 

s } ae~ at — be~ bt 


a ^ b. 


0 + a)(s + b) 


a — b 


a ^ b. 


15.8.5 Using partial fraction expansions, show that for a 1 ^ /; , 



sin At sinbt 


(s 2 + a 2 )(s 2 + b 2 ) \ a 2 — b 2 


{a sin of — Z? sin }. 
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15.8.6 


The electrostatic potential of a charged conducting disk is known to have the general 
form (circular cylindrical coordinates) 





e k ^Jo(kp)f(k)dk, 


with f(k) unknown. At large distances (z, —> oo) the potential must approach the 
Coulomb potential Q/Ane^z. Show that 


lim f(k) = 
k^o 


q 

Atteq 


Hint. You may set p — 0 and assume a Maclaurin expansion of f(k) or, using e 
construct a delta sequence. 


15.8.7 Show that 


(a) 

(b) 


f 

f 

Jo 


COS 5 


-i is — 


Tt 


2(v — l)!cos(u7r/2) ’ 

Tt 


sin s 

- ds — -, 

5 V 2(v — 1)! sin(v7r/2) 


0 < v < 1, 


0 < v < 2, 


Why is v restricted to (0, 1) for (a), to (0, 2) for (b)? These integrals may be interpreted 
as Fourier transforms of s~ v and as Mellin transforms of sin s and cos .y. 

Hint. Replace ,v~ l; by a Laplace transform integral: £{r v-1 }/(v — 1)!. Then integrate 
with respect to s. The resulting integral can be treated as a beta function (Section 8.4). 

15.8.8 A function F(t) can be expanded in a power series (Maclaurin); that is, 

OO 

F(t) = 

n =0 

Then 

n OO 00 00 r 1 OO 

£{F(r)}= / e~ st Y\a n t n dt = Y\a n \ e~ s 't n dt. 

J ° n =0 n=0 J ° 

Show that f(s), the Laplace transform of F(t), contains no powers of v greater than 
,v-'. Check your result by calculating and comment on this fiasco. 

15.8.9 Show that the Laplace transform of M(a, c, x) is 

C\M(a, c, jc)} = —2F1 1 ; c, . 


15.9 Laplace Transform of Derivatives 

Perhaps the main application of Laplace transforms is in converting differential equations 
into simpler forms that may be solved more easily. It will be seen, for instance, that coupled 
differential equations with constant coefficients transform to simultaneous linear algebraic 
equations. 
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Let us transform the first derivative of F(t): 

C{F\t)} = f 
Jo 

Integrating by parts, we obtain 


00 - s ,dF(t) 


dt 


dt. 


OO f 

C{F\t)}=e~ s, F(t) +s 

0 J 0 

= s£{F(O}-T(0). 


+ s I e s, F(t)dt 

0 Jo 


(15.123) 


Strictly speaking, F( 0) = F(+0) 13 and dF/dt is required to be at least piecewise contin¬ 
uous for 0 < t < 00 . Naturally, both Fit) and its derivative must be such that the integrals 
do not diverge. Incidentally, Eq. (15.123) provides another proof of Exercise 15.8.8. An 
extension gives 


£{T (2) (/)} = ^ 2 /:{T(f)} - sF(+ 0) - F'(+0), (15.124) 

C{F (n \t)} =^"£{F(r)} -s n ~ l F(+ 0)-F (n_1) (+0). (15.125) 


The Laplace transform, like the Fourier transform, replaces differentiation with multi¬ 
plication. In the following examples ODEs become algebraic equations. Here is the power 
and the utility of the Laplace transform. But see Example 15.10.3 for what may happen if 
the coefficients are not constant. 

Note how the initial conditions, T(+0), F'(+ 0), and so on, are incorporated into the 
transform. Equation (15.124) may be used to derive £{sinfcf}. We use the identity 


2 a 
—k sin kt = —- sin kt. 
dt 2 

Then applying the Laplace transform operation, we have 


(15.126) 


— k~C{sinkt} — C 


—- sin kt 
dt 2 


— s~C{sinkt} — s sin(O)-sin kt 

dt 


t =0 


(15.127) 


Since sin(0) = 0 and d/dt sin kt | f= o = k , 


£{sin£f} = 


s 2 + k 2 ’ 


(15.128) 


verifying Eq. (15.107). 


13 Zero is approached from the positive side. 
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Example 15.9.1 


Simple Harmonic Oscillator 


As a physical example, consider a mass m oscillating under the influence of an ideal spring, 
spring constant k. As usual, friction is neglected. Then Newton’s second law becomes 

d 2 X(t) 


dt 2 

also, we take as initial conditions 

X (0) = Xq, 

Applying the Laplace transform, we obtain 

d 2 X 


+ kX(t) = 0; 


A'(0) = 0. 


mC 


dt 2 


+ kC[X(t)} =0, 


and by use of Eq. (15.124) this becomes 


ms~x(s) — msXo + kx(s ) = 0, 


x(s) — X 0 


s 2 + ’ 


with cl>q = —. 


From Eq. (15.107) this is seen to be the transform of coscuoL which gives 

X(t) — XocoscuoL 

as expected. 


(15.129) 


(15.130) 

(15.131) 

(15.132) 

(15.133) 


Example 15.9.2 earth’s nutation 


A somewhat more involved example is the nutation of the earth’s poles (force-free pre¬ 
cession). If we treat the Earth as a rigid (oblate) spheroid, the Euler equations of motion 
reduce to 


dX 

dt 


= -aY , 


dY 


—— — -\-aX, 
dt 


(15.134) 


where a = [(/, — I x )/I z ]co z , X — o > x , Y — co y with angular velocity vector co — 
(a> x . a>y, o>-) (Fig. 15.9), I z — moment of inertia about the z-axis and 7 V = I x moment 
of inertia about the x- (or y-jaxis. The "-axis coincides with the axis of symmetry of the 
Earth. It differs from the axis for the Earth’s daily rotation, «, by some 15 meters, measured 
at the poles. Transformation of these coupled differential equations yields 


sx(s) — 2f(0) = — ay(s), sy(s) — Y (0) = ax(s). (15.135) 


Combining to eliminate yfv), we have 

s 2 x(s) — sX(0) + flF(0) = —a 2 x(s), 


or 


x(s) — X (0) - 


s z + a 2 


Y( 0) 


s 2 + a 2 


(15.136) 
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z 



Figure 15.9 


Hence 

X(t) — X(0)cos at — y(0)sinflf. (15.137) 

Similarly, 

Y (t) = X(0)sinflf + Y(0)cosat. (15.138) 

This is seen to be a rotation of the vector (X, Y ) counterclockwise (for a > 0) about the 
Z-axis with angle 6 — at and angular velocity a. 

A direct interpretation may be found by choosing the time axis so that Y (0) = 0. Then 

X(t) — X(0) cos at, Y (t) — X(0) sinot, (15.139) 

which are the parametric equations for rotation of (X, Y) in a circular orbit of radius X (0), 
with angular velocity a in the counterclockwise sense. 

In the case of the Earth’s angular velocity, vector X (0) is about 15 meters, whereas 
a, as defined here, corresponds to a period (2n/a) of some 300 days. Actually because 
of departures from the idealized rigid body assumed in setting up Euler’s equations, the 
period is about 427 days. 14 If in Eq. (15.134) we set 

X{t) — L x , Y(t) = L y , 

where L x and L y are the x- and y-components of the angular momentum L , a — —gLB z , 
gi is the gyromagnetic ratio, and B z is the magnetic field (along the 7-axis), then 
Eq. (15.134) describes the Larmor precession of charged bodies in a uniform magnetic 
field B z . ■ 


1 T). Menzel, ed.. Fundamental Formulas of Physics, Englewood Cliffs, NJ: Prentice-Hall (1955). reprinted, 2nd ed., Dover 
(1960), p. 695. 




15.9 Laplace Transform of Derivatives 


975 


Dirac Delta Function 


For use with differential equations one further transform is helpful — the Dirac delta func¬ 
tion: 15 


7*00 

£{5(r-r 0 )}= / e- s, 8(t-t 0 )dt = e- s, °, forr 0 >0, 

Jo 


and for to — 0 


(15.140) 


£{<$(*)} = 1, (15.141) 

where it is assumed that we are using a representation of the delta function such that 


f 


8(t)dt—l, 8(t) — 0, for t > 0. 


(15.142) 


As an alternate method, 8(t) may be considered the limit as e -» 0 of Fit), where 

f 0 , 


F(t) = 


-l 


t < 0, 

0 < t < s, 
t > s. 


By direct calculation 


C[F{t)} = 


1 — e 


es 


(15.143) 


(15.144) 


Taking the limit of the integral (instead of the integral of the limit), we have 

lim C\ F(t)\ = 1, 

e^0 1 ’ 


orEq. (15.141), 


£{$(*)} = 1. 

This delta function is frequently called the impulse function because it is so useful in 
describing impulsive forces, that is, forces lasting only a short time. 


Example 15.9.3 impulsive force 


Newton’s second law for impulsive force acting on a particle of mass m becomes 


d 2 X 

m ——r = P8(t), 


dt 2 

where P is a constant. Transforming, we obtain 

ms 2 x(s ) — msX( 0) — mX'( 0) = P. 


(15.145) 


(15.146) 


15 Strictly speaking, the Dirac delta function is undefined. However, the integral over it is well defined. This approach is developed 
in Section 1.16 using delta sequences. 
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For a particle starting from rest, X'(0) — 0. If ’ We shall also take X (0) = 0. Then 

P 



x{s) = — j, 
ms L 

(15.147) 

X(t) 

P 

m 

(15.148) 

dX(t) 

P 

— _ a rnncttint 


dt 

— , a LUliaidlll. 

m 

^1J. 1 i 7 ) 


The effect of the impulse PS(t) is to transfer (instantaneously) P units of linear momentum 
to the particle. 

A similar analysis applies to the ballistic galvanometer. The torque on the galvanometer 
is given initially by kb, in which ( is a pulse of current and k is a proportionality constant. 
Since i is of short duration, we set 


kb — kq <5(r). 


(15.150) 


where q is the total charge carried by the current i. Then, with I the moment of inertia, 

I —= kq S(t), (15.151) 

dt- 


and, transforming as before, we find that the effect of the current pulse is a transfer of kq 
units of angular momentum to the galvanometer. ■ 


Exercises 

15.9.1 Use the expression for the transform of a second derivative to obtain the transform of 
cos kt. 

15.9.2 A mass m is attached to one end of an unstretched spring, spring constant k (Fig. 15.10). 
At time t — 0 the free end of the spring experiences a constant acceleration a, away from 
the mass. Using Laplace transforms. 




X 


Figure 15.10 Spring. 


16 This should be X^+O). To include the effect of the impulse, consider that the impulse will occur at t = s and let s —> 0. 
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15.9.3 


15.9.4 


(a) Find the position x of m as a function of time. 

(b) Determine the limiting form of x(t) for small t. 


1 


ANS. (a) a: = -at 

2 


-^-(1 — coscot), co = —, 
co z m 


(b )x = -^-r, 


Radioactive nuclei decay according to the law 

dN 

-= —XN, 

dt 

A being the concentration of a given nuclide and X being the particular decay constant. 
This equation may be interpreted as stating that the rate of decay is proportional to the 
number of these radioactive nuclei present. They all decay independently. 

In a radioactive series of n different nuclides, starting with N \, 


dN i 
dt 
dN 2 
dt 
dN n 
dt 


= -kiN i, 

— X\N i — X 2 N 2 , and so on. 
= 7„_iA„_i, stable. 


Find N 2 (t), A 3 (f), n = 3, with Ai(0) = Nq, N 2 ( 0) = A 3 (0) = 0. 

At 


ANS. Aj (?) = Noe~ Xlt , 
Ni(t) = N Q ( 1- 


N 2 (t) = N 0 
^2 


e~ Xl ' + 


X 2 — T-i 

T-i 




o~ X 21 


X 2 — 7-i X 2 — 7.1 

Find an approximate expression for N 2 and A 3 , valid for small t when 7i ~ X 2 ■ 

No 

ANS. A 2 sa Ao7.iT A 3 ^ 

Find approximate expressions for N 2 and A 3 , valid for large ?, when 

(a) 7-i X 2 , 

(b) T-i 7.2. 


7. 1 7_2 1~ • 


ANS. (a) 

a 2 « 

^ N 0 e~ X2 ', 



a 3 - 

s A 0 (l -e~ X2 '), 

7i t 1 

(b) 

a 2 - 

“A 0 |e- l >', 



A 3 s 

•< 

1 

1 

72? 1 


The formation of an isotope in a nuclear reactor is given by 
dN 2 


dt 


— nvaiNio — X 2 N 2 (t) — nvo 2 N 2 (t). 
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Here the product nv is the neutron flux, neutrons per cubic centimeter, times centimeters 
per second mean velocity; a\ and oi (cm 2 ) are measures of the probability of neutron 
absorption by the original isotope, concentration /Vio, which is assumed constant and 
the newly formed isotope, concentration AA, respectively. The radioactive decay con¬ 
stant for the isotope is A. 2 . 


(a) Find the concentration AA of the new isotope as a function of time. 

(b) If the original element is Eu 153 , o\ — 400 barns = 400 x 10“ 24 cm 2 , ai — 
1000 barns = 1000 x 10“ 24 cm 2 , and A 2 = 1.4 x 10“ 9 s“‘. If N w = 10 20 and 
(nv) = 10 9 cm -2 s“\ find /V 2 , the concentration of Eu 154 after one year of con¬ 
tinuous irradiation. Is the assumption that N 1 is constant justified? 


15.9.5 In a nuclear reactor Xe 135 is formed as both a direct fission product and a decay product 
of I 135 , half-life, 6.7 hours. The half-life of Xe 135 is 9.2 hours. Because Xe 135 strongly 
absorbs thermal neutrons thereby “poisoning” the nuclear reactor, its concentration is a 
matter of great interest. The relevant equations are 


dN, 

dt 


— YiV°fNu ~ A iNj , 


dN x 

dt 


— XjNi + Yx<P<TfNu - A xNx - (paxNx- 


Here Nj — concentration of I 135 (Xe 135 , U 235 ). Assume 


Nu — constant, 

yj = yield of I 135 per fission = 0.060, 

yx = yield of Xe 135 direct from fission = 0.003, 

ns / ns\ l n 2 0.693 

A/ = I (Xe decay constant =-=-, 

0/2 0/2 

Of — thermal neutron fission cross section for U 235 , 
a x = thermal neutron absorption cross section for Xe 135 
= 3.5 x 10 6 barns = 3.5 x 10“ 18 cm 2 . 

(a/ the absorption cross section of I 135 , is negligible.) 

'l 

<p — neutron flux = neutrons/cm x mean velocity (cm/s). 


(a) Find Nx(t) in terms of neutron flux cp and the product a fNjj. 

(b) Find Nx(t —> 00 ). 

(c) After Nx has reached equilibrium, the reactor is shut down, <p — 0. Find N\ (t) fol¬ 
lowing shutdown. Notice the increase in Nx . which may for a few hours interfere 
with starting the reactor up again. 
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15.10 Other Properties 

Substitution 

If we replace the parameter s by s — a in the definition of the Laplace transform 
(Eq. (15.99)), we have 

poo roo 

f(s — a) — / e- (s - a) ' F{t)dt = / e~ s, e a 'F{t)dt 

Jo Jo 

= £{<? a? F(r)}. (15.152) 

Hence the replacement of s with s — a corresponds to multiplying Fit) by e at , and con¬ 
versely. This result can be used to good advantage in extending our table of transforms. 
From Eq. (15.107) we find immediately that 

C\e a, sinkt}= - \ -- (15.153) 

1 1 (s-a) 2 + k 2 

also, 

f nt » 1 ^ A 

C\e cos kt\ = - ■= - s > a. 

1 1 (s - a) 2 + k 2 


Example 15.10.1 


Damped Oscillator 


These expressions are useful when we consider an oscillating mass with damping propor¬ 
tional to the velocity. Equation (15.129), with such damping added, becomes 


mX”(t) + bX\t) + kX(t) = 0, 


(15.154) 


in which b is a proportionality constant. Let us assume that the particle starts from rest at 
X (0) = Xo, X'(0) — 0. The transformed equation is 

m[s 2 x(s ) — sXq] + fc[^x(^) — Xo] + kx(s ) = 0, (15.155) 


and 


ms + b 

x(s) = Xo - 2 - 

--- . 


ms z + bs + k 

This may be handled by completing the square of the denominator: 

2 / 7 . 7,2 


H- S -= s + 


AV+fi-i). 


2m 


4 m 2 / 


(15.156) 


(15.157) 


If the damping is small, b 1 < 4 km , the last term is positive and will be denoted by co 2 : 


x(s) — X 0 
— Xo 


s + b/m 


(s + b/2m) 2 + co 2 
s + b/2m 


X 0 - 


(. b/2ma)i)coi 


(s + b/2m) 2 + cof (s + b/2mY + 


,2 ' 


(15.158) 
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By Eq. (15.153), 


X{t) = Xoe <b / 2m)r ( coscoif H- 

\ 2 / 770)1 

= Xo—e~ lh ^ 2m ^ cos(o>it — <p), 

Ml 


sin o>i t 


(15.159) 


where 


b i k 

tan ip — -, 015 = —. 

2 / 770)1 777 

Of course, as b —» 0, this solution goes over to the undamped solution (Section 15.9). ■ 


RLC Analog 


It is worth noting the similarity between this damped simple harmonic oscillation of a mass 
on a spring and an RLC circuit (resistance, inductance, and capacitance) (Fig. 15.11). At 
any instant the sum of the potential differences around the loop must be zero (Kirchhoff’s 
law, conservation of energy). This gives 


dl 1 

L- + RI + - / ldt = 0. 

dt C J 


(15.160) 


Differentiating the current I with respect to time (to eliminate the integral), we have 


L 


d 2 I 
dt 2 


dl 1 

R -h —7 = 0. 

dt C 


(15.161) 


If we replace 7(f) with X(t), L with ///, R with b, and C -1 with k , then Eq. (15.161) is 
identical with the mechanical problem. It is but one example of the unification of diverse 
branches of physics by mathematics. A more complete discussion will be found in Olson’s 
book . 17 


R 

A/W 


AJU/ 


c 


L 


Figure 15.11 RLC circuit. 


i 7 H. F. Olson, Dynamical Analogies, New York: Van Nostrand (1943). 
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F(r) 




Figure 15.12 Translation. 


Translation 


This time let f(s) be multiplied by e ~ hs ,b> 0 : 


e~ bs f(s) = e~ b 


■f 


e~ s, F(t)dt 


/»00 

= / e~ s(,+b) F{t)dt. 

Jo 

Now let t + b — r. Equation (15.162) becomes 


(15.162) 


e~ bs f(s) = 



e ST F(r — b)dr 


e ST F(r — b)u(r~b)dr, 


(15.163) 


where u(r — b) is the unit step function. This relation is often called the Heaviside shifting 
theorem (Fig. 15.12). 

Since F(t) is assumed to be equal to zero for t < 0, F(x — b) = 0 for 0 < r < b. 
Therefore we can extend the lower limit to zero without changing the value of the integral. 
Then, noting that r is only a variable of integration, we obtain 

e~ bs f(s) = C{F(t -b)}. (15.164) 


Example 15.10.2 Electromagnetic Waves 


The electromagnetic wave equation with E — E y or E z , a transverse wave propagating 
along the v-axis, is 


3 2 E(x,t) 1 3 2 E(x,t) 

dx 2 v 2 3 1 2 


(15.165) 


Transforming this equation with respect to t, we get 


dx 2 


C\E(x, r)} 


C{E(x, f)} + 0) + 


1 3 E(x,t) 
v 2 3 1 


= 0 . 

1=0 


(15.166) 
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If we have the initial condition E(x, 0) = 0 and 

dE(x,t ) _ Q 

t =0 

then 

^C{E(x,t)} = S -^C{E(x,t)}. 
The solution (of this ODE) is 

C[E(x, t )} = cie~ (slv)x + c 2 e +(s/v)x . 


(15.167) 

(15.168) 


The “constants” c \ and c 2 are obtained by additional boundary conditions. They are 
constant with respect to x but may depend on s. If our wave remains finite as x —> 
oo, C{E(x, f)} will also remain finite. Hence c 2 = 0. If E( 0, t) is denoted by F(t), then 
ci = f(s) and 

£{£(x, r)} = e~ {s/v)x f(s). (15.169) 


From the translation property (Eq. (15.164)) we find immediately that 


E(x, t) — 


0 , 


t > 


f <T 


(15.170) 


Differentiation and substitution into Eq. (15.165) verifies Eq. (15.170). Our solution rep¬ 
resents a wave (or pulse) moving in the positive x -direction with velocity v. Note that for 
x > vt the region remains undisturbed; the pulse has not had time to get there. If we had 
wanted a signal propagated along the negative x-axis, cj would have been set equal to 0 
and we would have obtained 


E(x, t) 


*■(' + !). 

o, 


t 

V ’ 


(15.171) 


a wave along the negative x-axis. 


Derivative of a Transform 


When F(t), which is at least piecewise continuous, and v are chosen so that e sr F(t) 
converges exponentially for large s, the integral 



e~ s, F(t)dt 


is uniformly convergent and may be differentiated (under the integral sign) with respect 
to j. Then 


POO 

f'(s)= / (-t)e~ s, F(t)dt = £{-rF(r)}. (15.172) 

Jo 


Continuing this process, we obtain 

f( n \s) = £{(-t) n F(t)}. 


(15.173) 
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All the integrals so obtained will be uniformly convergent because of the decreasing expo¬ 
nential behavior of e~ st Fit). 

This same technique may be applied to generate more transforms. For example, 

poo 1 

C\e kt ]= / e~ st e kt dt= -, s > k. (15.174) 

Jo s-k 

Differentiating with respect to s (or with respect to k), we obtain 

= ^ 2 - S>k ■ ^ 15 - 175 ) 


Example 15.10.3 Bessel’s Equation 


An interesting application of a differentiated Laplace transform appears in the solution of 
Bessel’s equation with n — 0. From Chapter 11 we have 

x 2 y"ix) + xy\x) + x 2 y(x) — 0. (15.176) 

Dividing by x and substituting t = x and Fit) = yix) to agree with the present notation, 
we see that the Bessel equation becomes 

tF"{t) + F'(t) + tF(t) = 0. (15.177) 


We need a regular solution, in particular, F( 0) = 1. From Eq. (15.177) with t = 0, 
F'i+0) = 0. Also, we assume that our unknown Fit) has a transform. Transforming and 
using Eqs. (15.123), (15.124), and (15.172), we have 

~^-[s 2f (s) - s] + sf(s) - 1 - ^.f(s) = 0. (15.178) 

Rearranging Eq. (15.178), we obtain 

(. s 2 + l)f\s) + sf{s) = 0 , (15.179) 


or 


df s ds 

f S 2 + 1 ’ 


a first-order ODE. By integration. 

In f is) = — j ln(s 2 + l) + InC, 


which may be rewritten as 


m = 


c 

Vs 2 + 1 


(15.180) 

(15.181) 

(15.182) 


To make use of Eq. (15.108), we expand f(s) in a series of negative powers of s, conver¬ 
gent for.? > 1: 


m 


c 

5 



- 1/2 


1 1-3 
2s 2 + 2 2 • 2\s 4 


■ + 


(2"n!) 2 s 2n 


(15.183) 
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Inverting, term by term, we obtain 


F(t) = Cj2 

n =0 


(-1 y i t 2n 

(2 n n\) 2 ' 


(15.184) 


When C is set equal to 1, as required by the initial condition F( 0) = 1, Fit) is just Jo(t), 
our familiar Bessel function of order zero. Hence 

£{Jo(0} = -t^=. (15-185) 

Vs 2 + 1 

Note that we assumed s > 1. The proof for s > 0 is left as a problem. 

It is worth noting that this application was successful and relatively easy because we 
took n = 0 in Bessel’s equation. This made it possible to divide out a factor of x (or t). 
If this had not been done, the terms of the form t 2 F(t) would have introduced a second 
derivative of f(s). The resulting equation would have been no easier to solve than the 
original one. 

When we go beyond linear ODEs with constant coefficients, the Laplace transform may 
still be applied, but there is no guarantee that it will be helpful. 

The application to Bessel’s equation, n f 0, will be found in the references. Alterna¬ 
tively, we can show that 


C{j n (at)} 


a~ n (\/ s 2 + a 2 — s) n 
Vi 2 + a 2 


by expressing J n (t ) as an infinite series and transforming term by term. 


(15.186) 


Integration of Transforms 


Again, with Fit) at least piecewise continuous and x large enough so that e xt F(t) de¬ 
creases exponentially (as x -> oo), the integral 

/»00 

/(*)= / e~ xt F{t)dt (15.187) 

Jo 

is uniformly convergent with respect to x. This justifies reversing the order of integration 
in the following equation: 



fix ) dx — 



dt e xt Fit ) 


— (e- st -e~ bt )dt, (15.188) 

on integrating with respect to x. The lower limit ,v is chosen large enough so that fis) is 
within the region of uniform convergence. Now letting b —> oo, we have 

rfix ) dx=r F ^e-“dt = C 

Js Jo t 


Fit) 


(15.189) 



provided that Fit)/t is finite at t — 0 or diverges less strongly than t 1 (so that C{Fit)/t} 
will exist). 
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Limits of Integration — Unit Step Function 


The actual limits of integration for the Laplace transform may be specified with the (Heav¬ 
iside) unit step function 


For instance. 


u (t — k) = 


0 , 

1 , 


t < k 
1 > k. 


C{u (t 



dt=-e~ ks . 


s 


A rectangular pulse of width k and unit height is described by F(t) = u(t) — u(t — k). 
Taking the Laplace transform, we obtain 

rk j 

C[u{t) — u(t — k)} = / e~ sl dt — -(l — e~ ks ). 

J o 

The unit step function is also used in Eq. (15.163) and could be invoked in Exer¬ 
cise 15.10.13. 


Exercises 

15.10.1 Solve Eq. (15.154), which describes a damped simple harmonic oscillator for X(0) = 
X 0 , X'(0) = 0, and 

(a) b 2 — 4 km (critically damped), 

(b) b 2 > 4 km (overdamped). 

LA 

2m J 

15.10.2 Solve Eq. (15.154), which describes a damped simple harmonic oscillator for X (0) = 0, 
X'(0) = vq, and 

(a) b 2 < 4 km (underdamped), 

(b) b 2 — 4 km (critically damped), 

(c) b 2 > 4 km (overdamped). 

ANS. (a) X(t) = sincui t, 

co i 

(b) X(t) = v 0 te~ (b/2m)r . 

15.10.3 The motion of a body falling in a resisting medium may be described by 

d 2 X(t) dX(t) 

m --— = mg — b 

dt 1 


ANS. (a) X(t) = Xoe- (b/2m)t (\ + 


dt 
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when the retarding force is proportional to the velocity. Find X(t) and dX(t)/dt for the 
initial conditions 


15.10.4 


X(0) = 


dX 

dt 


= 0 . 

r=0 


Ringing circuit. In certain electronic circuits, resistance, inductance, and capacitance 
are placed in the plate circuit in parallel (Fig. 15.13). A constant voltage is maintained 
across the parallel elements, keeping the capacitor charged. At time t — 0 the circuit 
is disconnected from the voltage source. Find the voltages across the parallel elements 
R, L, and C as a function of time. Assume R to be large. 

Hint. By Kirchhoff’s laws 


where 


Ir + Ic + Il— 0 and Er — Ec = Er, 


dlL 

Er = IrR , E l = L-f- 
dt 


£c = ? + si>'’ 

qo = initial charge of capacitor. 


With the DC impedance of L — 0, let // (()) = Iq, Er( 0) = 0. This means qo — 0. 

15.10.5 With Jo(t) expressed as a contour integral, apply the Laplace transform operation, re¬ 
verse the order of integration, and thus show that 

C{Jo(t )} = (s 2 + l) ^ 2 , for^>0. 

15.10.6 Develop the Laplace transform of J n (t) from C\ Jo(t)} by using the Bessel function 
recurrence relations. 

Hint. Here is a chance to use mathematical induction. 


15.10.7 


A calculation of the magnetic field of a circular current loop in circular cylindrical 
coordinates leads to the integral 



e kz kJ\{kd)dk, 


9t(z) > 0. 


Show that this integral is equal to a/(z 2 + a 2 ) 3 / 2 . 
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15.10.8 The electrostatic potential of a point charge q at the origin in circular cylindrical coor¬ 
dinates is 


. — f e kz J Q (kp)dk =—^ 
47T£o J 0 47TJ 


1 


4tT£o (p 2 + Z 2 ) 1 / 2 ' 


SR(z) > 0. 


From this relation show that the Fourier cosine and sine transforms of Jo(kp) are 


(a) 


(b) 


jt 

2 F ‘ 


71 

2 F 


{/o(£p)}= f 

Jo 

\Mkp)}= r 

Jo 


Jo(kp) cos kt; dk = 


Jo(kp) sin kt, dk — 


(p 2 -er 1/2 , 

o, 


(p 2 -a 


2 \ 1/2 


P>^ 

p < ^. 

P > 

P <K- 


Hint. Replace z by z + if and take the limit as z —> 0. 

15.10.9 Show that 

£{/o(at)} = (^ 2 — « 2 ) ^ 2 , 

15.10.10 Verify the following Laplace transforms: 


s > a. 


(a) C{j 0 (at)} = C 


sin at 
at 


1 

= — cot 
a 


(b) £{«o(flO} does not exist, 

. , \ sinh at 

(c) £{/o(flr)} = £ 


at 


1 , s + a 1 

= — In-= - coth 

2 a s — a a 


-1 


(d) C{ko(at)} does not exist. 

15.10.11 Develop a Laplace transform solution of Laguerre’s equation 

tF"(t) + (1 - t)F\t) + nF(t ) = 0. 

Note that you need a derivative of a transform and a transform of derivatives. Go as far 
as you can with n; then (and only then) set n — 0. 


15.10.12 Show that the Laplace transform of the Laguerre polynomial L n (at) is given by 

£ > 0 . 


, , (,s — a)' 1 

C{L n (at)} = 


15.10.13 Show that 


where 


£{£i(f)} = -ln(s + 1), £ > 0, 


/ OO g — T f C 

- ~ J 

E\ it) is the exponential-integral function. 


-dx. 
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15 . 10.14 (a) From Eq. (15.189) show that 


nOO nC 

/ f{x)dx = 

Jo Jo 


F(t) 


dt. 


provided the integrals exist. 

(b) From the preceding result show that 


r°° sinf 

Jo t 


dt = 

2 


in agreement with Eqs. (15.122) and (7.56). 
15 . 10.15 (a) Show that 


sin kt 


— cot 


-l 


(b) Using this result (with k — 1), prove that 


£{si(f)} = —tan 1 s. 


where 


si it) = 


-j; 


sinx 


-dx, the sine integral. 


15 . 10.16 If Fit) is periodic (Fig. 15.14) with a period a so that Fit + a) — Fit) for all t > 0, 
show that 


. . f 1 ! e s, Fit)dt 


with the integration now over only the first period of Fit). 

15 . 10.17 Find the Laplace transform of the square wave (period a) defined by 

' 1, 0 <t <% 


Fit) = 


0 , 


^ < t < a. 


1 1 — e~ as ! 2 

ANS. /(*) = -■--— • 

s 1 — e as 


Fit) 



Figure 15.14 Periodic function. 
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15 . 10.18 Show that 


(a) 

(b) 


£{coshflf cosat} 


£{coshflf sinaf} 


s 4 + 4a 4 ' 

as 2 + 2 a 3 
s 4 + 4 a 4 


(c) £{sinhflf cos at} 

(d) £{sinhflt sinaf} 


as 2 — 2a 3 
s 4 + 4a 4 

2 a 2 s 
s 4 + 4 a 4 


15.10.19 Show that 

(a) £ -1 {(.s' 2 + a 2 ) ”} = —jsinflt- =tcosat, 

2a i 2a 1 

(b) £ _1 {.sG 2 + fl 2 ) 2 ] = — tsinat, 

2 a 

_i > 9/9 9\—2i 1 1 

(c) L [s (s + a ) } = sin^r + -tcosat, 

(d) £ _1 {.s 3 (s' 2 + a 2 ) “} = cosat — — t sin At. 


15 . 10.20 Show that 

C{(t 2 - k 2 y i/2 u(t - k)} = Ko(ks). 

Hint. Try transforming an integral representation of Ko(ks) into the Laplace transform 
integral. 

15 . 10.21 The Laplace transform 

f°° _ s 

i «-”*■*><*><'* = 51775372 

may be rewritten as 

7-L 

which is in Gauss-Laguerre quadrature form. Evaluate this integral for s — 1.0,0.9, 0.8, 
..., decreasing 5 in steps of 0.1 until the relative error rises to 10 percent. (The effect 
of decreasing s is to make the integrand oscillate more rapidly per unit length of y, thus 
decreasing the accuracy of the numerical quadrature.) 

15 . 10.22 (a) Evaluate 

e~ kz kJ\ ( ka ) dk 

by the Gauss-Laguerre quadrature. Take a — 1 and z = 0.1(0.1)1.0. 

(b) From the analytic form. Exercise 15.10.7, calculate the absolute error and the rel¬ 
ative error. 
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15.11 Convolution (Faltungs) Theorem 


One of the most important properties of the Laplace transform is that given by the convo¬ 
lution, or Faltungs, theorem. 18 We take two transforms, 

/i(i) = £{fi(f)} and f 2 (.s) = C{F 2 (t)}, (15.190) 

and multiply them together. To avoid complications when changing variables, we hold the 
upper limits finite: 


fl(s)f 2 (s) = lim f e sx F\ (x)dx f e sy F 2 (y')dy. (15.191) 

a ^°°Jo Jo 


The upper limits are chosen so that the area of integration, shown in Fig. 15.15a, is the 
shaded triangle, not the square. If we integrate over a square in the xy -plane, we have 
a parallelogram in the f ’-plane, which simply adds complications. This modification is 
permissible because the two integrands are assumed to decrease exponentially. In the limit 
a —> oo, the integral over the unshaded triangle will give zero contribution. Substituting 
x — t — z, y = z, the region of integration is mapped into the triangle shown in Fig. 15.15b. 
To verify the mapping, map the vertices: t = x + y, z = y. Using Jacobians to transform 
the element of area, we have 


dx dy = 


dx 

~3t 

dy 

dt 

dt dz = 

1 0 

dx 

dy 

-1 1 

dz 

dz 




dt dz 


(15.192) 


or dx dy — dt dz. With this substitution Eq. (15.191) becomes 



Figure 15.15 
Change of variables, 
(a) xy-plane (b) zf-plane. 


1 x An alternate derivation employs the Bromwich integral (Section 15.12). This is Exercise 15.12.3. 
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For convenience this integral is represented by the symbol 


/' 


F\ (t - z)F 2 (z ) dz= Fi* Fi 


(15.194) 


and referred to as the convolution, closely analogous to the Fourier convolution (Sec¬ 
tion 15.5). If we substitute w — t — z, we find 


F\ * F 2 — F 2 * F\, 


(15.195) 


showing that the relation is symmetric. 

Carrying out the inverse transform, we also find 

£~ 1 {Ms)Ms)}= f Fi(t-z)F 2 (z)dz. (15.196) 

Jo 

This can be useful in the development of new transforms or as an alternative to a partial 
fraction expansion. One immediate application is in the solution of integral equations (Sec¬ 
tion 16.2). Since the upper limit, t, is variable, this Laplace convolution is useful in treating 
Volterra integral equations. The Fourier convolution with fixed (infinite) limits would apply 
to Fredholm integral equations. 


Example 15.11.1 Driven Oscillator with Damping 


As one illustration of the use of the convolution theorem, let us return to the mass m on 
a spring, with damping and a driving force F(t). The equation of motion ((15.129) or 
(15.154)) now becomes 

mX"(t) + bX\t) + kX(t) = F(t). (15.197) 

Initial conditions A(0) = 0, X' (0) = 0 are used to simplify this illustration, and the trans¬ 
formed equation is 

ms 2 x(s ) + bs x(s) + kx(s) — f(s), (15.198) 


x(s) = 


Hs) 


m (v + b/2m) 2 + 


where coj = k/m — b 2 /Am 2 , as before. 

By the convolution theorem (Eq. (15.193) or (15.196)), 


lo 

If the force is impulsive, F(t ) = P8(t), 19 

P 

X(t) = 


mw\ 


e-mm), sino)it 


(15.199) 


1 C 1 

X(t) = - / F(t-z)e- (bl2m)z sin anzdz. (15.200) 

mco i J o 


(15.201) 


l9 Note that S(t ) lies inside the interval [0, f]. 
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P represents the momentum transferred by the impulse, and the constant P/m takes the 
place of an initial velocity X'(0). 

If F{t) — f’o sin cot, Eq. (15.200) may be used, but a partial fraction expansion is perhaps 
more convenient. With 


Eq. (15.199) becomes 


m = 


Foot 

S 2 + CO 2 


x(s) = ._ 1 _ 1 _ 

m s 2 + co 2 (s + b/2m) 2 + coj 


Foot 

m 


c's + d' 


a's + b' 


s 2 + co 2 (s+ b/2m) 2 +coj j 


(15.202) 


The coefficients a!, /;', c', and cl' are independent of v. Direct calculation shows 


1 

a’ 



., 2\2 


1 

V 



Since d and cl’ will lead to exponentially decreasing terms (transients), they will be dis¬ 
carded here. Carrying out the inverse operation, we find for the steady-state solution 


X(t) = 


Fo 


[b 2 co 2 + m 2 imi, — &) 2 ) 2 ] 1 / 2 


sin(&>/ — <p), 


(15.203) 


where 


tan cp ■■ 


bco 


m (ad. — co 2 ) 


Differentiating the denominator, we find that the amplitude has a maximum when 


ot~ — co 0 — ^ = a> 1 — 2 


(15.204) 


This is the resonance condition. 20 At resonance the amplitude becomes Fo/bcoi, showing 
that the mass m goes into infinite oscillation at resonance if damping is neglected (b — 0). 
It is worth noting that we have had three different characteristic frequencies: 




■(On. 


2m 2 ’ 


resonance for forced oscillations, with damping; 


Jd_ 

4m 2 ’ 


- () Thc amplitude (squared) has the typical resonance denominator, the Lorentz line shape, Exercise 15.3.9. 
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free oscillation frequency, with damping; and 

2 ^ 

«o = 

m 

free oscillation frequency, no damping. They coincide only if the damping is zero. ■ 

Returning to Eqs. (15.197) and (15.199), Eq. (15.197) is our ODE for the response of 
a dynamical system to an arbitrary driving force. The final response clearly depends on both 
the driving force and the characteristics of our system. This dual dependence is separated 
in the transform space. In Eq. (15.199) the transform of the response (output) appears as 
the product of two factors, one describing the driving force (input) and the other describing 
the dynamical system. This latter part, which modifies the input and yields the output, is 
often called a transfer function. Specifically, [(s + b/2m) 2 + co 2 ]~ l is the transfer function 
corresponding to this damped oscillator. The concept of a transfer function is of great use in 
the field of servomechanisms. Often the characteristics of a particular servomechanism are 
described by giving its transfer function. The convolution theorem then yields the output 
signal for a particular input signal. 


Exercises 


15.11.1 From the convolution theorem show that 

1 r r‘ 

— C / F(x)d.x 
s Jo 

where f(s ) = C{F(t)}. 

15.11.2 If F(t) = t a and G{t) = t b , a > -1, b>- 1: 


(a) Show that the convolution 


F*G=t a 


f y a Cl¬ 
io 


y) b dy. 


(b) By using the convolution theorem, show that 


/ y a (l-y) b dy= , , . 

Jo (a + b + 1)! 

This is the Euler formula for the beta function (Eq. (8.59a)). 

15 . 11.3 Using the convolution integral, calculate 

j —pyrl’ cr^b 2 . 

(s 2 + a 2 )(s 2 + b 2 ) J 

15 . 11.4 An undamped oscillator is driven by a force Fq sin cot. Find the displacement as a func¬ 
tion of time. Notice that it is a linear combination of two simple harmonic motions, 
one with the frequency of the driving force and one with the frequency ojq of the free 
oscillator. (Assume X(0) = X'(0) = 0.) 

Fo/m ( w \ 

ANS. X (t) — — -y I — sin&>o t — sin cot 1. 

co 2 — wS \&>o / 
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Other exercises involving the Laplace convolution appear in Section 16.2. 

15.12 Inverse Laplace Transform 
B romwich Integral 

We now develop an expression for the inverse Laplace transform £ _1 appearing in the 
equation 


F(t) = C~ 1 {f(s)}. (15.205) 

One approach lies in the Fourier transform, for which we know the inverse relation. There 
is a difficulty, however. Our Fourier transformable function had to satisfy the Dirichlet 
conditions. In particular, we required that 

lim G(co) = 0 (15.206) 

<£>—>00 

so that the infinite integral would be well defined. 21 Now we wish to treat functions F(t) 
that may diverge exponentially. To surmount this difficulty, we extract an exponential fac¬ 
tor, e yt , from our (possibly) divergent Laplace function and write 

F(t) = e y, G(t). (15.207) 

If F(t) diverges as e 01 ', we require y to be greater than a so that G(t) will be convergent. 
Now, with G(t) — 0 for t < 0 and otherwise suitably restricted so that it may be represented 
by a Fourier integral (Eq. (15.20)), 

j p OO n OO 

G(t) = — / e iut du / G(v)e~ iuv dv. (15.208) 

J —oo Jo 

Using Eq. (15.207), we may rewrite (15.208) as 

yt poo poo 

F(t) — - — / e lut du I F(v)e- yv e~ n,v dv. (15.209) 

J —oo Jo 

Now, with the change of variable. 


s — y + iu. 


the integral over v is thrown into the form of a Laplace transform. 



dv = f(s ); 


(15.210) 


(15.211) 


21 If delta functions are included, G(&>) may be a cosine. Although this does not satisfy Eq. (15.206), G(a>) is still bounded. 
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Figure 15.16 Singularities 
of e st f(s). 


s is now a complex variable, and SHf?) > y to guarantee convergence. Notice that the 
Laplace transform has mapped a function specified on the positive real axis onto the com¬ 
plex plane, 31 (,v) > y. 22 

With y as a constant, ds = i du. Substituting Eq. (15.211) into Eq. (15.209), we obtain 

1 ny+ioo 

F(t)— -—7 / e st f(s)ds. (15.212) 

Jy—ioo 

Here is our inverse transform. We have rotated the line of integration through 90° (by 
using ds — i du). The path has become an infinite vertical line in the complex plane, the 
constant y having been chosen so that all the singularities of f(s) are on the left-hand side 
(Fig. 15.16). 

Equation (15.212), our inverse transformation, is usually known as the Bromwich in¬ 
tegral, although sometimes it is referred to as the Fourier-Mellin theorem or Fourier- 
Mellin integral. This integral may now be evaluated by the regular methods of contour 
integration (Chapter 7). If t > 0, the contour may be closed by an infinite semicircle in the 
left half-plane. Then by the residue theorem (Section 7.1) 

F(t) — E(residues included for JH(s) < y). (15.213) 

Possibly this means of evaluation with (s) ranging through negative values seems para¬ 
doxical in view of our previous requirement that S H(s) > y. The paradox disappears when 
we recall that the requirement JH(s) > y was imposed to guarantee convergence of the 
Laplace transform integral that defined f(s). Once /Tv) is obtained, we may then pro¬ 
ceed to exploit its properties as an analytical function in the complex plane wherever we 
choose . 23 In effect we are employing analytic continuation to get C{F(t)} in the left half¬ 
plane, exactly as the recurrence relation for the factorial function was used to extend the 
Euler integral definition (Eq. (8.5)) to the left half-plane. 

Perhaps a pair of examples may clarify the evaluation of Eq. (15.212). 


--For a derivation of the inverse Laplace transform using only real variables, see C. L. Bohn and R. W. Flynn, Real variable 
inversion of Laplace transforms: An application in plasma physics. Am. J. Phys. 46: 1250 (1978). 

- 'In numerical work /(s) may well be available only for discrete real, positive values of s. Then numerical procedures are 
indicated. See Krylov and Skoblya in the Additional Reading. 
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Example 15.12.1 Inversion via Calculus of Residues 


If f(s) — a/is 2 — a 2 ), then 


e s, f(s) = 


ae 


ae 


(, s + a) (,y — a) 


(15.214) 


The residues may be found by using Exercise 6.6.1 or various other means. The first step is 
to identify the singularities, the poles. Here we have one simple pole at s — a and another 
simple pole at s — —a. By Exercise 6.6.1, the residue at .y — a is (\)e : " and the residue at 
s = — a is (— \)e~ a '. Then 


Residues = {j){e at — e ar ) — sinhof = Fit), 
in agreement with Eq. (15.105). 


(15.215) 


Example 15.12.2 


if 


1 — e 


f(s) = 

s 

then grows exponentially for t < a on the semicircle in the left-hand s-plane, so 

contour integration and the residue theorem are not applicable. However, we can evaluate 
the integral explicitly as follows. We let y -> 0 and substitute s = iy, so 

"y +i °° 1 f 00 - • . . ^dy 

'] —. (15.216) 


1 


F{t) 2TTi J v : 


ry+i 
1 Jy—ic 


\ r°° . 

e s<f( s )=—\ ie'y'-e 1 
27 ri_ 00 L 


y 


Using the Euler identity, only the sines survive that are odd in y and we obtain 

1 

F(t) = - 


f 00 [" sinf v 

1 

•+«* 

'c/3 

J-ool y 

V J 


(15.217) 


If k > 0, then J 0 °° dy gives 7r/2, and it gives —7r/2 if k < 0. As a consequence, 

F(t) = 0ift>fl>0 and if t < 0. If 0 < t < a, then Fit) — 1. This can be written 
compactly in terms of the Heaviside unit step function u(t) as follows: 

fo, 

Fit) — u it) — n(r — a) — 


1, 

0, 


t < 0, 

0 < t < a, 
t > a. 


(15.218) 


a step function of unit height and length a (Fig. 15.17). 


Two general comments may be in order. First, these two examples hardly begin to show 
the usefulness and power of the Bromwich integral. It is always available for inverting a 
complicated transform when the tables prove inadequate. 

Second, this derivation is not presented as a rigorous one. Rather, it is given more as 
a plausibility argument, although it can be made rigorous. The determination of the in¬ 
verse transform is somewhat similar to the solution of a differential equation. It makes 
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F(t) 


- T^Ta - 

Figure 15.17 
Finite-length step function 
u(t) — u(t — a). 


little difference how you get the solution. Guess at it if you want. The solution can al¬ 
ways be checked by substitution back into the original differential equation. Similarly, 
F(t) can (and, to check on careless errors, should) be checked by determining whether, by 
Eq. (15.99), 

£{F(f)} = /(s). 

Two alternate derivations of the Bromwich integral are the subjects of Exercises 15.12.1 
and 15.12.2. 

As a final illustration of the use of the Laplace inverse transform, we have some results 
from the work of Brillouin and Sommerfeld (1914) in electromagnetic theory. 


Example 15.12.3 Velocity of Electromagnetic Waves in a Dispersive Medium 


The group velocity u of traveling waves is related to the phase velocity v by the equation 


dv 

u — v — X —. 

dX 


(15.219) 


Here X is the wavelength. In the vicinity of an absorption line (resonance), dv/dX may be 
sufficiently negative so that u > c (Fig. 15.18). The question immediately arises whether 
a signal can be transmitted faster than c, the velocity of light in vacuum. This question, 
which assumes that such a group velocity is meaningful, is of fundamental importance to 
the theory of special relativity. 

We need a solution to the wave equation 


d 2 \fr 1 3 2 i {r 
dx 2 v 2 3 1 2 


(15.220) 


corresponding to a harmonic vibration starting at the origin at time zero. Since our medium 
is dispersive, v is a function of the angular frequency. Imagine, for instance, a plane wave, 
angular frequency a>, incident on a shutter at the origin. At t — 0 the shutter is (instanta¬ 
neously) opened, and the wave is permitted to advance along the positive x-axis. 
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Figure 15.1 8 Optical dispersion. 


Let us then build up a solution starting at x — 0. It is convenient to use the Cauchy 
integral formula, Eq. (6.43), 


1 r e~ izt 

i//(0, t) = - CD - dz = e ,z °' 

2:xi J z — zo 

(for a contour encircling z = zo in the positive sense). Using s = —iz and zo = &>, we 
obtain 


iA(0. f) = 


j ny+ioo £ st 

-—: / -— ds — 

2ni Jy—ioQ s "j~ i o) 


0, 

e~ i(0t 


t < 0, 
t > 0. 


(15.221) 


To be complete, the loop integral is along the vertical line SHU) = y and an infinite semi¬ 
circle, as shown in Fig. 15.19. The location of the infinite semicircle is chosen so that the 
integral over it vanishes. This means a semicircle in the left half-plane for t > 0 and the 
residue is enclosed. For t < 0 we pick the right half-plane and no singularity is enclosed. 
The fact that this is just the Bromwich integral may be verified by noting that 


F(t) = 


0, 

g—icot 


t < 0, 
t > 0 


(15.222) 





-/CO' 


/<0 



Figure 15.19 Possible closed contours. 
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and applying the Laplace transform. The transformed function /Tv) becomes 

/(*) = —^— • (15.223) 

S + ICO 

Our Cauchy-Bromwich integral provides us with the time dependence of a signal leav¬ 
ing the origin at t = 0. To include the space dependence, we note that 

e s(t-x/v) 

satisfies the wave equation. With this as a clue, we replace f by t —x/v and write a solution: 

j ry+ioo s(t-x/v) 

f( x j)= / - ; — ds. (15.224) 

2tv i Jy—ioQ s H - i(o 

It was seen in the derivation of the Bromwich integral that our variable ,v replaces the u> 
of the Fourier transformation. Hence the wave velocity v may become a function of .v, that 
is, i’(.v). Its particular form need not concern us here. We need only the property v < c and 

lim v(s) = constant, c. (15.225) 

|s|—>oo 

This is suggested by the asymptotic behavior of the curve on the right side of Fig. 15.18. 24 

Evaluating Eq. (15.225) by the calculus of residues, we may close the path of integration 
by a semicircle in the right half-plane, provided 

x 

t -<0. 

c 

Hence 

f(x,t) = 0, t--< 0, (15.226) 

c 

which means that the velocity of our signal cannot exceed the velocity of light in the vac¬ 
uum, c. This simple but very significant result was extended by Sommerfeld and Brillouin 
to show just how the wave advanced in the dispersive medium. ■ 


Summary—Inversion of Laplace Transform 

• Direct use of tables. Table 15.2, and references; use of partial fractions (Section 15.8) 
and the operational theorems of Table 15.1. 

• Bromwich integral, Eq. (15.212), and the calculus of residues. 

• Numerical inversion, see the Additional Readings. 


24 Equation (15.225) follows rigorously from the theory of anomalous dispersion. See also the Kronig-Kramers optical disper¬ 
sion relations of Section 7.2. 
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Table 15.1 Laplace Transform Operations 


Operations 


f(.s) = C{F(t)}= f e~ s, F(t)dt 

Jo 

sf(s)-F(+0) = £{F'(t)} 


1. Laplace transform 

2. Transform of derivative 

3. Transform of integral 

4. Substitution 

5. Translation 

6. Derivative of transform 

7. Integral of transform 

8. Convolution 

9. Inverse transform, Bromwich integral 


s 2 f(s) - sF(+ 0) - F'(+0) = C{F"(t)} 

'/(s) = lJ^ F(x)TyJ 

f(s-a) = C[e at F(t)} 
e~ bs f(s) = C{F(t-b)) 
f( n \s) = C{(-t) n F(t)} 

l 

= Ti(f-z)F 2 (z)rfz| 

\ ry+ioo 

— e st f(s)ds = F(t) 

Jy—ioo 


Equation 

(15.99) 

(15.123) 

(15.124) 

(Exercise 15.11.1) 

(15.152) 

(15.164) 

(15.173) 

(15.189) 

(15.193) 

(15.212) 


Exercises 


15 . 12.1 Derive the Bromwich integral from Cauchy’s integral formula. 
Hint. Apply the inverse transform JZ~ l to 


1 ry+iot 

=- lim / 

2ni oi—>oo J y_ ia 


m = — 

2jt 

where f(z) is analytic for IH(z) > y. 

15 . 12.2 Starting with 

j ry+ioo 


Hz) 


dz, 


y—ict s 2 


rv+‘ 

— / e sl f (s)ds, 

Z7T l J y—ioo 


show that by introducing 


i 


f(s)= / e sz F(z)dz, 


we can convert one integral into the Fourier representation of a Dirac delta function. 
From this derive the inverse Laplace transform. 

15 . 12.3 Derive the Laplace transformation convolution theorem by use of the Bromwich inte¬ 
gral. 


15 . 12.4 Find 


— l 


s 2 — k 2 


(a) by a partial fraction expansion. 

(b) Repeat, using the Bromwich integral. 
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Table 15.2 Laplace Transforms 


m 

F(t ) 

Limitation 

Equation 

1.1 

5(0 

Singularity at +0 

(15.141) 

i 

2. - 
s 

1 

s > 0 

(15.102) 

3 — 

*»+i 

t n 

s > 0 

(15.108) 



/! > — 1 


1 

4.-- 

e kt 

s > k 

(15.103) 

s — k 



1 

5. 7-TT9 

te kt 

s > k 

(15.175) 

(s - k) 2 



6 ' s 2 - k 2 

cosh kt 

s > k 

(15.105) 

k 

1 ' s 2 - k 2 

sinh kt 

s > k 

(15.105) 

8 ' s 2 + k 2 

cos kt 

s > 0 

(15.107) 

9 k 

s 2 + k 2 

sin kt 

s > 0 

(15.107) 

s — a 

i°.-^7 

e at cos kt 

s > a 

(15.153) 

{s — a) 2 + k 2 



k 

11. -=- T 

(i — a) 2 + k 2 

e at sin kt 

s > a 

(15.153) 

s 2 -k 2 




1Z (s 2 +k 2 ) 2 

t cos kt 

s > 0 

(Exercise 15.10.19) 

2 ks 

13 - (s 2 + k 2 ) 2 

t sin kt 

s > 0 

(Exercise 15.10.19) 

14. (s 2 + a 2 )~ x l 2 

Mat) 

s > 0 

(15.185) 

15. 0 2 — a 2 )~1/ 2 

Mat) 

s > a 

(Exercise 15.10.9) 

16. — cot -1 ) 

a \ a / 

1 s + a 

— In - 

2 a s — a 

jo (at) 

s > 0 

(Exercise 15.10.10) 

11. , ✓ \ 
« COth ''(a) 

io (at) 

s > a 

(Exercise 15.10.10) 

(i - a)” 




18. , / 
s n+l 

L n (at) 

s > 0 

(Exercise 15.10.12) 

19. - ln(.« + 1) 
s 

Ei ( x ) — —Ei(—x) 

s > 0 

(Exercise 15.10.13) 

_ In .9 

20. — 

- In t — y 

s > 0 

(Exercise 15.12.9) 

s 





A more extensive table of Laplace transforms appears in Chapter 29 of AMS-55 (see footnote 4 in Chapter 5 for the reference). 

15.12.5 Find 



s(s 2 + k 2 ) 
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(a) by using a partial fraction expansion. 

(b) Repeat using the convolution theorem. 

(c) Repeat using the Bromwich integral. 

ANS. F(t)= 1-cos kt. 

15 . 12.6 Use the Bromwich integral to find the function whose transform is f(s ) = s -1 / 2 . Note 
that f(s ) has a branch point at .v = 0. The negative .t-axis may be taken as a cut line. 

ANS. F(t) — 

15 . 12.7 Show that 

£ _1 {(i 2 + l) _1/2 } = J 0 (t) 
by evaluation of the Bromwich integral. 

Hint. Convert your Bromwich integral into an integral representation of Jo(t). Fig¬ 
ure 15.20 shows a possible contour. 

15 . 12.8 Evaluate the inverse Laplace transform 

by each of the following methods: 


(a) Expansion in a series and term-by-term inversion. 

(b) Direct evaluation of the Bromwich integral. 

(c) Change of variable in the Bromwich integral: s — (a/2)(z + z -1 )- 



Figure 15.20 A possible 
contour for the inversion of 
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15.12.9 Show that 



= — In t — y. 


where y = 0.5772.... the Euler-Mascheroni constant. 


15.12.10 Evaluate the Bromwich integral for 

m = 


(, s 2 + a 2 ) 2 

15.12.11 Heaviside expansion theorem. If the transform f is) may be written as a ratio 


m = 


g00 

h(s)’ 


where g(s) and h(s) are analytic functions, his) having simple, isolated zeros at s = Sj , 
show that 


F(t) — C~ l 


S(s) ] _ g(Si) c s lt 
h{s)\ V h'(si) 

l 


Hint. See Exercise 6.6.2. 

15.12.12 Using the Bromwich integral, invert f(s) — s~ 2 e~ ks . Express F(t) = £~ l !./fv)} in 
terms of the (shifted) unit step function n(t — k). 

ANS. F{t) = {t — k)u(t — k). 


15.12.13 You have a Laplace transform: 

m = 


i 


(s + a)(s + b) ’ 
Invert this transform by each of three methods: 


a 7 ^ b. 


(a) Partial fractions and use of tables. 

(b) Convolution theorem. 

(c) Bromwich integral. 


e~ bt — e ~ at 

ANS. F(t) = -, a + b. 

a — b 


Additional Readings 


Champeney, D. C., Fourier Transforms and Their Physical Applications. New York: Academic Press (1973). 
Fourier transforms are developed in a careful, easy-to-follow manner. Approximately 60% of the book is 
devoted to applications of interest in physics and engineering. 

Erdelyi, A.,W. Magnus, F. Oberhettinger, and F. G. Tricomi, Tables of Integral Transforms, 2 vols. New York: 
McGraw-Hill (1954). This text contains extensive tables of Fourier sine, cosine, and exponential transforms, 
Laplace and inverse Laplace transforms, Mellin and inverse Mellin transforms, Hankel transforms, and other, 
more specialized integral transforms. 
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Hanna, J. R., Fourier Series and Integrals of Boundary Value Problems. Somerset, NJ: Wiley (1990). This book 
is a broad treatment of the Fourier solution of boundary value problems. The concepts of convergence and 
completeness are given careful attention. 

Jeffreys, H., and B. S. Jeffreys, Methods of Mathematical Physics, 3rd ed. Cambridge, UK: Cambridge University 
Press (1972). 

Krylov, V. I., and N. S. Skoblya, Handbook of Numerical Inversion of Laplace Transform. Jerusalem: Israel 
Program for Scientific Translations (1969). 

Lepage, W. R., Complex Variables and the Laplace Transform for Engineers. New York: McGraw-Hill (1961); 
New York: Dover (1980). A complex variable analysis that is carefully developed and then applied to Fourier 
and Laplace transforms. It is written to be read by students, but intended for the serious student. 

McCollum, P. A., and B. F. Brown, Laplace Transform Tables and Theorems. New York: Holt, Rinehart and 
Winston (1965). 

Miles, J. W., Integral Transforms in Applied Mathematics. Cambridge, UK: Cambridge University Press (1971). 
This is a brief but interesting and useful treatment for the advanced undergraduate. It emphasizes applications 
rather than abstract mathematical theory. 

Papoulis, A., The Fourier Integral and Its Applications. New York: McGraw-Hill (1962). This is a rigorous 
development of Fourier and Laplace transforms and has extensive applications in science and engineering. 

Roberts, G. E., and H. Kaufman, Table of Laplace Transforms. Philadelphia: Saunders (1966). 

Sneddon, I. N., Fourier Transforms. New York: McGraw-Hill (1951), reprinted, Dover (1995). A detailed com¬ 
prehensive treatment, this book is loaded with applications to a wide variety of fields of modem and classical 
physics. 

Sneddon, I. H., The Use of Integral Transforms. New York: McGraw-Hill (1972). Written for students in science 
and engineering in terms they can understand, this book covers all the integral transforms mentioned in this 
chapter as well as in several others. Many applications are included. 

Van der Pol, B., and H. Bremmer, Operational Calculus Based on the Two-sided Laplace Integral, 3rd ed. Cam¬ 
bridge, UK: Cambridge University Press (1987). Here is a development based on the integral range —oo to 
+oo, rather than the useful 0 to oo. Chapter V contains a detailed study of the Dirac delta function (impulse 
function). 

Wolf, K. B., Integral Transforms in Science and Engineering. New York: Plenum Press (1979). This book is a 
very comprehensive treatment of integral transforms and their applications. 



Chapter 16 


Integral Equations 


16.1 Introduction 

With the exception of the integral transforms of the last chapter, we have been considering 
relations between the unknown function < fi(x) and one or more of its derivatives. We now 
proceed to investigate equations containing the unknown function within an integral. As 
with differential equations, we shall confine our attention to linear relations, linear integral 
equations. Integral equations are classified in two ways: 

• If the limits of integration are fixed, we call the equation a Fredholm equation; if one 
limit is variable, it is a Volterra equation. 

• If the unknown function appears only under the integral sign, we label it first kind. 

If it appears both inside and outside the integral, it is labeled second kind. 


Definitions 


Symbolically, we have a Fredholm equation of the first kind, 

.fix)— f K(x,t)<p(t)dt', 

Ja 

the Fredholm equation of the second kind, with X being the eigenvalue, 

<p(x) = f(x)+X ( K(x,t)(p(t)dt\ 

Ja 

the Volterra equation of the first kind, 

f{x)= f K(x,t)<p(t)dt ; 

Ja 


(16.1) 


(16.2) 


(16.3) 
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and the Volterra equation of the second kind, 

(p(x) = f(x) + f K(x,t)<p(t)dt. (16.4) 

Ja 

In all four cases cp(t) is the unknown function. K(x, t ), which we call the kernel, and 
f{x ) are assumed to be known. When f(x) — 0, the equation is said to be homogeneous. 

Why do we bother about integral equations? After all, the differential equations have 
done a rather good job of describing our physical world so far. There are several reasons 
for introducing integral equations here. 

We have placed considerable emphasis on the solution of differential equations subject 
to particular boundary conditions. For instance, the boundary condition at r — 0 deter¬ 
mines whether the Neumann function N n (r ) is present when Bessel’s equation is solved. 
The boundary condition for r —> oo determines whether the /„ (r ) is present in our solu¬ 
tion of the modified Bessel equation. The integral equation relates the unknown function 
not only to its values at neighboring points (derivatives) but also to its values throughout a 
region, including the boundary. In a very real sense the boundary conditions are built into 
the integral equation rather than imposed at the final stage of the solution. It can be seen in 
Section 10.5, where kernels are constructed, that the form of the kernel depends on the val¬ 
ues on the boundary. The integral equation, then, is compact and may turn out to be a more 
convenient or powerful form than the differential equation. Mathematical problems such as 
existence, uniqueness, and completeness may often be handled more easily and elegantly 
in integral form. Finally, whether or not we like it, there are some problems, such as some 
diffusion and transport phenomena, that cannot be represented by differential equations. 
If we wish to solve such problems, we are forced to handle integral equations. Finally, an 
integral equation may also appear as a matter of deliberate choice based on convenience or 
the need for the mathematical power of an integral equation formulation. 


Example 16.1.1 Momentum Representation in Quantum Mechanics 

The Schrodinger equation (in ordinary space representation) is 

h 2 


2m 


V i/f(r) + V(r)ifr(r) — E\j/(r), 


(V- + a~)\jr{r) = u(r)i/r(r), 


where 


2m 


2m 


a z =-yE, u(r) = -jV(r). 
n n z 

If we generalize Eq. (16.6) to 

(V 2 + a 2 )\j/(r) — J v(r, r , )V f (r , )d : V, 
then, for the special case of 

v(r, r') = u(r , )5(r — r'), 


(16.5) 

(16.6) 

(16.7) 

(16.8) 

(16.9) 
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a local interaction, Eq. (16.8) reduces to Eq. (16.6). Consider the Fourier transform pair i// 
and T (compare footnote 9 in Section 15.6): 


*00 = 




ij/(r)e lkr d 3 r , t/r(r) = 


1 


(2 t r) 3 / 2 

with the abbreviation p for momentum so that 


(2 7r) 3 / 2 


/ 


4'(k)<? /kr d 3 C (16.10) 


— = k (wave number). 


Multiplying Eq. (16.8) by the plane-wave e ,kr , we obtain 

J c _,k ' r (V 2 + a 2 )i/f (r) d 3 r = J d 3 re~' kr J u(r, r')i/r(r r ) d 3 r'. 


(16.11) 


(16.12) 


Note that the V 2 on the left operates only on the i/r(r). Integrating the left-hand side by 
parts and substituting Eq. (16.10) for i/ f (r / ) on the right, we get 

J ( — k 2 + a 2 )\l/(r)e~' kr d 3 r — (2i r) 3 ^ 2 ( — k 2 + fl 2 )'k(k) 


1 


(27r) 3 / 2 


)vk(k')e“ i(k r “ k ' r,) dV d 3 r d 3 k!. 


(16.13) 


If we use 


/ (k, k') = 


1 


( 2 n ) 3 / 2 


J j u(r, r , )e“ , ' (k r “ k ' r ' , d 3 / d 3 r, (16.14) 


Eq. (16.13) becomes 


( - k 2 + a 2 )^( k) = J /(k, k')vp(k')J 3 C, 


(16.15) 


a Fredholm equation of the second kind in which the parameter a 2 corresponds to the 
eigenvalue. 

For our special but important case of local interaction, application of Eq. (16.9) leads to 


/ (k, k') = /(k — k'). 


(16.16) 


This is our momentum representation, equivalent to an ordinary static interaction poten¬ 
tial in coordinate space. Our momentum wave function T (k) satisfies the integral equation 
Eq. (16.15). It must be emphasized that all through here we have assumed that the required 
Fourier integrals exist. For a harmonic oscillator potential, E(r) = r 2 , the required inte¬ 
grals would not exist. Equation (16.10) would lead to divergent oscillations and we would 
have no Eq. (16.15). ■ 
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Transformation of a Differential Equation into an 
Integral Equation 

Often we find that we have a choice. The physical problem may be represented by a dif¬ 
ferential or an integral equation. Let us assume that we have the differential equation and 
wish to transform it into an integral equation. Starting with a linear second-order ODE 

y" + A(x)y' + B(x)y = g(x) (16.17) 


with initial conditions 


y(a) = y 0 , y\a) = y' 0 , 

we integrate to obtain 

/(*) = - f A(t)y'(t)dt- f B(t)y(t)dt + f g(t)dt + y' 0 . (16.18) 

J a J a J a 

Integrating the first integral on the right by parts yields 

y'(x) = -Ay(x)~ [ (B — A')y(t)dt + [ g(t) dt + A(a)y 0 + y'. (16.19) 

J a J a 

Notice how the initial conditions are being absorbed into our new version. Integrating a 
second time, we obtain 

px nx nu 

y(x) — — / Aydx— / du / [B(f) — A'{t)\y(t) dt 
J a J a J a 

-/ du g(t)dt + \A(a)y 0 + y' Q ](x-a) + y 0 - 

J a J a 


+ 


(16.20) 


(16.21) 


To transform this equation into a neater form, we use the relation 

nx pu px 

/ du I f(t)dt= / (x — t)f(t)dt. 

J a J a J a 

This may be verified by differentiating both sides. Since the derivatives are equal, the 
original expressions can differ only by a constant. Letting x —> a , the constant vanishes 
and Eq. (16.21) is established. Applying it to Eq. (16.20), we obtain 

y(x) = - f {A(f) + (x-f)[B(0- A\t)]]y(t)dt 
J a 

+ [ (x - t)g(t) dt + [A(a)yo + Vo](.v - a) + yo- 

J a 

If we now introduce the abbreviations 

K(x,t ) = {t -x)[B(t) - A'(t)] - A(t), 

fix) = f (x - t)g(t) dt + [A(fl)yo + Vo] (x - a) + yo, 

J a 


(16.22) 


(16.23) 
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Eq. (16.22) becomes 


y(x) = f(x) + f K(x,t)y(t)dt, (16.24) 

J a 

which is a Volterra equation of the second kind. This reformulation as a Volterra integral 
equation offers certain advantages in investigating questions of existence and uniqueness. 


Example 16.1.2 Linear Oscillator Equation 

As an illustration, consider the linear oscillator equation 

y" + (0 2 y = 0 (16.25) 

with 


y(0) = 0, y'(0) = l. 

This yields (compare with Eq. (16.17)) 

A(x) = 0, B(x) — co 2 , g(x) = 0. 

Substituting into Eq. (16.22) (or Eqs. (16.23) and (16.24)), we find that the integral equa¬ 
tion becomes 


y(x) = x + co 2 f ( t—x)y(t)dt. 

Jo 


(16.26) 


• This integral equation, Eq. (16.26), is equivalent to the original differential equation 
plus the initial conditions. 


A check shows that each form is indeed satisfied by y (x ) — (1/co) sin cox. ■ 

Let us reconsider the linear oscillator equation (16.25) but now with the boundary con¬ 
ditions 


y(0) = 0, y(b) = 0. 

Since y'(0) is not given, we must modify the procedure. The first integration gives 


y' = -co 2 ( ydx + y'( 0). 

Jo 


(16.27) 


Integrating a second time and again using Eq. (16.21), we have 


7 » 


y = — co / (x — t)y(t) dt + y (0).r. 


(16.28) 


To eliminate the unknown y'(0), we now impose the condition y(b) = 0. This gives 


co 


f (b — t)y(t)dt = by'( 0). 
Jo 


(16.29) 
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Klx, t) 



Substituting this back into Eq. (16.28), we obtain 


}’(x) - 


-co 2 f (x- 

J o 


t)v(t)dt + co~- 
b 


(V 

J o 


t)y(t)dt. 


Now let us break the interval [0, b] into two intervals, [0, x] and [x, /;]. Since 


\{b-t)-(x-t)= t - (b - x), 
b b 


we find 


-I 


y(x) — co 1 ) ~(b — x)y(t)dt + co 2 I -(b — t)y(t)dt. 


f 


Finally, if we define a kernel (Fig. 16.1) 

K(x, t) 


I t 

-(b — x), t < x, 
b 

X 

— {b — t), t > x, 
b 


we have 


-L 


y(x) = a> 2 / K(x, t)y(t) dt. 


a homogeneous Fredholm equation of the second kind. 

Our new kernel, K(x , f). has some interesting properties. 


(16.30) 

(16.31) 

(16.32) 

(16.33) 

(16.34) 


1 . 

2 . 


3. 


It is symmetric, K (x, t ) = K{t , x). 
It is continuous, in the sense that 


jjb-x) 

b 


= T (b-t ) 

t=x b 


Its derivative with respect to t is discontinuous. As t increases through the point t = x, 
there is a discontinuity of —1 in dK(x, t)/dt. 


According to these properties in Section 9.7 we identify K(x, t ) as a Green’s function. 

1. In the transformation of a linear, second-order ODE into an integral equation, the initial 
or boundary conditions play a decisive role. If we have initial conditions (only one end 
of our interval), the differential equation transforms into a Volterra integral equation. 
For the case of the linear oscillator equation with boundary conditions (both ends 
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of our interval), the differential equation leads to a Fredholm integral equation with 
a kernel that will be a Green’s function. 

2. Note that the reverse transformation (integral equation to differential equation) is not 
always possible. There exist integral equations for which no corresponding differential 
equation is known. 


Exercises 

16 . 1.1 


16 . 1.2 


16 . 1.3 


16 . 1.4 


Starting with the ODE, integrate twice and derive the Volterra integral equation corre¬ 
sponding to 

(a) fix) - y(x) = 0; y(0 ) = 0, y'(0) = 1. 


f (x-> 
Jo 


ANS. y = I (x — t)y(t) dt + x. 

(b) fix) — y(x) = 0; y(0) = 1 , /(0) = -l. 

ANS. y = I ix — t)yit)dt — x + 1 . 

Check your results with Eq. (16.23). 

Derive a Fredholm integral equation corresponding to 

fix) — yix) — 0, y(l) = 1, y(-l) = l. 


-r 

Jo 


(a) by integrating twice, 

(b) by forming the Green’s function. 


ANS. yix) = 1 




K(x, t)yit)dt. 


Kix, t) — 


\i\-x)it+\), 

\i\-t)ix+\). 


x > t, 

X < t. 


(a) Starting with the given answers of Exercise 16.1.1, differentiate and recover the 
original ODEs and the boundary conditions. 

(b) Repeat for Exercise 16.1.2. 

The general second-order linear ODE with constant coefficients is 

fix) + a\y'ix) + ci 2 yix) — 0. 

Given the boundary conditions 


y(0) = y(l) = 0, 


integrate twice and develop the integral equation 



Kix , t)yit)dt , 
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K(x , t) = 


d 2 t(l — x) + a\(x — 1), t<x, 
ci 2 x{\ — t) + a\x, x<t. 


Note that K (x, t ) is symmetric and continuous if a\ — 0. How is this related to self¬ 
adjointness of the ODE? 

16.1.5 Verify that f x f* f(t)dtdx = j x (x — t) f(t)dt for all f(t ) (for which the integrals 
exist). 

16.1.6 Given <p(x) = x — Jq (t — x)<p(t) dt, solve this integral equation by converting it to an 
ODE (plus boundary conditions) and solving the ODE (by inspection). 

16.1.7 Show that the homogeneous Volterra equation of the second kind 

i//(x) = X f K(x,t)^r(t)dt 

Jo 

has no solution (apart from the trivial \jj — 0). 

Hint. Develop a Maclaurin expansion of i//(x). Assume i fr(x) and K(x,t) are differen¬ 
tiable with respect to x as needed. 

16.2 Integral Transforms, Generating Functions 


Analogous to differentiation, linear ODEs are solved in Chapter 9. Analogous to integra¬ 
tion, there is no general method available for solving integral equations. However, certain 
special cases may be treated with our integral transforms (Chapter 15). For convenience 
these are listed here. If 


1 C°° ■ 

i/r(x) = _ / e lxt q>(t)dt , 

v 2 jt J —Co 


1 f°° _ 

<p(x) — _ / e ,xt \jf(t)dt (Fourier). 

v 2 jt J —co 


(16.35) 


i l/(x)— I e x ’(p{t)dt , 


j py+ioo 

( p(x)= - 7 / e x, \!f(t)dt (Laplace). 

^.Tt 1 Jy — ioO 


(16.36) 


if(x) = I t x l (p(t)dt, 
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then 


If 


then 


j r-y+ioo 

(p(x)=— x~'if{t)dt (Mellin). (16.37) 

ZTtl J y—ioo 


nOO 

\//(x) — / t(p{t)J v {xt)dt, 

Jo 

poo 

<p(x)= I tijf(t)J v (xt)dt (Hankel). 

Jo 


(16.38) 


Actually the usefulness of the integral transform technique extends a bit beyond these 
four rather specialized forms. 


Example 16.2.1 Fourier Transform Solution 


Let us consider a Fredholm equation of the first kind with a kernel of the general type 
k(x — t ), 

/ OO 

k(x — t)<p(t)dt, (16.39) 

-OO 


in which <p{t) is our unknown function. Assuming that the needed transforms exist, we 
apply the Fourier convolution theorem (Section 15.5) to obtain 

/ OO 

K(co)<^{co)e~ imx dco. (16.40) 

-OO 


The functions K(co), $(&>), and F(a> ) are the Fourier transforms of k(x), (p(x), and f(x), 
respectively. Taking the Fourier transform of both sides of Eq. (16.40), by Eq. (16.35) we 
have 


Then 





f(x)e i0JX dx = 


F(a>) 

V2jt 


O(o;) = — L= 

\J2ti 


F(co) 
K(a>) ’ 


and, using the inverse Fourier transform, we have 


<P(x) = 



F(u) .-to 
K(co) 


dco. 


(16.41) 


(16.42) 


(16.43) 


For a rigorous justification of this result one can follow Morse and Feshbach (see the 
Additional Readings) (1953) across complex planes. An extension of this transformation 
solution appears as Exercise 16.2.1. ■ 
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Example 16.2.2 Generalized Abel Equation, Convolution Theorem 


The generalized Abel equation is 

r <p<t) 


/(*) = 


dt, 0 < a < 1, with 


f(x) known, 
(p{t) unknown. 


Jo (x-t) a [ (pit) unknown. 

Taking the Laplace transform of both sides of this equation, we obtain 

£{/(*)} = £ J* J^ t)a dt } = L[x~ a ]C{(pix)\, 

the last step following by the Laplace convolution theorem (Section 15.11). Then 


i/n = £{i a }C{(p(x)Y 


C{(pix)} = 


s l ~ a C{fix)} 


Dividing by s, 1 we obtain 


1 £ , , _ s~ a C{fix)} _ £{t“~ 1 }£{/ (x)} 

s ^ X (—a)! (a — 1)!(—a)! 


(16.44) 


(16.45) 


(16.46) 


(16.47) 


Combining the factorials (Eq. (8.32)) and applying the Laplace convolution theorem again, 
we discover that 


Li , W )=r w 

S 7t Jo (.X-t) 1 

Inverting with the aid of Exercise 15.11.1, we get 


(pit)dt — 


ix — t ) 1 01 


and finally, by differentiating. 


sinjra d f x fit ) 

<K*) =-/ r ' Wt 

71 dx Jo ix — t )‘ 


(16.48) 


(16.49) 


(16.50) 


Generating Functions 

Occasionally, the reader may encounter integral equations that involve generating func¬ 
tions. Suppose we have the admittedly special case 

/w °f <16 - 51) 

We notice two important features: 

1. (1 — 2 xt + x 2 ) - 1/2 generates the Legendre polynomials. 

2. [—1, 1] is the orthogonality interval for the Legendre polynomials. 

L 1 — “ does not have an inverse for 0 < a < 1. 
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If we now expand the denominator (property 1) and assume that our unknown (pit) may 
be written as a series of these same Legendre polynomials, 

/ I oo oo 

J2^nPn(t)J2 P ^ X '' dt - (16.52) 

1 n=0 r=0 

Utilizing the orthogonality of the Legendre polynomials (property 2), we obtain 

OO - 

f(x) = ^2^i Xr - (16 ' 53) 

r=0 ’ T 

We may identify the a n by differentiating n times and then setting x = 0: 

/(")(0) = n\—^——a n . (16.54) 

2 « + 1 

Hence 


<P(t) = 

n =0 

Similar results may be obtained with 
cise 7.1.6). 


2n + 1 f (n) (0) 


Pnit). 


(16.55) 


the other generating functions (compare Exer- 


• This technique of expanding in a series of special functions is always available. It is 
worth a try whenever the expansion is possible (and convenient) and the interval is 
appropriate. 


Exercises 


16.2.1 


16.2.2 


The kernel of a Fredholm equation of the second kind. 


< P(x ) = f(x)+X 



K (x, t)(p(t)dt. 


is of the form k(x — t). 2 Assuming that the required transforms exist, show that 

1 F{t)e~ ixt dt 

i p(x) = — -— 1 - -— -. 

\/2tt J- OO 1 - V2jrkK(t) 

F(t ) and K it) are the Fourier transforms of fix) and k (x ) , respectively. 

The kernel of a Volterra equation of the first kind. 


fix)— f K(x,t)(p(t)dt, 

Jo 


-This kernel and a range 0 < x < oo are the characteristics of integral equations of the Wiener-Hopf type. Details will be found 
in Chapter 8 of Morse and Feshbach (1953); see the Additional Readings. 
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has the form k(x — t ). Assuming that the required transforms exist, show that 


1 

<P(x) = — 

Ini 


ry> 
i J y—i 


y+i oo 


F(s) 


e xs ds. 


r y —zoo K(s) 

F(s ) and K is) are the Laplace transforms of fix) and k(x), respectively. 
16 . 2.3 The kernel of a Volterra equation of the second kind, 


r 

Jo 


(p(x) = f(x) + X I K(x,t)<p(t)dt 


has the form k(x — t ). Assuming that the required transforms exist, show that 

, , 1 [ y+i0 ° F(s) x 

<P(x)=— . . e ds. 

Z7TI J y—joo 


l-XK(s) 


16 . 2.4 Using the Laplace transform solution (Exercise 16.2.3), solve 


(a) (p(x ) 


=, + r 

Jo 


(t — x)(p{t) dt. 


ANS. (p)x) — sin.v. 


(b) (p(x)=x 


~f<‘~ 


x)(p(t)dt. 


16 . 2.5 

16 . 2.6 


16 . 2.7 


ANS. (p(x ) = sinh.v. 

Check your results by substituting back into the original integral equations. 

Reformulate the equations of Example 16.2.1 (Eqs. (16.39) to (16.43)), using Fourier 
cosine transforms. 


Given the Fredholm integral equation. 


£ 


e ( ' T n (p(t)dt , 


apply the Fourier convolution technique of Example 16.2.1 to solve for (pit). 
Solve Abel’s equation, 

r (pit) 

f(x) =l 0<ol<h 

by the following method: 


(a) Multiply both sides by ( z — x) a ~ [ and integrate with respect to x over the range 

0 <x<z. 

(b) Reverse the order of integration and evaluate the integral on the right-hand side 
(with respect to x) by the beta function. 
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16 . 2.8 


16 . 2.9 


16 . 2.10 


16 . 2.11 


Note. 


f: 


dx 


(z — x) 1 a (x — t) 

Given the generalized Abel equation with fix) — 1, 

<p(t) 


= 5(1 - a, a) = (-«)!(« - 1)! = — 


sunr cr 


1 = 


/ 


-dt, 


0 < a < 1 , 


(x — t)° 

solve for (pit) and verify that (pit) is a solution of the given equation. 


ANS. (pit) = 


simra 


O '—1 


7r 


A Fredholm equation of the first kind has a kernel e ^ : 

/ °° 2 

e~ (x ~ ,y (pit) dt. 

-OO 

Show that the solution is 

1 ^ /(«)(0) 

= —= V - —H„ix), 

r 2"n! 

7T—0 

in which H„ix) is an nth-order Hermite polynomial. 

Solve the integral equation 

(pit) 


f(x) 


-j: 


(1 — 2 xt + .r 2 ) 1 / 2 


dt. 


-1 < x < 1, 


for the unknown function (pit) if 
(a) fix) = x 2s , (b) fix) = x 2s+l . 


ANS. (a) (pit) = 


4s + 1 


Pls(t), (b) (pit) — 


4s + 3 


2 v T v y 2 
A Kirchhoff diffraction theory analysis of a laser leads to the integral equation 


^2s+l(0- 


vir 2 ) = y Jj Kiri,r 2 )vir l )dA. 

The unknown, n(ri), gives the geometric distribution of the radiation field over one 
mirror surface; the range of integration is over the surface of that mirror. For square 
confocal spherical mirrors the integral equation becomes 

_: v Jkb nn na 

vix 2 ,yi )=—— - / / e~ uklb)( - XlX2+yiy2) vix\,y\)dx\dy\, 

Xb J_ a J_ a 

in which b is the centerline distance between the laser mirrors. This can be put in a 
somewhat simpler form by the substitutions 


kx i *2 k Vi 2 

= -T = *’ 


and 


ka~ 


2rta~ 


b Xb 

(a) Show that the variables separate and we get two integral equations. 
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(b) Show that the new limits, ±a, may be approximated by ±oo for a mirror dimen¬ 
sion a X. 

(c) Solve the resulting integral equations. 

16.3 Neumann Series, Separable (Degenerate) 

Kernels 

Many and probably most integral equations cannot be solved by the specialized integral 
transform techniques of the preceding section. Here we develop three rather general tech¬ 
niques for solving integral equations. The first, due largely to Neumann, Liouville, and 
Volterra, develops the unknown function <p (x) as a power series in X, where A. is a given 
constant. The method is applicable whenever the series converges. 

The second method is somewhat restricted because it requires that the two variables ap¬ 
pearing in the kernel K(x, t ) be separable. However, there are two major rewards: (1) The 
relation between an integral equation and a set of simultaneous linear algebraic equations 
is shown explicitly, and (2) the method leads to eigenvalues and eigenfunctions—in close 
analogy to Section 3.5. 

Third, a technique for numerical solution of Fredholm equations of both the first and 
second kind is outlined. The problem posed by ill-conditioned matrices is emphasized. 


Neumann Series 


We solve a linear integral equation of the second kind by successive approximations; our 
integral equation is the Fredholm equation, 

q>(x) — f(x) + X f K(x,t)(p(t)dt, (16.56) 

Ja 

in which f(x) / 0. If the upper limit of the integral is a variable (Volterra equation), the 
following development will still hold, but with minor modifications. Let us try (there is no 
guarantee that it will work) to approximate our unknown function by 


<P (x) & <PoM = f(x). 


(16.57) 


This choice is not mandatory. If you can make a better guess, go ahead and guess. The 
choice here is equivalent to saying that the integral or the constant X is small. To improve 
this first crude approximation, we feed (po(x) back into the integral, Eq. (16.56), and get 

<P\{x) = f{x) + X f K(x,t)f(t)dt. (16.58) 

Ja 

Repeating this process of substituting the new (p n (x) back into Eq. (16.56), we develop the 
sequence 


<P2(x) — f(x) + X f K{x,h)f(t\)dti 
J a 

(*b cb 


+ A/ 


If 


K(x, h)K(ti,t 2 )f(t 2 )dt 2 dti 


(16.59) 
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and 


n 

l Pn(x) = y ^ X'ujjx), 
1=0 


(16.60) 


where 


u 0 (x) = f(x), 

(*b 

Ui(x)= I K(x,h)f(ti)dti, 


U2{x) — 


Unix) = 


f 

J a 

-fl 

IH 


(16.61) 


Kix, t\)Kit\,t 2 )fit 2 )dt 2 dt\, 


K(x,t l )K(ti,t 2 )- ■ ■ K(t n -ut n ) ■ f it n )dt n ■ ■ - dt\. 


We expect that our solution (pix) will be 


(pix) — lim (p n ix)— lim Y X'ujix), (16.62) 

n—>oo n— >oo ^^ 

1=0 

provided that our infinite series converges. We may conveniently check the convergence 
by the Cauchy ratio test. Section 5.2, noting that 

\^U n ix)\ < \k n \ ■ |/| m ax ■ l^l^ax ' \b ~ a\ n , (16.63) 

using |/| max It) represent the maximum value of | f (a ) in the interval [u, b ] and \K |max 
to represent the maximum value of \Kix,t)\ in its domain in the x, ?-plane. We have 
convergence if 


W ' Imax ' \b O| < 1. (16.64) 

Note that k | (max) | is being used as a comparison series. If it converges, our actual series 
must converge. If this condition is not satisfied, we may or may not have convergence. 
A more sensitive test is required. Of course, even if the Neumann series diverges, there 
still may be a solution obtainable by another method. 

To see what has been done with this iterative manipulation, we may find it helpful to 
rewrite the Neumann series solution, Eq. (16.59), in operator form. We start by rewriting 
Eq. (16.56) as 


cp = XK(p + /, 

where K represents the integral operator r Kix , t)[ ] dt. Solving for <p, we obtain 

<p = i\-XK)~ l f. 

Binomial expansion leads to Eq. (16.59). The convergence of the Neumann series is a 
demonstration that the inverse operator (1 — XK)~ l exists. 
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Example 16.3.1 Neumann Series Solution 

To illustrate the Neumann method, we consider the integral equation 


1 

<p(x)=x + - 

To start the Neumann series, we take 




x)(p(t)dt. 


(16.65) 


<po(x) = x. 


(16.66) 


Then 


<Pi(x)=x + - 


j: 


l/i, i, 

(r — x)t dt = x + - ( -t - 1 x 


2 V 3 


= x + -. 


-l 


Substituting <p\ (x) back into Eq. (16.65), we get 


1 If 1 1 lx 

(p 2 (x) = x + - / ( t-x)tdt+-J {t-x)-dt=x+ 


Continuing this process of substituting back into Eq. (16.65), we obtain 


n U)=x+'-- x --X 


and by induction 


<P2n(x) —X + ^(-1)* *3 *-T^(-l)- S J 3 s . 


5=1 


5 = 1 


(16.67) 


Letting n —>■ oo, we get 

(p{x)=^x + ~. (16.68) 

This solution can (and should) be checked by substituting back into the original equation, 
Eq. (16.65). ■ 


It is interesting to note that our series converged easily even though Eq. (16.64) is not 
satisfied in this particular case. Actually Eq. (16.64) is a rather crude upper bound on k. 
It can be shown that a necessary and sufficient condition for the convergence of our series 
solution is that |A.| < \X e \, where X e is the eigenvalue of smallest magnitude of the cor¬ 
responding homogeneous equation [/(.r) = 0)]. For this particular example X e = V3/2. 
Clearly, X = ^ < X e = V3/2. 

One approach to the calculation of time-dependent perturbations in quantum mechanics 
starts with the integral equation for the evolution operator 

U(t,to) — l —- [ V(t\)U{t\,to)dt\. (16.69a) 

h Jto 

Iteration leads to 

V(ti)dt\ + J' J' V{t\)V{t2)dt2dt\-\ -. (16.69b) 


U{t,t 0 )=\- 1 - [ 
h Jto 
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The evolution operator is obtained as a series of multiple integrals of the perturbing poten¬ 
tial V(t), closely analogous to the Neumann series, Eq. (16.60). For V — Vo- independent 
of t , the evolution operator becomes (see Exercise 3.4.13, replace t —> A t, and construct 
U from products of T(t + At, t) as in Eq. (4.26)) 


U (t\, to) = exp 


i 

h 


(t - to) Vo 


A second and similar relationship between the Neumann series and quantum mechanics 
appears when the Schrodinger wave equation for scattering is reformulated as an integral 
equation. The first term in a Neumann series solution is the incident (unperturbed) wave. 
The second term is the first-order Born approximation, Eq. (9.203b) of Section 9.7. 

The Neumann method may also be applied to Volterra integral equations of the second 
kind, Eq. (16.4) or Eq. (16.56) with the fixed upper limit, b, replaced by a variable, x. In 
the Volterra case the Neumann series converges for all X as long as the kernel is square 
integrable. 


Separable Kernel 


The technique of replacing our integral equation by simultaneous algebraic equations may 
also be used whenever our kernel K (x, t ) is separable, in the sense that 

n 

K(x, t) = ^2 Mj(x)Nj(t), (16.70) 

7=1 

where n, the upper limit of the sum, is finite. Such kernels are sometimes called degener¬ 
ate. Our class of separable kernels includes all polynomials and many of the elementary 
transcendental functions; that is. 


cos(t — x) = cos t cos x + sin t sin x. 


(16.70a) 


If Eq. (16.70) is satisfied, substitution into the Fredholm equation of the second kind, Eq. 
(16.2), yields 


<P(x) = f(x) + X 



Nj(t)(p(t)dt, 


(16.71) 


interchanging integration and summation. Now, the integral with respect to t is a constant, 

Nj(t)<p(t)dt —cj. (16.72) 

Hence Eq. (16.71) becomes 

n 

tp(x) — f(x) + X y CjMjix). (16.73) 

7 = 1 



This gives us cp(x), our solution, once the constants c,- have been determined. Equa¬ 
tion (16.73) further tells us the form of <p(x ): f (x ), plus a linear combination of the 
x-dependent factors of the separable kernel. 
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We may find q by multiplying Eq. (16.73) by /V, (x ) and integrating to eliminate the 
x-dependence. Use of Eq. (16.72) yields 


Cj = bj + X Y/ljjC j, 
j =i 


(16.74) 


where 


/’/? /»/? 

bj — / Nj{x)f{x)dx, cijj = I Nj(x)M j(x)dx. (16.75) 

J a J a 


It is perhaps helpful to write Eq. (16.74) in matrix form, with A = (a,/): 

b = c — AAc = (1 — AA)c, 


(16.76a) 


c = (l -UA) _1 b. 


(16.76b) 


Equation (16.76a) is equivalent to a set of simultaneous linear algebraic equations 
(1 — Afln)ci — Xa\2C2 — 7.A13C3 — ■■■ — b 1 , 


— Xd2lC\ + (1 — 7.C(22)C2 — ^-fl23 c 3-= ^2. 

—A.fl 3 ici — A.fl 32 C 2 + (1 — 7 . 033)03 — • • • = £> 3 , and so on. 


(16.77) 


If our integral equation is homogeneous, [ f(x ) = 0], then h = 0. To get a solution, we set 
the determinant of the coefficients of c; equal to zero, 


|1 -T.A| =0, 


(16.78) 


exactly as in Section 3.5. The roots of Eq. (16.78) yield our eigenvalues. Substituting into 
(1 — aA)c = 0, we find the c,-, and then Eq. (16.73) gives our solution. 


Example 16.3.2 


To illustrate this technique for determining eigenvalues and eigenfunctions of the homoge¬ 
neous Fredholm equation, we consider the case 


< 


(t + x)<p(t) dt. 


(16.79) 


Here (compare with Eqs. (16.71) and (16.77)) 


M i = l, M 2 (x) — x, 

Ni(t) = t, N 2 =l. 


Equation (16.75) yields 


an = ci2 2 — 0 , a 12 = 3 , fl2t=2; b\—0 = b2- 


3 Notice the similarity to the operator form of the Neumann series. 
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Equation (16.78), our secular equation, becomes 

2X 

1 - 

3 

-21 1 


= 0 . 


Expanding, we obtain 


4X 2 


= 0 , 


2 


Substituting the eigenvalues 1 = ±\/3/2 into Eq. (16.76), we have 

C2 A 

C| ^ = ° 

Finally, with a choice of ci = 1, Eq. (16.73) gives 

V3 r- V3 

<Pi(x) — — (! + V3x), k=—, 

2 


<P 2 (x) = ~ V3x), 


Since our equation is homogeneous, the normalization of <p(x ) is arbitrary. 


(16.80) 

(16.81) 

(16.82) 

(16.83) 

(16.84) 


If the kernel is not separable in the sense of Eq. (16.70), there is still the possibility that 
it may be approximated by a kernel that is separable. Then we can get the exact solution of 
an approximate equation, an equation that approximates the original equation. The solution 
of the separable approximate kernel problem can then be checked by substituting back into 
the original, unseparable kernel problem. 


Numerical Solution 

There is extensive literature on the numerical solution of integral equations, and much of 
it concerns special techniques for certain situations. One method of fair generality is the 
replacement of the single integral equation by a set of simultaneous algebraic equations. 
And again matrix techniques are invoked. This simultaneous algebraic equation-matrix 
approach is applied here to two different cases. For the homogeneous Fredholm equation 
of the second kind this method works well. For the Fredholm equation of the first kind the 
method is a disaster. First we deal with the disaster. 

We consider the Fredholm integral equation of the first kind, 

f(x)= ( K(x,t)<p(t)dt, (16.84a) 

J a 

with fix) and K (x , t) known and (pit) unknown. The integral can be evaluated (in prin¬ 
ciple) by quadrature techniques. For maximum accuracy the Gaussian method is recom¬ 
mended (if the kernel is continuous and has continuous derivatives). The numerical quadra¬ 
ture replaces the integral by a summation, 

n 

f (Xi) = ^ A k K(xj,tk)<P(tk), 

k= l 


(16.84b) 
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with A k the quadrature coefficients. We abbreviate / (xj ) as fi,(p(t k ) as <pk, and 
A k K(xt, tk) as Bjk- In effect we are changing from a function description to a vector- 
matrix description, with the n components of the vector (/,-) defined as the values of the 
function at the n discrete points [/(x,)]. Equation (16.84b) becomes 

n 

fi = 22, B 'k<Pk, 
k=1 

a matrix equation. Inverting (Bjk), we obtain 

n 

<p(xk) = <Pk = 22 B ki * f' ’ (16.84c) 

a=i 

and Eq. (16.84a) is solved — in principle. In practice, the quadrature coefficient-kernel ma¬ 
trix is often “ill-conditioned” (with respect to inversion). This means that in the inversion 
process small (numerical) errors are multiplied by large factors. In the inversion process 
all significant figures may be lost and Eq. (16.84c) becomes numerical nonsense. 

This disaster should not be entirely unexpected. Integration is essentially a smoothing 
operation. f(x) is relatively insensitive to local variation of (pit). Conversely, (pit) may 
be exceedingly sensitive to small changes in fix). Small errors in f(x) or in B 1 are 
magnified and accuracy disappears. This same behavior shows up in attempts to invert 
Laplace transforms numerically. 

When the quadrature-matrix technique is applied to the integral equation eigenvalue 
problem, the symmetric kernel, homogeneous Fredholm equation of the second kind, 

Xcp(x)= ( K(x,t)(p(t)dt, (16.84d) 

J a 

the technique is far more successful. Replacing the integral by a set of simultaneous alge¬ 
braic equations (numerical quadrature), we have 

n 

X( Pi = 22 A k K ik(Pk, (16.84e) 

k= 1 

with (pj — <p(xi), as before. The points Xj, i — 1,2, , n, are taken to be the same (nu¬ 
merically) as tk, k = 1,2,..., n, so K,k will be symmetric. The system is symmetrized by 
multiplying by A . so that 

^■{A) l2 (Pi) = {A) /2 K ik A\ /2 ){A]/ 2 (p k ). (16.84f) 

k— I 

1/2 1/2 1/2 

Replacing A - (pi by i fa and A, Kj k Af by Sj k , we obtain 

Xf = Sf, (16.84g) 

with S symmetric (since the kernel K(x,t) was assumed symmetric). Of course, i// has 
components i fa — f(Xj). Equation (16.84g) is our matrix eigenvalue equation, Eq. (3.136). 


Whe eigenvalue A has been written on the left side, multiplying the eigenfunction, as is customary in matrix analysis (Section 
3.5). In this form A will take on a maximum value. 
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The eigenvalues are readily obtained by calling a canned eigenroutine. 5 For kernels such as 
those of Exercise 16.3.15 and using a 10-point Gauss-Legendre quadrature, the eigenrou¬ 
tine determines the largest eigenvalue to within about 0.5 percent for the cases where the 
kernel has discontinuities in its derivatives. If the derivatives are continuous, the accuracy 
is much better. 

Linz 6 has described an interesting variational refinement in the determination of /, max to 
high accuracy. The key to his method is Exercise 17.8.7. The components of the eigenfunc¬ 
tion vector are obtained from Eq. (16.84d) with <p(tk) now known and cp, — (p(xi ) generated 
as required. (The x\ are no longer tied to the 4.) 


Exercises 

16 . 3.1 


16 . 3.4 


Using the Neumann series, solve 
t(p(t)dt, 

(t — x)(p{t) dt , 


(a) <p(x) =1—2 f ' 

Jo 

(b) <p(x) = x+ I 

Jo 


(c) (p(x) — x 


-/'a- 


x)(p(t)dt. 


ANS. (a) (p(x) = e 


16 . 3.2 Solve the equation 


<P(x) = x + - 

£ . 7-1 


u: 


(t + x)q>(t)dt 


by the separable kernel method. Compare with the Neumann method solution of Section 
16.3. 


ANS. (p(x) = j(3x — 1). 


16 . 3.3 Find the eigenvalues and eigenfunctions of 

(p(x) — X 


/>- 


x)(p(t)dt. 


Find the eigenvalues and eigenfunctions of 

f>2 7T 


<p(x) = X 1 cos (x — t)<p(t) dt. 

Jo 

ANS. A.i = A .2 = —, <p(x) — Acosx + B sin.r. 


'’See W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vetterling, Numerical Recipes, 2nd ed., Cambridge, UK: Cambridge 
University Press (1992), Chapter 11, for details, references, and computer codes. The symbolic software Mathematica and Maple 
also include matrix functions for computing eigenvalues and eigenvectors. 

6 P. Linz, On the numerical computation of eigenvalues and eigenvectors of symmetric integral equations. Math. Comput. 24: 
905 (1970). 
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16 . 3.5 Find the eigenvalues and eigenfunctions of 

y(x) = k J (x — t) 2 y(t)dt. 

Hint. This problem may be treated by the separable kernel method or by a Legendre 
expansion. 

16 . 3.6 If the separable kernel technique of this section is applied to a Fredholm equation of the 
first kind (Eq. (16.1)), show that Eq. (16.76) is replaced by 

c = A“'b. 

In general the solution for the unknown (pit) is not unique. 

16 . 3.7 Solve 

i fr(x)=x+ f (1 + xt)\jr(t) dt 

Jo 

by each of the following methods: 


(a) the Neumann series technique, 

(b) the separable kernel technique, 

(c) educated guessing. 


16 . 3.8 Use the separable kernel technique to show that 

r 

i fr(x) = X / cosx sin t i/r (t) dt 

Jo 

has no solution (apart from the trivial i jr = 0). Explain this result in terms of separability 
and symmetry. 


16 . 3.9 Solve 

<p{x) = 1 + k 2 

by each of the following methods: 


f X (x- 
J 0 


t)(p(t)dt 


(a) reduction to an ODE (find the boundary conditions), 

(b) the Neumann series, 

(c) the use of Laplace transforms. 


ANS. tp(x) — cosh Ax. 


16 . 3.10 (a) In Eq. (16.69a) take V = Vq, independent of t. Without using Eq. (16.69b), show 

that Eq. (16.69a) leads directly to 


-(r -1 0 ) Vo 
n 


U (t — to) = exp 
(b) Repeat for Eq. (16.69b) without using Eq. (16.69a). 
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16 . 3.11 

16 . 3.12 

16 . 3.13 


16 . 3.14 


16 . 3.15 


Given tp(x ) = X fg (1 + xt)cp(t) dt, solve for the eigenvalues and the eigenfunctions by 
the separable kernel technique. 

Knowing the form of the solutions can be a great advantage, for the integral equation 

<p(x) = X f (1 + xt)<p(t)dt. 


assume <p(x) to have the form 1 + bx. Substitute into the integral equation. Integrate 
and solve for b and X. 


The integral equation 


■/' 


is approximated by 


(p(x)=X / Jo(axt)(p(t) dt, Jo(a) = 0, 


(p(x) — X f [l — x 2 t 2 ](p(t)dt. 

J o 


Find the minimum eigenvalue X and the corresponding eigenfunction (pit) of the ap¬ 
proximate equation. 

ANS. A min = 1.112486, <p(x) = 1 - 0.303337x 2 . 

You are given the integral equation 


<P(x) 


= i /"si 

Jo 


sin jzxttpit) dt. 


Approximate the kernel by 


K(x , t) — 4xt(l — xt ) sinjr.rr. 

Find the positive eigenvalue and the corresponding eigenfunction for the approximate 
integral equation. 

Note. For K{x,t) — sin nxt, X — 1.6334. 

ANS. X = 1.5678, (p(x) = x- 0.6955.r 2 

(A.+ = V3l -4, X- = -V3l - 4). 


The equation 

f(x)= f K(x,t)(p(t)dt 
J a 

has a degenerate kernel K(x. t ) = ^” =1 M, (x)A/(f). 

(a) Show that this integral equation has no solution unless fix) can be written as 

n 

f(x) = j2fi M i( x )’ 


i= 1 


with the fi constants. 
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(b) Show that to any solution <p(x) we may add i/r (x), provided i {r(x) is orthogonal to 
all Ni (x): 

Nj(x)\l/(x)dx = 0 for all i. 

16 . 3.16 Using numerical quadrature, convert 

r l 

(p(x) = X / Jo(axt)(p(t)dt, Jo(a) — 0, 

Jo 

to a set of simultaneous linear equations. 

(a) Find the minimum eigenvalue X. 

(b) Determine ip{x ) at discrete values of x and plot (p(x) versus x. Compare with the 
approximate eigenfunction of Exercise 16.3.13. 



ANS.(a) A min = 1.14502. 

16 . 3.17 Using numerical quadrature, convert 

< p(x) — X I sinj xxt(p{t)dt 

Jo 

to a set of simultaneous linear equations. 

(a) Find the minimum eigenvalue X. 

(b) Determine (p(x ) at discrete values of x and plot (p(x) versus x. Compare with the 
approximate eigenfunction of Exercise 16.3.14. 


ANS. (a) A min = 1.6334. 

16 . 3.18 Given a homogeneous Fredholm equation of the second kind 

X(p(x)= ( K(x,t)<p(t)dt. 

J o 

(a) Calculate the largest eigenvalue Xq. Use the 10-point Gauss-Legendre quadrature 
technique. For comparison the eigenvalues listed by Finz are given as /-exact • 

(b) Tabulate cp{xk ), where the x^ are the 10 evaluation points in [0, 1], 

(c) Tabulate the ratio 

1 

- / K(x,t)<p(t)dt for x — xk- 

^•o <P(x) J o 

This is the test of whether or not you really have a solution. 


(a) K(x,t) = e xt . 


ANS. Aexact = 1.35303. 
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I ix(2 — t), x < t, 

: 

jf (2 — x), x > t. 

ANS. Aexact = 0.24296. 

(c) K(x, t ) = \x — 1 1. 


ANS. Aexact = 0.34741. 


{ x, x <t, 

t, X > t. 


ANS. Aexact = 0.40528. 

Note. (1) The evaluation points x; of Gauss-Legendre quadrature for [—1,1] may be 
linearly transformed into [0, 1], 

*i[0,l] = £(jCi[-U] + 1 ). 

Then the weighting factors A, are reduced in proportion to the length of the interval: 

A;[0,1]=±A,[-1,1]. 

16 . 3.19 Using the matrix variational technique of Exercise 17.8.7, refine your calculation of the 
eigenvalue of Exercise 16.3.18(c) [K(x, t ) = \x — 1 1], Try a 40 x 40 matrix. 

Note. Your matrix should be symmetric so that the (unknown) eigenvectors will be or¬ 
thogonal. 

ANS. (40-point Gauss-Legendre quadrature) 0.34727. 

16.4 Hilbert-Schmidt Theory 
S ymmetrization of Kernels 

This is the development of the properties of linear integral equations (Fredholm type) with 
symmetric kernels: 

K(x, t) — K(t, x). (16.85) 

Before plunging into the theory, we note that some important nonsymmetric kernels can be 
symmetrized. If we have the equation 

<p(x) = fix) + A f K(x,t)p(t)<p(t)dt , (16.86) 

J a 

the total kernel is actually K(x, t)p(t), clearly not symmetric if K(x. t) alone is symmetric. 
However, if we multiply Eq. (16.86) by p(x) and substitute 


y/p(x)(p(x) = fix), 


(16.87) 
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we obtain 

rb 

i j/(x) = y/p(x)f(x) + X / [ K(x,t)^/p(x)p(t)]iJ/(t)dt , (16.88) 

J a 

with a symmetric total kernel K{x, 1)y/ p(x)p{t). We shall meet p(x) later as a positive 
weighting factor in this integral equation Sturm-Liouville theory. 

Orthogonal Eigenfunctions 

We now focus on the homogeneous Fredholm equation of the second kind: 

<p(x) = X f K(x,t)(p(t)dt. (16.89) 

J a 

We assume that the kernel K(x,t ) is symmetric and real. Perhaps one of the first ques¬ 
tions we might ask about the equation is: “Does it make sense?” or more precisely, “Does 
an eigenvalue X satisfying this equation exist?” With the aid of the Schwarz and Bessel 
inequalities. Chapter 10 and Courant and Hilbert (Chapter III, Section 4 — see the Addi¬ 
tional Readings) show that if K(x, t) is continuous, there is at least one such eigenvalue 
and possibly an infinite number of them. 

We show that the eigenvalues, X, are real and that the corresponding eigenfunctions, 
i pi(x ), are orthogonal. Let A.,-, Xj be two different eigenvalues and <p,(x), q>j(x) be the 
corresponding eigenfunctions. Equation (16.89) then becomes 

rb 

(Pi(x)-Xi I K(x. t)(pi(t) dt. (16.90a) 


= A, f 

J a 

r b 

(pj(x) = Xj I K(x,t)ipj{t)dt. 

J a 


(16.90b) 


If we multiply Eq. (16.90a) by Xjcpj (x) and Eq. (16.90b) by Xj(pj(x) and then integrate 
with respect to x, the two equations become 7 

rb rb rb 

Xj / (pi(x)(pj(x)dx = X,Xj / / K(x, t)<fj(t)(pj(x) dt dx, (16.91a) 

J a J a J a 

pb pb pb 

X, / (pi(x)<pj(x)dx = XiXj / / K(x,t)<pj(t)(pi(x)dt dx, (16.91b) 

J a J a J a 

Since we have demanded that K(x, t) by symmetric, Eq. (16.91b) may be rewritten as 

pb pb pb 

Xj I <pi(x)(pj(x) dx = XjXj / / K(x,t)ipi(t)(pj(x)dt dx. (16.92) 

J a J a J a 


Subtracting Eq. (16.92) from Eq. (16.91a), we obtain 

rb 


(Xj - Xi) / (pi ( x)<pj (x) dx — 0. 

J a 


(16.93) 


7 We assume that the necessary integrals exist. For an example of a simple pathological case, see Exercise 16.4.3. 



16.4 Hilbert-Schmidt Theory 1031 


This has the same form as Eq. (10.34) in the Sturm-Liouville theory. Since /., ^ Xj, 

b 

q>i(x)(pj(x) dx = 0, ij£ j, (16.94) 

proving orthogonality. Note that with a real symmetric kernel, no complex conjugates are 
involved in Eq. (16.94). For the self-adjoint or Hermitian kernel, see Exercise 16.4.1. 

If the eigenvalue Xj is degenerate, 8 the eigenfunctions for that particular eigenvalue may 
be orthogonalized by the Gram-Schmidt method (Section 10.3). Our orthogonal eigen¬ 
functions may, of course, be normalized, and we assume that this has been done. The 
result is 

<Pi ( x)<pj (x) dx — Sij. (16.95) 



To demonstrate that the X, are real, we need to admit complex conjugates. Taking the 
complex conjugate of Eq. (16.90a), we have 


<p*(x) = X* I K(x,t)<p*(t)dt, (16.96) 


provided the kernel K(x, t) is real. Now, using Eq. (16.96) instead of Eq. (16.90b), we see 
that the analysis leads to 


(A* — Xj) ( <p* ( x)(pi (x) dx — 0. 


(16.97) 


This time the integral cannot vanish (unless we have the trivial solution, (pj (x ) = 0) and 


Xf=Xi, 


(16.98) 


or Xj, our eigenvalue, is real. 

This is the third time we have passed this way, first with Hermitian matrices, then with 
Sturm-Liouville (self-adjoint) ODEs, and now with Hilbert-Schmidt integral equations. 
The correspondence between the Hermitian matrices and the self-adjoint ODEs shows up 
in physics as the two outstanding formulations of quantum mechanics — the Heisenberg 
matrix approach and the Schrodinger differential operator approach. In Section 17.8 and 
Exercise 17.7.6 we shall explore further the correspondence between the Hilbert-Schmidt 
symmetric kernel integral equations and the Sturm-Liouville self-adjoint differential equa¬ 
tions. 

The eigenfunctions of our integral equations form a complete set, 9 in the sense that any 
function g(x) that can be generated by the integral 

g(x)= f K(x,t)h(t)dt , (16.99) 


8 If more than one distinct eigenfunction corresponds to the same eigenvalue (satisfying Eq. (16.89)), that eigenvalue is said to 
be degenerate (see Chapters 3 and 4). 

^For a proof of this statement, see Courant and Hilbert (1953), Chapter III, Section 5, in the Additional Readings. 
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in which h(t) is any piecewise continuous function, can be represented by a series of 
eigenfunctions, 


g(x) = 'Y^a n ip n (x). 


(16.100) 


n= 1 


The series converges uniformly and absolutely. 

Let us extend this to the kernel K(x,t ) by asserting that 


K(x, t) — y ~^a„(p n (t). 


(16.101) 


n =1 


and a n = a n {x). Substituting into the original integral equation (Eq. (16.89)) and using the 
orthogonality integral, we obtain 


( Pi(x)=Xiai(x ). 


(16.102) 


Therefore for our homogeneous Fredholm equation of the second kind, the kernel may be 
expressed in terms of the eigenfunctions and eigenvalues by 


K(x,t) = 'jr 


n =1 


< Pn(x)<p„(t) 
kij 


(zero not an eigenvalue). 


(16.103) 


Here we have a bilinear expansion, a linear expansion in <p n (x) and linear in (p„ (r). Similar 
bilinear expansions appear in Section 9.7. It is possible that the expansion given by Eq. 
(16.101) may not exist. As an illustration of the sort of pathological behavior that may 
occur, you are invited to apply this analysis to 


cp{x) 




e x, (p{t)dt 


(compare Exercise 16.4.3). 

It should be emphasized that this Hilbert-Schmidt theory is concerned with the establish¬ 
ment of properties of the eigenvalues (real) and eigenfunctions (orthogonality, complete¬ 
ness), properties that may be of great interest and value. The Hilbert-Schmidt theory does 
not solve the homogeneous integral equation for us any more than the Sturm-Liouville 
theory of Chapter 10 solved the ODEs. The solutions of the integral equation come from 
Sections 16.2 and 16.3 (including numerical analysis). 


Nonhomogeneous Integral Equation 

We need a solution of the nonhomogeneous equation 

(p(x) — f(x) + k ( K(x,t)(p(t)dt. 

Ja 

Let us assume that the solutions of the corresponding homogeneous integral equation are 
known: 

f b 

<p n (x) = X n / K(x,t)(p n (t)dt , (16.105) 

J a 


(16.104) 
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the solution (p n (x ) corresponding to the eigenvalue X n . We expand both (p(x) and f(x) in 
terms of this set of eigenfunctions: 

oo 

<P(x) = E a n (Pn{x) (fl/i unknown), (16.106) 

n= 1 
oo 

f(x) = y ^b n (p n {x) (b n known). (16.107) 

n= 1 

Substituting into Eq. (16.104), we obtain 

oo oo pb °° 

b n <p n (x) + 7 / K(x,t)^^a n (p n (t)dt. (16.108) 

/i=i /i=t /i=t 

By interchanging the order of integration and summation, we may evaluate the integral by 
Eq. (16.105), and we get 


LXJ LXJ LXJ y •. 

^2 a n(Pn(x) = ^2b n <p n (x)+X^2 an(Pn X . (16.109) 

... 


If we multiply by q>j (x) and integrate from x — a to x = b, the orthogonality of our eigen¬ 
functions leads to 


This can be rewritten as 


th — bj + A —. 

Xi 


a; — b; 


— X 


bi. 


(16.110) 


(16.111) 


which brings us to our solution 


OO 

<p(x)=f(x)+x 

i=1 


f b 


f (t)<Pi(t) dt 

Xi-X 


<Pi(x). 


(16.112) 


Here it is assumed that the eigenfunctions <pj(x) are normalized to unity. Note that if 
f{x) = 0 there is no solution unless X = X,. This means that our homogeneous equation 
has no solution (except the trivial <p(x) — 0) unless X is an eigenvalue. A.,-. 

In the event that X for the nonhomogeneous equation (16.104) is equal to one of the 
eigenvalues X p of the homogeneous equation, our solution (Eq. (16.112)) blows up. To 
repair the damage we return to Eq. (16.110) and give the value 

a p 

cip — bp Xp - — b p -f- q p (16.113) 

X p 

special attention. Clearly, a p drops out and is no longer determined by b p , whereas b p — 0. 
This implies that / f(x)(p p (x)dx = 0; that is, fix) is orthogonal to the eigenfunction 
i p p (x ). If this is not the case, we have no solution. 
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Equation (16.111) still holds for i / p, so we multiply by q>i(x) and sum over i(i ^ p) 
to obtain 

<p(x) = f(x) + a p cp p +X P T a , -«w. (16.114) 

; = 1 k P 

i^P 

In this solution the a /; remains as an undetermined constant. 10 


Exercises 

16 . 4.1 In the Fredholm equation 


■L 


<p(x) = X / K (x, t)<p(t) dt 


the kernel K(x,t ) is self-adjoint or Hermitian: 

K ( x , t) = K*(t, x). 

Show that 


(a) the eigenfunctions are orthogonal, in the sense that 

<Pm ( x)<p n (x) dx = 0, m ± n (X m ± X n ), 

(b) the eigenvalues are real. 

16 . 4.2 Solve the integral equation 

1 f 1 

(p{x) = x + - / (t+x)cp(t)dt 

2 J-\ 

(compare Exercise 16.3.2) by the Hilbert-Schmidt method. 

Note. The application of the Hilbert-Schmidt technique here is somewhat like using 
a shotgun to kill a mosquito, especially when the equation can be solved quickly by 
expanding in Legendre polynomials. 

16 . 4.3 Solve the Fredholm integral equation 

POO 

(p{x) = k I e~ x, (p(t)dt. 

Jo 

Note. A series expansion of the kernel e~ xr would permit a separable kernel-type solu¬ 
tion (Section 16.3), except that the series is infinite. This suggests an infinite number of 
eigenvalues and eigenfunctions. If you stop with 

(p(x)=x~ 1 / 2 , X — 7T~ l ! 2 , 

l() This is like the inhomogeneous linear ODE. We may add to its solution any constant times a solution of the corresponding 
homogeneous ODE. 
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16 . 4.4 


16 . 4.5 


16 . 4.6 


you will have missed most of the solutions. Show that the normalization integrals of 
the eigenfunctions do not exist. A basic reason for this anomalous behavior is that the 
range of integration is infinite, making this a “singular” integral equation. 


Given 


y(.r) = x + X 



dt. 


(a) Determine y(x) as a Neumann series. 

(b) Find the range of X for which your Neumann series solution is convergent. Com¬ 
pare with the value obtained from 

W-I*lmax<l. 


(c) Find the eigenvalue and the eigenfunction of the corresponding homogeneous in¬ 
tegral equation. 

fd) By the separable kernel method show that the solution is 


y(x) = 


3x 

3 — X' 


(e) Find y(x) by the Hilbert-Schmidt method. 


In Exercise 16.3.4, 


K(x, t) — cos(.r — t). 
The (unnormalized) eigenfunctions are cos x and sin x. 


(a) Show that there is a function li(t) such that K(x. s), considered as a function of s 
alone, may be written as 


r2n 

K(x,s)= I K(s,t)h(t)dt. 

Jo 

(b) Show that K(x,t ) may be expanded as 


K(x,t) = J2 


n= 1 


<Pn (x)<pn(t ) 
hyi 


The integral equation <p(x) — X J Q (1 +xt)<p(t) dt has eigenvalues A.i = 0.7889 and X 2 — 
15.211 and eigenfunctions tp\ — 1 + 0.5352x and <^2 =1— 1 ,8685jc. 


(a) Show that these eigenfunctions are orthogonal over the interval [0, 1], 

(b) Normalize the eigenfunctions to unity. 

(c) Show that 


K (x, t) = 


<P\(x)(pi(t) 

k| 


V2(x)(p2(t) 

^•2 
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ANS. (b) = 0.7831 + 0.4191 a: 

<P2(x) = 1.8403 -3.4386*. 


16 . 4.7 An alternate form of the solution to the nonhomogeneous integral equation, Eq. 
(16.104), is 

^ biXt 

V(x) = Y - - ~<Pi(x). 

, A; A 

i = 1 

(a) Derive this form without using Eq. (16.112). 

(b) Show that this form and Eq. (16.112) are equivalent. 

16 . 4.8 (a) Show that the eigenfunctions of Exercise 16.3.5 are orthogonal. 

(b) Show that the eigenfunctions of Exercise 16.3.11 are orthogonal. 

Additional Readings 


Bocher, M., An Introduction to the Study of Integral Equations, Cambridge Tracts in Mathematics and Mathe¬ 
matical Physics, No. 10. New York: Hafner (1960). This is a helpful introduction to integral equations. 

Cochran, J. A., The Analysis of Linear Integral Equations. New York: McGraw-Hill (1972). This is a compre¬ 
hensive treatment of linear integral equations which is intended for applied mathematicians and mathematical 
physicists. It assumes a moderate to high level of mathematical competence on the part of the reader. 

Courant, R., and D. Hilbert, Methods of Mathematical Physics, Vol.l (English edition). New York: Interscience 
(1953). This is one of the classic works of mathematical physics. Originally published in German in 1924, 
the revised English edition is an excellent reference for a rigorous treatment of integral equations, Green’s 
functions, and a wide variety of other topics on mathematical physics. 

Golberg, M. A., ed., Solution Methods of Integral Equations. New York: Plenum Press (1979). This is a set of 
papers from a conference on integral equations. The initial chapter is excellent for up-to-date orientation and 
a wealth of references. 

Kanval, R. P, Linear Integral Equations. New York: Academic Press (1971), reprinted, Birkhauser (1996). This 
book is a detailed but readable treatment of a variety of techniques for solving linear integral equations. 

Morse, P. M., and H. Feshbach, Methods of Theoretical Physics. New York: McGraw-Hill (1953). Chapter 7 
is a particularly detailed, complete discussion of Green’s functions from the point of view of mathematical 
physics. Note, however, that Morse and Feshbach frequently choose a source of 4x8 (r — r r ) in place of our 
<5(r — i*'). Considerable attention is devoted to bounded regions. 

Muskhelishvili, N. I., Singular Integral Equations, 2nd ed., New York: Dover (1992). 

Stakgold, I., Green's Functions and Boundary Value Problems. New York: Wiley (1979). 



Chapter 17 


Calculus of Variations 


Uses of the Calculus of Variations 

We now address problems where we search for a function or curve, rather than a value of 
some variable, that makes a given quantity stationary, usually an energy or action integral. 
Because a function is varied, these problems are called variational. Variational principles, 
such as D’Alembert’s and Hamilton’s, have been developed in classical mechanics, and 
Lagrangian techniques occur in quantum mechanics and field theory, for example, Fermat’s 
principle of the shortest optical path in electrodynamics. Before plunging into this rather 
different branch of mathematical physics, let us summarize some of its uses in both physics 
and mathematics. 

1. In existing physical theories: 

a. Unification of diverse areas of physics using energy as a key concept. 

b. Convenience in analysis—Lagrange equations. Section 17.3. 

c. Elegant treatment of constraints. Section 17.7. 

2. Starting point for new, complex areas of physics and engineering. In general rela¬ 
tivity the geodesic is taken as the minimum path of a light pulse or the free-fall path 
of a particle in curved Riemannian space (see geodesics in Section 2.10). Variational 
principles appear in quantum field theory. Variational principles have been applied 
extensively in control theory. 

3. Mathematical unification. Variational analysis provides a proof of the completeness 
of the Sturm-Liouville eigenfunctions. Chapter 10, and establishes a lower bound for 
the eigenvalues. Similar results follow for the eigenvalues and eigenfunctions of the 
Hilbert-Schmidt integral equation. Section 16.4. 

4. Calculation techniques. Section 17.8. Calculation of the eigenfunctions and eigenval¬ 
ues of the Sturm-Liouville equation. Integral equation eigenfunctions and eigenvalues 
may be calculated using numerical quadrature and matrix techniques. Section 16.3. 
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17.1 A Dependent and an Independent Variable 
C oncept of Variation 

The calculus of variations involves problems in which the quantity to be minimized (or 
maximized) appears as a stationary integral, a functional, because a function y(x, a) needs 
to be determined from a class described by an infinitesimal parameter a. As the simplest 
case, let 

J= [ 2 f(v,y x ,x)dx. (17.1) 

Jxi 

Here J is the quantity that takes on a stationary value. Under the integral sign, / is a 
known function of the indicated variables x and a, as are y(x, a), y x (x, a) = 3 y(x, a)/dx, 
but the dependence of y on x (and a) is not yet known; that is, y (x) is unknown. This 
means that although the integral is from x\ to xj , the exact path of integration is not known 
(Fig. 17.1). We are to choose the path of integration through points (x \, yi) and (X 2 , yi) to 
minimize J. Strictly speaking, we determine stationary values of J: minima, maxima, or 
saddle points. In most cases of physical interest the stationary value will be a minimum. 
This problem is considerably more difficult than the corresponding problem of a function 
y (x ) in differential calculus. Indeed, there may be no solution. In differential calculus the 
minimum is determined by comparing y(x o) with y(x), where x ranges over neighboring 
points. Here we assume the existence of an optimum path, that is, an acceptable path for 
which J is stationary, and then compare J for our (unknown) optimum path with that 
obtained from neighboring paths. In Fig. 17.1 two possible paths are shown. (There are an 
infinite number of possibilities.) The difference between these two for a given x is called 
the variation of y, Sy, and is conveniently described by introducing a new function, ij(x), 
to define the arbitrary deformation of the path and a scale factor, a, to give the magnitude 
of the variation. The function rj(x) is arbitrary except for two restrictions. First, 

r]{x\) = r) (X 2 ) = 0, (17.2) 



X 


Figure 17.1 A varied path. 
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which means that all varied paths must pass through the fixed endpoints. Second, as will 
be seen shortly, r]{x) must be differentiable; that is, we may not use 


>;(.r) = 1, x — xo , 

= 0 , x^xq. 


(17.3) 


but we can choose rj(x) to have a form similar to the functions used to represent the Dirac 
delta function (Chapter 1) so that rj(x) differs from zero only over an infinitesimal region. 1 
Then, with the path described by a and r](x), 

y(x, a) = y(x, 0) + arj(x) (17.4) 


and 


8y = y(x, a) — y(x, 0) = aij(x). 


(17.5) 


Let us choose y(x,a = 0) as the unknown path that will minimize 7. Then v (x , a ) 
for nonzero a describes a neighboring path. In Eq. (17.1), 7 is now a function 2 of our 
parameter a: 

r* 2 

J(a)= f[y(x ,ce),y x (x,a),x]dx, (17.6) 

Jx\ 

and our condition for an extreme value is that 


37(a) 

da 


= 0, 


J a=0 


(17.7) 


analogous to the vanishing of the derivative dy/dx in differential calculus. 

Now, the a-dependence of the integral is contained in y(x, a) and y x (x,a) — 
(3/3 x)y(x, a). Therefore 3 


From Eq. (17.4), 


so Eq. (17.8) becomes 


37(a) 

da 


rx i 

7*i 


9/9y 9/ dy.x 

3 y da 3 y x 3a 


dx. 


dy(x, a) 
3a 

dy x (x, a) 
da 


= d(x), 

di](x) 

dx 


”M = fyv, (x) + K d J!<?l)dx 

9a J X1 \dy 3 y x dx ) 


(17.8) 


(17.9) 

(17.10) 


(17.11) 


1 Compare H. Jeffreys and B. S. Jeffreys, Methods of Mathematical Physics, 3rd ed., Cambridge, UK: Cambridge University 
Press (1966), Chapter 10, for a more complete discussion of this point. 

^Technically, J is a functional of y,y x , but a function of a depending on the functions yO^a?) and y^(x,Qf): 7[y(x,a), 
y x (x,a)]. 

3 Note that y and y* are being treated as independent variables. 
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Integrating the second term by parts to get rj(x) as a common and arbitrary nonvanishing 
factor, we obtain 



dtjjx) df 
dx 3 y x 


dx = ifx) 


df_ 

3 y x 


x 2 

X\ 



r/(x) - — dx. 

dx 3 y x 


(17.12) 


The integrated part vanishes by Eq. (17.2), and Eq. (17.11) becomes 


fX 2 


L 

_ dy dx dy x _ 


ri(x) dx — 0. 


(17.13) 


In this form a has been set equal to zero, corresponding to the solution path, and, in effect, 
is no longer part of the problem. 

Occasionally we will see Eq. (17.13) multiplied by 8a, which gives, upon using 
il(x)8a — 8y, 


rfs/ 

J X1 \3y 


d_df_ 
dx dy_ x 


8y dx — 8a 


dJ 

da 


= 8J = 0. 


Qf=0 


(17.14) 


Since r] (x ) is arbitrary, we may choose it to have the same sign as the bracketed expression 
in Eq. (17.13) whenever the latter differs from zero. Hence the integrand is always nonneg¬ 
ative. Equation (17.13), our condition for the existence of a stationary value, can then be 
satisfied only if the bracketed term itself is zero almost everywhere. The condition for our 
stationary value is thus a PDE, 4 


dl_d_df_ 

3 y dx 3 y x 


(17.15) 


known as the Euler equation, which can be expressed in various other forms. Sometimes 
solutions are missed when they are not twice differentiable, as required by Eq. (17.15). An 
example is Goldschmidt’s discontinuous solution of Section 17.2. It is clear that Eq. (17.15) 
must be satisfied for J to take on a stationary value, that is, for Eq. (17.14) to be satisfied. 
Equation (17.15) is necessary, but it is by no means sufficient. 5 Courant and Robbins (1996; 
see the Additional Readings) illustrate this very nicely by considering the distance over a 
sphere between points on the sphere, A and B, Fig. 17.2. Path (1), a great circle, is found 
from Eq. (17.15). But path (2), the remainder of the great circle through points A and B, 
also satisfies the Euler equation. Path (2) is a maximum, but only if we demand that it be 
a great circle and then only if we make less than one circuit; that is, path (2) +n complete 
revolutions is also a solution. If the path is not required to be a great circle, any deviation 
from (2) will increase the length. This is hardly the property of a local maximum, and 
that is why it is important to check the properties of solutions of Eq. (17.15) to see if they 
satisfy the physical conditions of the given problem. 


4 It is important to watch the meaning of i)/‘dx and d/dx closely. For example, if / = f[y(x), y x , x], 

df _ df | 3/ dy | df d 2 y 
dx dx dy dx dy x dx 2 

The first term on the right gives the explicit x-dependence. The second and third terms give the implicit x -dependence via y 
and y x . 

5 For a discussion of sufficiency conditions and the development of the calculus of variations as a part of mathematics, see G. M. 
Ewing, Calculus of Variations with Applications, New York: Norton (1969). Sufficiency conditions are also covered by Sagan 
(in the Additional Readings at the end of this chapter). 
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Figure 17.2 Stationary 
paths over a sphere. 


Example 17.1.1 


Optical Path Near Event Horizon of a Black Hole 


Determine the optical path in an atmosphere where the velocity of light increases in pro¬ 
portion to the height, v(y) = y/b , with b > 0 some parameter describing the light speed. 
So v — 0 at y = 0, which simulates the conditions at the surface of a black hole, called its 
event horizon, where the gravitational force is so strong that the velocity of light goes to 
zero, thus even trapping light. 

Because light takes the shortest time, the variational problem takes the form 


r> 2 

f ds f 

A t — dt — | 

1 — ~b 

Jti J 

v J 


y/dx 2 + dy 2 . . 

-- —dt — minimum. 

y 


Here v = ds/dt — y/b is the velocity of light in this environment, the y coordinate being 
the height. A look at the variational functional suggests choosing y as the independent 
variable because x does not appear in the integrand. We can bring dy outside the radical 
and change the role of x and y in J of Eq. (17.1) and the resulting Euler equation. With 
x = x(y), x' = dx/dy, we obtain 


■/ 


\! x ' 2 +1 


dy = minimum, 


and the Euler equation becomes 


dx dy dx' 

Since df/dx = 0, this can be integrated, giving 
x' 


— C i = const.. 


or 


„/2 


y\/V 2 + 1 

Separating dx and dy in this first-order ODE we find the integral 

ry C\ydy 


= ClvV 2 + !)■ 


r,, r ciyJy 
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Figure 17.3 Circular optical path in medium. 


which yields 

x + Ct= ttV 1 -C^.y 2 , or (x + C 2 ) 2 + y 2 = 

This is a circular light path with center on the x-axis along the event horizon. (See 
Fig. 17.3.) This example may be adapted to a mirage (Fata Morgana) in a desert with 
hot air near the ground and cooler air aloft (the index of refraction changes with height 
in cool versus hot air), thus changing the velocity law from v = y/b —> v$ — y/b. In this 
case, the circular light path is no longer convex with center on the x-axis, but becomes 
concave. ■ 


Alternate Forms of Euler Equations 

One other form (Exercise 17.1.1), which is often useful, is 

3/ d (f 9 -M n n71M 

7- - ~r / - it 7— = °- (17.16) 

ox dx y oy% J 

In problems in which / = f(y,y x )> that is, in which x does not appear explicitly, 
Eq. (17.16) reduces to 

d 


dx 


or 


% df \ n 

f -y x 7— \ = o, 

v 3 yx ) 

(17.17) 

3/ 

y x -= constant. 

3 y x 

(17.18) 


Example 17.1.2 Missing Dependent Variables 


Consider the variational problem / f(r)dt = minimum. Here r is absent from the inte¬ 
grand. Therefore the Euler equations become 


±v =0 ± d _l 

dt dx ’ dt dy 


d df 

— — = 0 , 
dt dz 
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with r = (x,y,z), so fy — c = const. Solving these three equations for the three unknowns 
x, y, z yields r = ci = const. Integrating this constant velocity gives r = c \t + c 2 . The 
solutions are straight lines, despite the general nature of the function /. 

A physical example illustrating this case is the propagation of light in a crystal, where 
the velocity of light depends on the (crystal) directions but not on the location in the crystal, 
because a crystal is an anisotropic homogeneous medium. The variational problem 

ds f Vt 2 

— = / - dt = minimum 

v J v(r) 

has the form of our example. Note that t need not be the time, but it parameterizes the light 
path. ■ 


Exercises 


17.1.1 


17.1.2 


17.1.3 


17.1.4 


For dy/dx = y x / 0, show the equivalence of the two forms of Euler’s equation: 

d JL_AA = o 

dx dx dy x 

and 

°f-jL(f- yx *L) = 0 . 

dy dx\ J y dy x J 

Derive Euler’s equation by expanding the integrand of 

rx 2 

J(a) = / f[y(x,a),y x (x.a),x]dx 

Jxi 

in powers of a, using a Taylor (Maclaurin) expansion with y and y x as the two variables 
(Section 5.6). 

Note. The stationary condition is dJ(oi)/da — 0, evaluated at a = 0. The terms 
quadratic in a may be useful in establishing the nature of the stationary solution (maxi¬ 
mum, minimum, or saddle point). 


Find the Euler equation corresponding to Eq. (17.15) if / = f(y xx , y x , y, x). 


ANS. 


( 3 / 


dx 2 \ 3 y x 
rj(xi) = r}(x 2 ) = 0, 

The integrand f(y, y x , x) of Eq. (17.1) has the form 

f(y, y x ,x) = /i(x, y) + f 2 (x, y)y x . 


dx \ dy x ) dy 
rjx (x\) = r] x (x 2 ) = 0. 


(a) Show that the Euler equation leads to 

d A_ d A=Q 

dy dx 

(b) What does this imply for the dependence of the integral J upon the choice of path? 
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17 . 1.5 Show that the condition that 

J = J f0cy)dx 

has a stationary value 

(a) leads to f(x, y ) independent of y and 

(b) yields no information about any x -dependence. 

We get no (continuous, differentiable) solution. To be a meaningful variational problem, 
dependence on y or higher derivatives is essential. 

Note. The situation will change when constraints are introduced (compare Exer¬ 
cise 17.7.7). 

17.2 Applications of the Euler Equation 

Example 17.2 .7 Straight Line 


Perhaps the simplest application of the Euler equation is in the determination of the shortest 
distance between two points in the Euclidean xy-plane. Since the element of distance is 



ds = [(t/x) 2 + (dy) 2 ] 1 ^ = [l + y 2 ] 1,/2 dx. 

(17.19) 

the distance J may 

be written as 



j= r y2 ds = r 2 [i+y 2 x y / 2 dx. 

Jxuyi Jxi 

(17.20) 

Comparison with Eq. (17.1) shows that 



f(y,y x ,x) = (i + y 2 ) 1/2 . 

(17.21) 

Substituting into Eq. (17.16), we obtain 



d [ 1 ] 

dx [(1 + y 2 ) 1 / 2 . 

(17.22) 

or 

1 

-, ,= C, a constant. 

(1 + y 2 ) 1/2 

(17.23) 

This is satisfied by 

y x =a, a second constant, 

(17.24) 

and 

y = ax + b. 

(17.25) 


which is the familiar equation for a straight line. The constants a and b are chosen so 
that the line passes through the two points (x \, vi) and (xy , >’ 2 ) • Hence the Euler equation 
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predicts that the shortest 6 distance between two fixed points in Euclidean space is a straight 
line. ■ 

The generalization of this in curved four-dimensional space-time leads to the important 
concept of the geodesic in general relativity (see Section 2.10). 


Example 17.2.2 Soap film 

As a second illustration (Fig. 17.4), consider two parallel coaxial wire circles to be con¬ 
nected by a surface of minimum area that is generated by revolving a curve y(x) about 
the .i'-axis. The curve is required to pass through fixed endpoints (x\ , vi) and (X 2 , )’ 2 )• The 
variational problem is to choose the curve y(x) so that the area of the resulting surface will 
be a minimum. 

For the element of area shown in Fig. 17.4, 

dA — 2ityds = 27ry(l + y^) l '~ dx. (17.26) 

The variational equation is then 

lTty(\ +yl) l/2 dx. (17.27) 


X ) = y(l+y^\ (17.28) 



Neglecting the 2n, we obtain 

f(y,y x . 


y 



Figure 17.4 Surface of rotation — soap film 
problem. 


^Technically, we have a stationary value. From the or terms it can be identified as a minimum (Exercise 17.2.2). 
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Since df/dx = 0, we may apply Eq. (17.18) directly and get 

y( i+ y *) 1 ' 2 ~ yy* (1+ ^ ( 17 - 29 > 


or 


y 

(i + x?) 1/2 Cl ' 

(17.30) 

Squaring, we get 


y 2 

, 2 = C 'T Wlth C 1 - >mi.u 

(17.31) 

and 


, ,_i dx ci 

(Tt) = , = ,- 

dy Jy^c\ 

(17.32) 

This may be integrated to give 


x = ci cosh -1 A + 0 . 

Cl 

(17.33) 

Solving for y, we have 



y = cicosh^-—— V (17.34) 


and again cj and cn are determined by requiring the hyperbolic cosine to pass through the 
points (xr, yi) and (xi, yi )• Our “minimum”-area surface is a special case of a catenary of 
revolution, or a catenoid. ■ 


Soap Film — Minimum Area 

This calculus of variations contains many pitfalls for the unwary. (Remember, the Euler 
equation is a necessary condition assuming a differentiable solution. The sufficiency con¬ 
ditions are quite involved. See the Additional Readings for details.) Respect for some of 
these hazards may be developed by considering a specific physical problem, for example, 
a minimum-area problem with (xi,yi) = (—xo, 1), (x' 2 , >’ 2 ) = (+xo, 1). The minimum sur¬ 
face is a soap film stretched between the two rings of unit radius at x = ±xq. The problem 
is to predict the curve y(x) assumed by the soap film. 

By referring to Eq. (17.34), we find that C 2 = 0 by the symmetry of the problem about 
x = 0. Then 

y = cicosh^—cicosh^—^ = 1. (17.34a) 

If we take x'o = \ we obtain a transcendental equation for ci, viz. 

1 = cicosh^^-^. (17.35) 



17.2 Applications of the Euler Equation 


1047 


We find that this equation has two solutions: ci = 0.2350, leading to a “deep” curve, and 
ci = 0.8483, leading to a “flat” curve. Which curve is assumed by the soap film? Before 
answering this question, consider the physical situation with the rings moved apart so that 
xq = 1. Then Eq. (17.34a) becomes 

1 = Ci cosh^-|-J, (17.36) 

which has no real solutions. The physical significance is that as the unit-radius rings were 
moved out from the origin, a point was reached at which the soap film could no longer 
maintain the same horizontal force over each vertical section. Stable equilibrium was no 
longer possible. The soap film broke (irreversible process) and formed a circular film over 
each ring (with a total area of 2:r — 6.2832...). This is the Goldschmidt discontinuous 
solution. 

The next question is: How large may A'o be and still give a real solution for Eq. (17.34a)? 7 
Letting c~[ l — p, Eq. (17.34a) becomes 

p = coshp.ro- (17.37) 


To find xq max we could solve for xq (as in Eq. (17.33)) and then differentiate with respect 
to p. Finally, with an eye on Fig. 17.5, dxo/dp would be set equal to zero. Alternatively, 
direct differentiation of Eq. (17.37) with respect to p yields 


1 = 


vo + p 


dx o 
dp 


sinh px o- 



Figure 1 7.5 Solutions of 
Eq. (17.34a) for unit-radius rings 
at x — ±xq. 


7 From a numerical point of view it is easier to invert the problem. Pick a value of (] and solve for aq. Equation (17.34a) becomes 
aq = ci cosh - *(l/ci). This has numerical solutions in the range 0 < ci < 1. 
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The requirement that dxo/dp vanish leads to 

1 = xo sinh px o. (17.38) 

Equations (17.37) and (17.38) may be combined to form 

pxi) = coth pxQ, (17.39) 


with the root 


px 0 = 1.1997. 

Substituting into Eq. (17.37) or (17.38), we obtain 

p= 1.810, ci =0.5524 


(17.40) 


(17.41) 


and 


*0r 


= 0.6627. 


(17.42) 


Returning to the question of the solution of Eq. (17.35) that describes the soap film, let 
us calculate the area corresponding to each solution. We have 

f x ° i n 47 x f x ° 

A — 4-jz I yh+y 2 )' dx =— / y 2 dx (by Eq. (17.30)) 

J 0 Cl Jo 

f xo ( *Y 

I ( cosh — 1 
Jo \ Cl J 


— 4ttci 


i — ) dx — ice 


/ 2v 0 3 

2v 0 " 

V ci y 

ci _ 


(17.43) 


For .ro = i, Eq. (17.35) leads to 


ci =0.2350 -> A = 6.8456, 
ci =0.8483 -* A = 5.9917, 

showing that the former can at most be only a local minimum. A more detailed investiga¬ 
tion (compare Bliss, Calculus of Variations, Chapter IV) shows that this surface is not even 
a local minimum. For xo = j, the soap film will be described by the flat curve 

y — 0.8483 cosh ( ——— V (17.44) 

\0.8483 / 

This flat or shallow catenoid (catenary of revolution) will be an absolute minimum for 
0 < Vo < 0.528. However, for 0.528 < x < 0.6627 its area is greater than that of the Gold¬ 
schmidt discontinuous solution (6.2832) and it is only a relative minimum (Fig. 17.6). 

For an excellent discussion of both the mathematical problems and experiments with 
soap films, we refer to Courant and Robbins (1996) in the Additional Readings at the end 
of the chapter. 
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Figure 1 7.6 Catenoid area (unit-radius rings at 
x — ±xo). 


Exercises 

17 . 2.1 A soap film is stretched across the space between two rings of unit radius centered at 
±xq on the x-axis and perpendicular to the x-axis. Using the solution developed in 
Section 17.2, set up the transcendental equations for the condition that x'o is such that 
the area of the curved surface of rotation equals the area of the two rings (Goldschmidt 
discontinuous solution). Solve forxo (Fig. 17.7). 

17 . 2.2 In Example 17.2.1, expand J[y(x, a)] — 7[y(x, 0)] in powers of a. The term linear in 
a leads to the Euler equation and to the straight-line solution, Eq. (17.25). Investigate 


y 



Figure 1 7.7 Surface of rotation. 
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the or term and show that the stationary value of ./, the straight-line distance, is a 

minimum. 


17 . 2.3 (a) Show that the integral 


rx 2 

J= f(y, y x ,x) dx, with / = y(x), 

Jx i 

has no extreme values. 

(b) If f(y, y x , x ) = y 2 (x), find a discontinuous solution similar to the Goldschmidt 
solution for the soap film problem. 


17 . 2.4 Fermat’s principle of optics states that a light ray will follow the path y(x ) for which 


rx 2 ,y2 

/ ' 

J xi,yi 


n(y , x) ds 


is a minimum when n is the index of refraction. For yi = y\ = 1, —x\ — xj = 1, find 
the ray path if 


(a) n — e y , (b) n = a(y — yo), y > yo- 


17.2.5 A frictionless particle moves from point A on the surface of the Earth to point B by 
sliding through a tunnel. Find the differential equation to be satisfied if the transit time 
is to be a minimum. 

Note. Assume the Earth to be nonrotating sphere of uniform density. 

ANS. (Eq. (17.15)): - ra 2 ) + r 2 (2a 2 - r 2 ) + a 2 r 2 = 0. 

r(<p = 0) = r 0 , r v (<p = 0) = 0, r(cp = <p A ) = a, r((p = <p B ) = a. 

9 2 2 r^—r 2 

Eq. (17.18): The solution of these equations is a hypocycloid, gener- 

V r Q a-—r- 

ated by a circle of radius |( a — ro) rolling inside the circle of radius a. You might like 
to show that the transit time is 


t — it 


(a 2 -rp 2 ) 1/2 
(ag ) 1 / 2 


For details see P. W. Cooper, Am. J. Phys. 34 : 68 (1966); G. Veneziano et al., ibid., pp. 
701-704. 


17 . 2.6 A ray of light follows a straight-line path in a first homogeneous medium, is refracted 
at an interface, and then follows a new straight-line path in the second medium. Use 
Fermat’s principle of optics to derive Snell’s law of refraction: 


sinPj = «2 sin 02 - 


Hint. Keep the points {x \, y\) and (X2,yi) fixed and vary xq to satisfy Fermat 
(Fig. 17.8). This is not an Euler equation problem. (The light path is not differentiable 
at A'o-) 
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17 . 2.7 A second soap film configuration for the unit-radius rings at x — ±A'o consists of a 
circular disk, radius a , in the x = 0 plane and two catenoids of revolution, one joining 
the disk and each ring. One catenoid may be described by 

V = Cl coshf — + C3 
\ci 


(a) Impose boundary conditions at a = 0 and x — xo . 

(b) Although not necessary, it is convenient to require that the catenoids form an angle 
of 120° where they join the central disk. Express this third boundary condition in 
mathematical terms. 

(c) Show that the total area of catenoids plus central disk is 


A — cj 


■ , , 2 xo , . \ , 2xo 
sinh-h 2 c 3 I H- 

Cl / Cl 


Note. Although this soap film configuration is physically realizable and stable, the area 
is larger than that of the simple catenoid for all ring separations for which both films 
exist. 


ANS. (a) 


1 = ci cosh 



a — ci coshc 3 . 


dy 

(b) — = tan 30° = sinhc 3 - 
dx 


17 . 2.8 For the soap film described in Exercise 17.2.7, find (numerically) the maximum value 
of xo- 

Note. This calls for a pocket calculator with hyperbolic functions or a table of hyperbolic 
cotangents. 


ANS. XOmax = 0.4078. 
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17 . 2.9 Find the root of px o = coth px o (Eq. (17.39)) and determine the corresponding values 
of p and xo (Eqs. (17.41) and (17.42)). Calculate your values to five significant figures. 

17 . 2.10 For the two-ring soap film problem of this section calculate and tabulate xo, p, p~ 1 , and 
A, the soap film area for px o = 0.00(0.02)1.30. 

17 . 2.11 Find the value of .to (to five significant figures) that leads to a soap film area, Eq. (17.43), 
equal to 2tc , the Goldschmidt discontinuous solution. 

ANS. vo = 0.52770. 

17 . 2.12 Find the curve of quickest descent from (0, 0) to (xo, yo) for a particle sliding under 
gravity and without friction. Show that the ratio of times taken by the particle along a 
straight line joining the two points compared to along the curve of quickest descent is 
(1 + 4/7T 2 ) 1 / 2 . 

Hint. Take y to increase downwards. Apply Eq. (17.18) to obtain y 2 = (1 — c 2 y)/c 2 y, 
where c is an integration constant. Then make the substitution y = (sin 2 (p/2)/c 2 to 
parametrize the cycloid and take (xo, vo) = {tc/ 2c 1 , 1 /c 2 ). 


17.3 Several Dependent Variables 


Our original variational problem, Eq. (17.1), may be generalized in several respects. In 
this section we consider the integrand / to be a function of several dependent vari¬ 
ables yi(x), V2(-x), \’3 (x),..., all of which depend on x, the independent variable. In Sec¬ 
tion 17.4 / again will contain only one unknown function y, but y will be a function of 
several independent variables (over which we integrate). In Section 17.5 these two gener¬ 
alizations are combined. In Section 17.7 the stationary value is restricted by one or more 
constraints. 

For more than one dependent variable, Eq. (17.1) becomes 

r*2 

J= /[yi(*),y 2 (*), ■■■,y n (x),yi x (x),y 2 x(x), ...,y nx (x),x]dx. (17.45) 

J X\ 

As in Section 17.1, we determine the extreme value of ./ by comparing neighboring 
paths. Let 

y,(x, a) — y,-(x, 0) + aiy/x), i = l,2,...,n, (17.46) 


with the iy independent of one another but subject to the restrictions discussed in Sec¬ 
tion 17.1. By differentiating Eq. (17.45) with respect to a and setting a = 0, since 
Eq. (17.7) still applies, we obtain 



dx = 0, 


(17.47) 


the subscript x denoting partial differentiation with respect to x; that is, y IX = 3y,- /dx, and 
so on. Again, each of the terms (df/dyi x )iy x is integrated by parts. The integrated part 
vanishes and Eq. (17.47) becomes 



d df 
dx dy ix 


rji dx = 0. 


(17.48) 
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Since the ?;,• are arbitrary and independent of one another, 8 each of the terms in the sum 
must vanish independently. We have 


Bf d df 
3 y; dxd(dyi/dx) 


i — 1,2 


(17.49) 


a whole set of Euler equations, each of which must be satisfied for an extreme value. 


Hamilton’s Principle 

The most important application of Eq. (17.45) occurs when the integrand / is taken to 
be a Lagrangian L. The Langrangian (for nonrelativistic systems; see Exercise 17.3.5 for 
a relativistic particle) is defined as the difference of kinetic and potential energies of a 
system: 

L = T — V. (17.50) 

Using time as an independent variable instead of x and x,(t) as the dependent variables, 
we get 

x ->■ t, yi ->• Xi (r), y ix -> i;(f); 

Xi(t) is the location and x, — dxj/dt is the velocity of particle i as a function of time. 
The equation SJ = 0 is then a mathematical statement of Hamilton’s principle of classical 
mechanics, 

rt 2 

S / L(x\, X 2 , ■ ■ ■, x„, x\, X 2 , ■ ■ ■ ,x n ; t) dt = 0. (17.51) 

Jti 

In words, Hamilton’s principle asserts that the motion of the system from time t\ to ti 
is such that the time integral of the Lagrangian L, or action, has a stationary value. The 
resulting Euler equations are usually called the Lagrangian equations of motion, 

(17.52) 

These Lagrangian equations can be derived from Newton’s equations of motion, and New¬ 
ton’s equations can be derived from Lagrange’s. The two sets of equations are equally 
“fundamental.” 

The Lagrangian formulation has advantages over the conventional Newtonian laws. 
Whereas Newton’s equations are vector equations, we see that Lagrange’s equations in¬ 
volve only scalar quantities. The coordinates x\, xi ■ ■ ■ ■ need not be any standard set of co¬ 
ordinates or lengths. They can be selected to match the conditions of the physical problem. 
The Lagrange equations are invariant with respect to the choice of coordinate system. New¬ 
ton’s equations (in component form) are not manifestly invariant. Exercise 2.5.10 shows 
what happens to F = ma resolved in spherical polar coordinates. 

8 For example, we could set r)2 = >73 = 174 = •• • = 0, eliminating all but one term of the sum. and then treat ij] exactly as in 
Section 17.1. 
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Exploiting the concept of energy, we may easily extend the Lagrangian formulation from 
mechanics to diverse fields, such as electrical networks and acoustical systems. Extensions 
to electromagnetism appear in the exercises. The result is a unity of otherwise-separate 
areas of physics. In the development of new areas, the quantization of Lagrangian particle 
mechanics provided a model for the quantization of electromagnetic fields and led to the 
gauge theory of quantum electrodynamics. 

One of the most valuable advantages of the Hamilton principle — Lagrange equation 
formulation — is the ease in seeing a relation between a symmetry and a conservation law. 
As an example, let x, = <p, an azimuthal angle. If our Lagrangian is independent of q> 
(that is, if q> is an ignorable coordinate), there are two consequences: (1) the conservation 
or invariance of a component of angular momentum and (2) from Eq. (17.52) dL/dcp — 
constant. Similarly, invariance under translation leads to conservation of linear momentum. 
Noether’s theorem is a generalization of this invariance (symmetry) — the conservation law 
relation. 


Example 17.3.1 


Moving Particle — Cartesian Coordinates 


Consider Eq. (17.50), which describes one particle with kinetic energy 

T = \mx 2 (17.53) 

and potential energy V(x), in which, as usual, the force is given by the negative gradient 
of the potential, 


From Eq. (17.52), 


F{x) = - 


d V (x) 
dx 


(17.54) 


cl d(T- 

— (mx) - 

dt dx 

which is Newton’s second law of motion. 


V) 


= mx — F(x ) = 0, 


(17.55) 


Example 17 . 3.2 Moving Particle —Circular Cylindrical Coordinates 

Now let us describe a moving particle in cylindrical coordinates of the xy-plane, that is, 
z = 0. The kinetic energy is 

T = \m(x 2 + y 2 ) = \m(p 2 + p 2 <ir), (17.56) 

and we take V — 0 for simplicity. 

The transformation of x 2 + y 2 into circular cylindrical coordinates could be carried out 
by taking x(p,q>) and y(p,tp), Eq. (2.28), and differentiating with respect to time and 
squaring. It is much easier to interpret x 2 + y 2 as v 2 and just write down the components 
of v as p(ds p /dt) = pp, and so on. (The ds p is an increment of length, p changing by dp, 
(p remaining constant. See Sections 2.1 and 2.4.) 

The Lagrangian equations yield 

— imp) — mp<p 2 = 0, — (mp 2 <p) = 0. (17.57) 

dt dt 
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The second equation is a statement of conservation of angular momentum. The first may be 
interpreted as radial acceleration 9 equated to centrifugal force. In this sense the centrifugal 
force is a real force. It is of some interest that this interpretation of centrifugal force as a 
real force is supported by the general theory of relativity. ■ 

Exercises 

17 . 3.1 (a) Develop the equations of motion corresponding to L = \m (:i 2 + y 2 ). 

(b) In what sense do your solutions minimize the integral Ldtl 
Compare the result for your solution with x = const., y = const. 

17 . 3.2 From the Lagrangian equations of motion, Eq. (17.52), show that a system in stable 
equilibrium has a minimum potential energy. 

17 . 3.3 Write out the Lagrangian equations of motion of a particle in spherical coordinates for 
potential V equal to a constant. Identify the terms corresponding to (a) centrifugal force 
and (b) Coriolis force. 

17 . 3.4 The spherical pendulum consists of a mass on a wire of length /, free to move in polar 
angle 0 and azimuth angle q> (Fig. 17.9). 

(a) Set up the Lagrangian for this physical system. 

(b) Develop the Lagrangian equations of motion. 

17 . 3.5 Show that the Lagrangian 


+■ y 

X 

Figure 17.9 Spherical 
pendulum. 

^ Here is a second method of attacking Exercise 2.4.8. 
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17 . 3.6 


17 . 3.7 


17.4 


leads to a relativistic form of Newton’s second law of motion, 

d_ ( m Q Vj ^ _ p 
dt V-y/l — v 2 /c 2 ) 

in which the force components are F, = —dV/d.Xj. 

The Lagrangian for a particle with charge q in an electromagnetic field described by 
scalar potential <p and vector potential A is 

L — \mv 2 — q<p + qA ■ v. 

Find the equation of motion of the charged particle. 

Hint. ( d/dt)Aj — dAj/dt + The dependence of the force fields E and 

B upon the potentials <p and A is developed in Section 1.13 (compare Exercise 1.13.10). 

ANS. mx, = f[E + vxB]j. 

Consider a system in which the Lagrangian is given by 

L(qi, c/i) = T ( qi,q t )-V(qi), 

where qt and q, represent sets of variables. The potential energy V is independent of 
velocity and neither T nor V has any explicit time dependence. 


(a) Show that 


(b) The constant quantity 



= 0 . 


• 9L 

Y j wr L 


defines the Hamiltonian H. Show that under the preceding assumed conditions, 
H — T + V, the total energy. 


Note. The kinetic energy T is a quadratic function of the qi. 


Several Independent Variables 


Sometimes the integrand / of Eq. (17.1) will contain one unknown function, u. that is a 
function of several independent variables, u — u (x , y, z), for the three-dimensional case, 
for example. Equation (17.1) becomes 


J = 



u x , u y , u z ,x, y, z]dx dy dz, 


(17.58) 


u x = du/dx, and so on. The variational problem is to find the function u(x, y, z) for which 
J is stationary. 


dJ 

SJ — 8a — 
da 


= 0 . 


Q !=0 


(17.59) 
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Generalizing Section 17.1, we let 

u(x, y, z, a) = u(x, y, z, 0) + arjix, y, z), (17.60) 

where u(x, y, z. a = 0) represents the (unknown) function for which Eq. (17.59) is satis¬ 
fied, whereas again r](x,y,z ) is the arbitrary deviation that describes the varied function 
u(x, y. z, a). This deviation r)(x , y, z) is required to be differentiable and to vanish at the 
endpoints. Then from Eq. (17.60), 

u x (x, y, z, a) = u x (x, y, z, 0) + ar/ x , (17.61) 


and similarly for u y and u z . 

Differentiating the integral Eq. (17.58) with respect to the parameter a and then setting 
a — 0, we obtain 


dJ 

da 


= fff( ! fr l +^-r ]x + -^-r, y + ^-r ]z '\dxdydz = 0. (17.62) 

JJJ \du du x ou y ‘ du~ ) 

Again, we integrate each of the terms ( df/duj)rn by parts. The integrated part vanishes 
at the endpoints (because the deviation i] is required to go to zero at the endpoints) and 


Iff 


df 9 3 f 9 9/ 3 9/, 

■ 7 - - -- ]v(x,y,z)dxdydz = 0. 

oil ox ou x oy oily oz oUz 


10 


(17.63) 


Since the variation z/(x. y, z) is arbitrary, the term in large parentheses is set equal to zero. 
This yields the Euler equation for (three) independent variables, 

df 3 9/ 3 3/ 9 df 


__ Zx. __ __ J — Q 

3y dx 3 u x 3 y du y dz du z 


(17.64) 


Example 17.4.1 Laplace’s Equation 

An example of this sort of variational problem is provided by electrostatics. The energy of 
an electrostatic field is 

energy density = ^eE 2 , (17.65) 

in which E is the usual electrostatic force field. In terms of the static potential <p, 

energy density = ^e(V^) 2 . (17.66) 

Now let us impose the requirement that the electrostatic energy (associated with the field) 
in a given volume be a minimum. (Boundary conditions on E and <p must still be satisfied.) 
We have the volume integral 11 

J= jjf (V<p) 2 dxdydz= f f f (<P X + <P y + <pl) dx dy dz. (17.67) 


10 Recall that d/dx is a partial derivative, where y and z are held constant. But d/dx also acts on implicit ^-dependence as well 
as on explicit x-dependence. In this sense, for example, 

d (df\_ d 2 f i a 2 / , d 2 f , a 2 / , d 2 f 

dx\du x ) dxdu x 3 udu x X du 2 XX du y du x Xy du z du x XZ 
11 The subscript x indicates the x -partial derivative, not an x-component. 
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With 


f(<P, <Px,<P y , <Pz , x, y, z ) = ^ + (pj + cp 2 z , (17.68) 

the function <p replacing the u of Eq. (17.64), Euler’s equation (Eq. (17.64)) yields 

-2 (fPxx + <Pyy + <Pzz) = 0, (17.69) 

or 

V 2 <p(x,y,z) = 0, (17.70) 


which is Laplace’s equation of electrostatics. 

Closer investigation shows that this stationary value is indeed a minimum. Thus the 
demand that the field energy be minimized leads to Laplace’s PDE. ■ 


Exercises 


17 . 4.1 The Lagrangian for a vibrating string (small-amplitude vibrations) is 


L = 



— yXU 2 ) dx. 


where p is the (constant) linear mass density and r is the (constant) tension. The x- 
integration is over the length of the string. Show that application of Hamilton’s principle 
to the Lagrangian density (the integrand), now with two independent variables, leads to 
the classical wave equation 

3 2 u p 3 2 u 
dx 2 x 3 1 1 

17 . 4.2 Show that the stationary value of the total energy of the electrostatic field of Exam¬ 
ple 17.4.1 is a minimum. 

Hint. Use Eq. (17.61) and investigate the a 2 terms. 


17.5 Several Dependent and Independent Variables 

In some cases our integrand / contains more than one dependent variable and more than 
one independent variable. Consider 

/ = f[p(x,y,z), Px,P y , Pz’q(x,y,z),q x ,qy,qz,r(x,y,z),r x ,ry,r z ,x,y,z\. (17.71) 
We proceed as before with 

p(x, y, z , a) = p(x, y,z, 0) +at- (x, y, z), 

q(x, y, z, a ) = q{x, y, z, 0) + aq(x, y, z), (17.72) 

r(x, y, z, a) = r(x, y, z, 0) + at;(x, y, z), and so on. 
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Keeping in mind that £, )/, and f are independent of one another, as were the rp in Sec¬ 
tion 17.3, the same differentiation and then integration by parts leads to 


9/ 9 9/ 9 9/ 9 9/ _ 

dp dx dp x dy dp y dz dp z 


(17.73) 


with similar equations for functions q and r. Replacing p,q,r ,... with y, and x, y, z,.. ■ 
with x y , we can put Eq. (17.73) in a more compact form: 


9/ 

dyi 



i = 1 , 2 ,..., 


(17.73a) 


in which 


ya = 


9 V; 

dxj 


An application of Eq. (17.73) appears in Section 17.7. 


Relation to Physics 

The calculus of variations as developed so far provides an elegant description of a wide 
variety of physical phenomena. The physics includes classical mechanics in Section 17.3; 
relativistic mechanics. Exercise 17.3.5; electrostatics. Example 17.4.1; and electromag¬ 
netic theory in Exercise 17.5.1. The convenience should not be minimized, but at the same 
time we should be aware that in these cases the calculus of variations has only provided an 
alternate description of what was already known. The situation does change with incom¬ 
plete theories. 

• If the basic physics is not yet known, a postulated variational principle can be a useful 
starting point. 

Exercise 

17 . 5.1 The Lagrangian (per unit volume) of an electromagnetic field with a charge density p is 
given by 

C = ]- ( e 0 E 2 -—B 2 ) - pq> + px ■ A. 

2 V Mo / 

Show that Lagrange’s equations lead to two of Maxwell’s equations. (The remaining 
two are a consequence of the definition of E and B in terms of A and <p.) This Lagrange 
density comes from a scalar expression in Section 4.6. 

Hint. Take Aj, Ai, A 3 , and cp as dependent variables, x,y,z, and t as independent 
variables. E and B are given in terms of A and tp by Eq. (4.142) and Eq. (1.88). 
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17.6 Lagrangian Multipliers 


In this section the concept of a constraint is introduced. To simplify the treatment, the 
constraint appears as a simple function rather than as an integral. In this section we are 
not concerned with the calculus of variations, but in Section 17.7 the constraints, with our 
newly developed Lagrangian multipliers, are incorporated into the calculus of variations. 

Consider a function of three independent variables, fix, y, z). For the function / to be 
a maximum (or extreme), 12 


df = 0. 


(17.74) 


The necessary and sufficient condition for this is 

3f = Bf = 3f 

dx By dz 

in which 


(17.75) 


df = f-dx + f -dy + f-dz . (17.76) 

ox dy dz 

Often in physical problems the variables x,y,z are subject to constraints so that they 
are no longer all independent. It is possible, at least in principle, to use each constraint to 
eliminate one variable and to proceed with a new and smaller set of independent variables. 

The use of Lagrangian multipliers is an alternate technique that may be applied when 
this elimination of variables is inconvenient or undesirable. Let our equation of constraint 
be 


<p(x, y, z) — 0, 


(17.77) 


from which z(x, y) may be extracted if x, y are taken as the independent coordinates. 
Returning to Eq. (17.74), Eq. (17.75) no longer follows because there are now only two 
independent variables, so dz is no longer arbitrary. From the total differential d<p = 0, we 
then obtain 


and therefore 


d<P , 3 <P , ,3 <p 

- dz — —dx H- dy 

dz dx dy 


(17.78) 


3/ df 

df = — dx + —dy + X 
dx dy 


dip 3 <p 

—dx H- dx 

dx dx 


X = - 


fz 

<Pz’ 


assuming <p z — 7^ 0. Thus, we may add Eq. (17.76) and a multiple of Eq. (17.78) to 

obtain 


/df d<p 
df + Xdip — l f —h X — 


dx 


dx 


dx ■ 


— + X — 
dy dy 


dy ■ 


df d <p 

— +X — 
dz dz 


dz = 0. (17.79) 


In other words, our Lagrangian multiplier X is chosen so that 


3 / dip 

— +X— =0, 
dz dz 


(17.80) 


^Including a saddle point. 
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assuming that d(p/dz ^ 0. Equation (17.79) now becomes 


^ + X^ 

3x dx 


, 3/ 3 <P 

dx + { -—h 7 — 
dy ay 


dy = 0. 


(17.81) 


However, now c/x and dy are arbitrary and the quantities in parentheses must vanish: 


3/ dq> 3/ 3^> 

—+ 7—=0, —+7—=0. 

3x 3x dy dy 


(17.82) 


When Eqs. (17.80) and (17.82) are satisfied, df — 0 and / is an extremum. Notice that 
there are now four unknowns: x, y, z, and X. The fourth equation is, of course, the con¬ 
straint Eq. (17.77). We want only x, y, and z, so X need not be determined. For this reason 
X is sometimes called Lagrange’s undetermined multiplier. This method will fail if all 
the coefficients of X vanish at the extremum, dcp/dx, dcp/dy, dcp/dz = 0. It is then impos¬ 
sible to solve for X. 

Note that from the form of Eqs. (17.80) and (17.82), we could identify / as the function 
taking an extreme value subject to the constraint, or we could identify / as the constraint 
and as the function. 

If we have a set of constraints <pt, then Eqs. (17.80) and (17.82) become 


3/ 

dxi 


+ ^2 } -k 

k 


d(Pk 

dxi 


— 0 , 


i — 1 , 2 ,...,«, 


with a separate Lagrange multiplier X^ for each cp^. 


Example 17.6.1 particle in a box 


As an example of the use of Lagrangian multipliers, consider the quantum mechanical 
problem of a particle (mass m) in a box. The box is a rectangular parallelepiped with sides 
a, b, and c. The ground-state energy of the particle is given by 

/ 7 2 / 1 1 1 \ 

E ~ + ^ + (1? ' 83) 

We seek the shape of the box that will minimize the energy E, subject to constraint that 
the volume is constant. 


V(a,b,c) — abc = k. 

With f(a, b , c) = E(a , b , c) and cp(a, b, c ) = abc — k — 0, we obtain 

3 E 3 (p h 2 


da 


X— = - 
da 4ma 3 


+ Xbc — 0. 


Also, 


(17.84) 


(17.85) 


Am c 3 


4 7«fo 3 


+ Xac — 0, 


T Xab — 0. 



1062 Chapter 17 Calculus of Variations 


Multiplying the first of these expressions by a, the second by b, and the third by c, we 
have 


Xabc — 


h 2 

4m a 2 


h 2 h 2 

4 mb 2 4m c 2 


Therefore our solution is 


(17.86) 


a — b — c, a cube. 

Notice that X has not been determined but follows from Eq. (17.86). 


(17.87) 


Example 17.6.2 Cylindrical Nuclear Reactor 


A further example is provided by the nuclear reactor theory. Suppose a (thermal) nuclear 
reactor is to have the shape of a right circular cylinder of radius R and height H. Neutron 
diffusion theory supplies a constraint: 


<p(R,H) = 


2.4048 

R 


2 



2 

= constant . 13 


We wish to minimize the volume of the reactor vessel, 


f{R,H) = nR 2 H. 


(17.88) 


(17.89) 


Application of Eq. (17.82) leads to 


3/ , , dip „ nrr (2.4048) 2 A 

-b X — = 2nRH — 2X -=-= 0, 

dR dR R 3 

3/ $<P 2 oi 71-2 _ n 

-h A.-— it R — 2k —7 — 0 . 

dH dH H 3 


(17.90) 


By multiplying the first of these equations by R/2 and the second by //, we obtain 


or height 


2 (2.4048) 2 2t r 

7 rR-H =X -=- 


R 2 


H 2 


(17.91) 


\[2tcR 

2.4048 


1.847/?, 


(17.92) 


for the minimum-volume right-circular cylindrical reactor. 

Strictly speaking, we have found only an extremum. Its identification as a minimum 
follows from a consideration of the original equations. ■ 


i 3 2.4048 ... is the lowest root of Bessel function Jq(R) (compare Section 11.1). 
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Exercises 


17.6.1 


17.6.2 

17.6.3 

17.6.4 


The following problems are to be solved by using Lagrangian multipliers. 

The ground-state energy of a quantum particle of mass m in a pillbox (right-circular 
cylinder) is given by 

h 2 / (2.4048) 2 tt 2 \ 

2m V R 2 H 2 )' 

in which R is the radius and H is the height of the pillbox. Find the ratio of R to // that 
will minimize the energy for a fixed volume. 

Find the ratio of R (radius) to H (height) that will minimize the total surface area of a 
right-circular cylinder of fixed volume. 

The U.S. Post Office limits first class mail to Canada to a total of 36 inches, length plus 
girth. Using a Lagrange multiplier, find the maximum volume and the dimensions of a 
(rectangular parallelepiped) package subject to this constraint. 


A thermal nuclear reactor is subject to the constraint 


V (a,b.c)=^ +(L) 



a constant. 


Find the ratios of the sides of the rectangular parallelepiped reactor of minimum volume. 


ANS. a —b — c, cube. 


17.6.5 

17.6.6 

17.6.7 

17.6.8 


For a lens of focal length /, the object distance p and the image distance q are related 
by 1/p + \/q — 1//. Find the minimum object-image distance ( p + q) for fixed /. 
Assume real object and image (p and q both positive). 

You have an ellipse ( x/a) 2 + ( y/b) 2 = 1. Find the inscribed rectangle of maximum- 
area. Show that the ratio of the area of the maximum-area rectangle to the area of the 
ellipse is 2/tx — 0.6366. 

A rectangular parallelepiped is inscribed in an ellipsoid of semiaxes a, h, and c. Maxi¬ 
mize the volume of the inscribed rectangular parallelepiped. Show that the ratio of the 
maximum volume to the volume of the ellipsoid is 2/tc\ f3 ~ 0.367. 


A deformed sphere has a radius given by r — rofao + a^RiicosQ)), where ao ■ 
\o? 2 1 <3C |ofo I - From Exercise 12.5.16 the area and volume are 


1 and 


A — 4nrQOiQ 


i + 1 (™ 


5 \a 0 


V = 


4j xr, 


o „3 


i + l(™ 


5 \ao 


Terms of order a 2 have been neglected. 


(a) With the constraint that the enclosed volume be held constant, that is, V — 4nr^ /3, 
show that the bounding surface of minimum area is a sphere (ao = 1, &2 = 0). 

(b) With the constraint that the area of the bounding surface be held constant, that 
is, A = 4tt , show that the enclosed volume is a maximum when the surface is 
a sphere. 
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17 . 6.9 Find the maximum value of the directional derivative of <p(x, y, z), 

dip dip dip dip 

— = — cos a H-cos p H-cos y, 

ds dx 3v dz 


subject to the constraint 


cos 2 a + cos 2 fd + cos 2 y — 1. 


ANS. 





Note concerning the following exercises: In a quantum mechanical system there are gj 
distinct quantum states between energies Ej and E, + d E,. The problem is to describe 
how rij particles are distributed among these states subject to two constraints: 


(a) fixed number of particles, 

= /?. 

i 

(b) fixed total energy, 

y^njEj = E. 


17 . 6.10 


For identical particles obeying the Pauli exclusion principle, the probability of a given 
arrangement is 


Wfd — ]~{ 


gr- 


ndigi — «f)! 


Show that maximizing Wfd , subject to a fixed number of particles and fixed total en¬ 
ergy, leads to 

gi 

' gA.i+A.2 Ei _|_ J 

With = —Eo/kT and a 2 = 1 /kT, this yields Fermi-Dirac statistics. 

Hint. Try working with In W and using Stirling’s formula. Section 8.3. The justification 
for differentiation with respect to n, is that we are dealing here with a large number of 
particles, A«,•/«,• <£ 1. 


17 . 6.11 


For identical particles but no restriction on the number in a given state, the probability 
of a given arrangement is 


Wsf = ]~[ 

i 


C nj + gi - 1)! 
ndigi — 1 )! ' 


Show that maximizing Wbe, subject to a fixed number of particles and fixed total en¬ 
ergy, leads to 

n ' e x i +x 2 E i _ 2 ' 

With 7] = —Eo/kT and a 2 = 1 /kT, this yields Bose-Einstein statistics. 

Note. Assume that g/ '» 1. 
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17.6.12 Photons satisfy Wbe and the constraint that total energy is constant. They clearly do not 
satisfy the fixed-number constraint. Show that eliminating the fixed-number constraint 
leads to the foregoing result but with Ai = 0. 


17.7 Variation with Constraints 


As in the preceding sections, we seek the path that will make the integral 

J= f f {yi , ^ ,x j) dx j (17 - 93) 

stationary. This is the general case in which xj represents a set of independent variables 
and y; a set of dependent variables. Again, 

8J = 0. (17.94) 


Now, however, we introduce one or more constraints. This means that the y/ are no longer 
independent of each other. Not all the rjj may be varied arbitrarily, and Eqs. (17.62) 
and (17.73a) would not apply. The constraint may have the form 


<Pk(yi,Xj) = 0 , 


(17.95) 


as in Section 17.6. In this case we may multiply by a function of xj, say, A . k {xj), and 
integrate over the same range as in Eq. (17.93) to obtain 




h (X j ) <Pk ( y> , Xj ) d X j — 0 . 

J 

Then clearly 

S Jx k (xj)<pk(yi,Xj)dxj = 0 . 

Alternatively, the constraint may appear in the form of an integral 

f(pk(yi, dyt/dxj,xj)dxj = constant. 




(17.96) 


(17.97) 


(17.98) 


We may introduce any constant Lagrangian multiplier, and again Eq. (17.97) follows — 
now with A a constant. 

In either case, by adding Eqs. (17.94) and (17.97), possibly with more than one con¬ 
straint, we obtain 


<5 




J2*.m<yi.xj) 

k 


dxj — 0 . 


(17.99) 


The Lagrangian multiplier X k may depend on xj when <p(yi, xj) is given in the form of 
Eq. (17.95). 

Treating the entire integrand as a new function. 
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we obtain 


g yt. 



f + 

k 


(17.100) 


If we have N yt (i — 1,2,..., N) and m constraints (k — 1,2,... m), then N — m of 
the rji may be taken as arbitrary. For the remaining m q ,, the X may, in principle, be cho¬ 
sen so that the remaining Euler-Lagrange equations are satisfied, completely analogous 
to Eq. (17.80). The result is that our composite function g must satisfy the usual Euler- 
Lagrange equations. 


dg _ 9 dg 

dyi y-' dxj ( dyi/dxj) 


(17.101) 


with one such equation for each dependent variable y; (compare Eqs. (17.64) and (17.73)). 
These Euler equations and the equations of constraint are then solved simultaneously to 
find the function yielding a stationary value. 


Lagrangian Equations 


In the absence of constraints, Lagrange’s equations of motion (Eq. (17.52)) were found to 
be 14 

d 9L dL _ Q 

i it dq, dqi 

with t (time) the one independent variable and m ( t ) (particle positions) a set of dependent 
variables. Usually the generalized coordinates q/ are chosen to eliminate the forces of con¬ 
straint, but this is not necessary and not always desirable. In the presence of (holonomic) 
constraints, ^ = 0, Hamilton’s principle is 


J L(qj , cjj , t) + y, X k ( t)(p k (qi , t) 


dt — 0, 


(17.102) 


and the constrained Lagrangian equations of motion are 


d dL dL ^ 

— / Cli k ^-k 

dt dqi dq, ^ 


(17.103) 


Usually <p k = (pk(qi, t ), independent of the generalized velocities ij,. In this case the coef¬ 
ficient aik is given by 



(17.104) 


Then ai k X k (no summation) represents the force of the kth constraint in the q, -direction, 
appearing in Eq. (17.103) in exactly the same way as —dV/dq,. 


1 ^The symbol q is customary in classical mechanics. It serves to emphasize that the variable is not necessarily a Cartesian 
variable (and not necessarily a length). 
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Figure 17.10 
Simple pendulum. 


Example 17.7.1 Simple Pendulum 

To illustrate, consider the simple pendulum, a mass m constrained by a wire of length / to 
swing in an arc (Fig. 17.10). In the absence of the one constraint 

<p l= r-l = 0 (17.105) 

there are two generalized coordinates r and 9 (motion in vertical plane). The Lagrangian 
is 


L — T — V— ^m(r 2 + r 2 9 2 ) + mgrcosd, 


(17.106) 


taking the potential V to be zero when the pendulum is horizontal, 9 — tx/2. By 
Eq. (17.103) the equations of motion are 


d dL dL _ 
dt dr dr 


d dL dL 

-=-= 0 (a r i = 1, ag i=0), 

dt d0 dO 


(17.107) 


or 


u *2 

— (mr)—mr6 — mg cos9 — Xi, 
dt 

— ( mr 2 0 ) + mgr sind = 0. 
dt 

Substituting in the equation of constraint (r = l, r = 0), we have 

mlO 2 + mgcosO = — A.i, ml 2 0 + mgl sin0 = 0. 


(17.108) 


(17.109) 


The second equation may be solved for 9(t) to yield simple harmonic motion if the am¬ 
plitude is small (sin# ~ 9), whereas the first equation expresses the tension in the wire in 
terms of 9 and 9. 

Note that since the equation of constraint, Eq. (17.105), is in the form of Eq. (17.95), the 
Lagrange multiplier X may be (and here is) a function of t (or of 9). ■ 
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Figure 17.11 A particle 
sliding on a cylindrical 
surface. 


Example 17.7.2 Sliding off a Log 


Closely related to this is the problem of a particle sliding on a cylindrical surface. The 
object is to find the critical angle 6 C at which the particle flies off from the surface. This 
critical angle is the angle at which the radial force of constraint goes to zero (Fig. 17.11). 
We have 

L = T — V — j m(r 2 + r 2 0 2 ) — mgrcosO (17.110) 

and the one equation of constraint, 

<p l =r-l = 0. (17.111) 

Proceeding as in Example 17.7.1 with a r i = 1, 

mr — mrO 2 + mg cos 8 — X\ (0), 

mr 2 0 + 2mrrO — mgr sin$ = 0, (17.112) 

in which the constraining force '/.\ (6) is a function of the angle 0. 15 Since r = l,r = r = 0, 
Eq. (17.112) reduces to 

—mW 2 T mg cos 0 — Ai(0), (17.113a) 

ml 2 0-mgl sin 0 = 0. (17.113b) 


Differentiating Eq. (17.113a) with respect to time and remembering that 


df(0) _ df(6) d 
dt d0 

we obtain 


—2 ml0 — mg sinP = 


dX i{0) 
d0 


(17.114) 


(17.115) 


1 s Note that /, | is the radial force exerted by the cylinder on the particle. Consideration of the physical problem shows that 
/,| must depend on the angle 8. We permitted X = /,(!). Now we are replacing the time dependence by an (unknown) angular 
dependence using 9 = 8 (t). 
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Using Eq. (17.113b) to eliminate the 6 term and then integrating, we have 

X\(6) — 3mgcos6 + C. (17.116) 

Since 

7.1(0) = / ng, (17.117) 

C = -2mg. (17.118) 

The particle m will stay on the surface as long as the force of constraint is nonnegative, 
that is, as long as the surface has to push outward on the particle: 

7i(0) = 3mgcos6 — 2 mg > 0. (17.119) 

The critical angle lies where Ai(0 c ) = 0, the force of constraint going to zero. From 
Eq. (17.119), 

cos d c =\, or 6 C =48° 11' (17.120) 

from the vertical. At this angle (neglecting all friction) our particle takes off. 

It must be admitted that this result can be obtained more easily by considering a varying 
centripetal force furnished by the radial component of the gravitational force. The example 
was chosen to illustrate the use of Lagrange’s undetermined multiplier without confusing 
the reader with a complicated physical system. ■ 


Example 17.7.3 TheSchrodinger Wave Equation 


As a final illustration of a constrained minimum, let us find the Euler equations for a quan¬ 
tum mechanical problem 


S 



xjr* Or, y, z)Hxj/(x, y, z ) dx dydz = 0, 


(17.121) 


with the normalization constraint 



i jf*if dx dy dz = 1. 


(17.122) 


Equation (17.121) is a statement that the energy of the system is stationary, H being the 
quantum mechanical Hamiltonian for a particle of mass m , a differential operator. 



2m 


V(x, y, z). 


(17.123) 


Equation (17.122) is a bound-state constraint, xjj is the usual wave function, a dependent 
variable, and xjr*, its complex conjugate, is treated as a second 16 dependent variable. 

The integrand in Eq. (17.121) involves second derivatives, which can be converted to 
first derivatives by integrating by parts: 


/ 


. *d 2 xjf dx[r 

if — T dx = i/ — 
ox z ox 


f 


d\//* dx/f 
dx dx 


dx. 


(17.124) 


We assume either periodic boundary conditions (as in the Sturm-Liouville theory. 
Chapter 10) or that the volume of integration is so large that i fr and xj/* vanish rapidly 


'^Compare Section 6.1. 
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enough 17 at the boundary. Then the integrated part vanishes and Eq. (17.121) may be 
rewritten as 


'/// 


— Vi //* ■ Wx// + Vf*f 
2m 


dx dy dz — 0. 


(17.125) 


The function g of Eq. (17.100) is 
Ti 2 

g = —Vi If* ■ Vi/r + Vijr*\jr — 

2m 

h 2 

= — WZtx + + v K^z) + Vilf*ir - kf*yjr, (17.126) 

2m y 

again using the subscript x to denote d/dx. For v/ = i jr*, Eq. (17.101) becomes 
dg _ _^__^g__ ±_dg_ _ 9 9g _ Q 

3i/r* dx 3i jr* dy 3i jr* dz d\[r* 


This yields 


or 


Vi jr — 7.1 jr — 


2m 


ifXX + tyyy + ^zz ) = 0 , 


h~ 2 

-V“l/f + Vi/r = 7.i/f. 

2m 


(17.127) 


Reference to Eq. (17.123) enables us to identify X physically as the energy of the quantum 
mechanical system. With this interpretation, Eq. (17.127) is the celebrated Schrodinger 
wave equation. ■ 


This variational approach is more than just a matter of academic curiosity. It provides a 
very powerful method of obtaining approximate solutions of the wave equation (Rayleigh- 
Ritz variational method. Section 17.8). 


Exercises 

17.7.1 A particle, mass m, is on a frictionless horizontal surface. It is constrained to move so 
that 6 — cot (rotating radial arm, no friction). With the initial conditions 

t — 0, r — ro, r — 0, 

(a) find the radial positions as a function of time. 


ANS. r(t) = rocoshoit. 


(b) find the force exerted on the particle by the constraint. 

ANS. F ^ = 2 mru> — 2mrou> 2 sinhaV. 


17 For example, lim ; -->-oo 


r\j/{r) = 0. 
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17.7.2 A point mass m is moving over a flat, horizontal, frictionless plane. The mass is con¬ 
strained by a string to move radially inward at a constant rate. Using plane polar coor¬ 
dinates (p, <p), p — po — kt, 

(a) Set up the Lagrangian. 

(b) Obtain the constrained Lagrange equations. 

(c) Solve the ^-dependent Lagrange equation to obtain toil), the angular velocity. 
What is the physical significance of the constant of integration that you get from 
your “free” integration? 

(d) Using the o>(t) from part (b), solve the p-dependent (constrained) Lagrange equa¬ 
tion to obtain k(t). In other words, explain what is happening to the force of con¬ 
straint as p —> 0. 


17.7.3 A flexible cable is suspended from two fixed points. The length of the cable is fixed. 
Find the curve that will minimize the total gravitational potential energy of the cable. 

ANS. Hyperbolic cosine. 

17.7.4 A fixed volume of water is rotating in a cylinder with constant angular velocity <x>. Find 
the curve of the water surface that will minimize the total potential energy of the water 
in the combined gravitational-centrifugal force field. 

ANS. Parabola. 


17.7.5 


17.7.6 


(a) Show that for a fixed-length perimeter the figure with maximum area is a circle. 

(b) Show that for a fixed area the curve with minimum perimeter is a circle. 

Hint. The radius of curvature R is given by 

(r 2 + r|) 3 / 2 
rroo - 2 - r- 

Note. The problems of this section, variation subject to constraints, are often called 
isoperimetric. The term arose from problems of maximizing area subject to a fixed 
perimeter — as in Exercise 17.7.5(a). 


Show that requiring /, given by 


rt> 

J = / [p(x)y 2 -q(x)y 2 ]dx, 
Ja 


to have a stationary value subject to the normalizing condition 

f*b 


j 

J a 


y z w(x) dx = 1 


leads to the Sturm-Liouville equation of Chapter 10: 


-H P-f- ) + qy + kwy = 0. 
dx \ dx 


Note. The boundary condition 


pyxy 


— 0 


is used in Section 10.1 in establishing the Hermitian property of the operator. 
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17.7.7 Show that requiring /, given by 


n b 

- 


K(x, t)q>(x)(p{t)dx dt, 

to have a stationary value subject to the normalizing condition 

r b 


f 


(p z (x) dx = 1 


leads to the Hilbert-Schmidt integral equation, Eq. (16.89). 
Note. The kernel K{x,t) is symmetric. 


17.8 Rayleigh-Ritz Variational Technique 


Exercise 17.7.6 opens up a relation between the calculus of variations and eigenfunction- 
eigenvalue problems. We may rewrite the expression of Exercise 17.7.6 as 


E[v(x)] 


fa (pyx ~ qy 2 )dx 

fay 2wdx 


(17.128) 


in which the constraint appears in the denominator as a normalizing condition. After the 
unconstrained minimum of F has been found, y can be normalized without changing the 
stationary value of F because stationary values of ./ correspond to stationary values of F. 
Then from Exercise 17.7.6, when y (x ) is such that J and F take on a stationary value, the 
optimum function y(x) satisfies the Sturm-Liouville equation 


d 

dx 



+ qy + Xwy — 0, 


(17.129) 


with X the eigenvalue (not a Lagrangian multiplier). Integrating the first term in the numer¬ 
ator of Eq. (17.128) by parts and using the boundary condition. 


py x y 



(17.130) 


we obtain 



(17.131) 


Then substituting in Eq. (17.129), the stationary values of F[y(x)] are given by 


= K, 


(17.132) 


with X n the eigenvalue corresponding to the eigenfunction y n . Equation (17.132) with F 
given by either Eq. (17.128) or Eq. (17.131) forms the basis of the Rayleigh-Ritz method 
for the computation of eigenfunctions and eigenvalues. 
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Ground State Eigenfunction 


Suppose that we seek to compute the ground-state eigenfunction vo and eigenvalue 18 Xq 
of some complicated atomic or nuclear system. The classical example, for which no exact 
solution exists, is the helium atom problem. The eigenfunction vo is unknown, but we shall 
assume we can make a pretty good guess at an approximate function y, so mathematically 
we may write 19 

OO 

y = yo + '^ / c i y i . (17.133) 

i =1 


The Cj are small quantities. (How small depends on how good our guess was.) The y; are 
orthonormalized eigenfunctions (also unknown), and therefore our trial function y is not 
normalized. 

Substituting the approximate function y into Eq. (17.131) and noting that 

cb 


f 


yi 


d 

dx 


P 


. d Jl 
dx 


■ qyi 


dx = — X; 8; 


(17.134) 


E[y(x)] 


^o + E”t^/ 
1 + E~t c f 


(17.135) 


Here we have taken the eigenfunctions to be orthonormal — since they are solutions of the 
Sturm-Liouville equation, Eq. (17.129). We also assume that yo is nondegenerate. Now, if 
we replace cjXi -> J2, cfx 0 + J2, cf(Xj - X 0 ) we obtain 


F[y(.x)\ — A. 0 + 


zr=icf(Xi-xo) 

! + E~t cf 


(17.136) 


Equation (17.136) contains two important results. 


• Whereas the error in the eigenfunction y was 0(cj), the error in X is only O ( cj ). Even 
a poor approximation of the eigenfunctions may yield an accurate calculation of the 
eigenvalue. 

• If Xq is the lowest eigenvalue (ground state), then since Xj — Xq > 0, 

F[y(x)]=X>X o, (17.137) 

or our approximation is always on the high side and becoming lower, converging on 
AO as our approximate eigenfunction y improves (c, —»• 0). Note that Eq. (17.137) 
is a direct consequence of Eq. (17.135). More directly, T[y(.v)] in Eq. (17.135) is 
a positively weighted average of the X and, therefore, must be no smaller than the 
smallest Xj, to wit, Aq. In practical problems in quantum mechanics, y often depends 
on parameters that may be varied to minimize F and thereby improve the estimate 
of the ground-state energy Xq. This is the “variational method” discussed in quantum 
mechanics texts. 

18 This means that Xq is the lowest eigenvalue. It is clear from Eq. (17.128) that if p(x) > 0 and q(x) < 0 (compare Table 10.1), 
then F[y(xj\ has a lower bound and this lower bound is nonnegative. Recall from Section 10.1 that w(x) > 0. 

,9 We are guessing at the form of the function. The normalization is irrelevant. 
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A vibrating string, clamped at x — 0 and 1, satisfies the eigenvalue equation 


d 2 y 
dx 2 


+ Ay = 0 


(17.138) 


and the boundary condition y(0) = y(l) = 0. For this simple example we recognize imme¬ 
diately that yo (t ) = sin ttx (unnormalized) and Ao = tt 2 . But let us try out the Rayleigh- 
Ritz technique. 

With one eye on the boundary conditions, we try 


y(x) = x(l — x). 


(17.139) 


Then with p = 1 and w = 1, Eq. (17.128) yields 


F[v(t)] = 


f Q l (l — 2x ) 2 dx 
fo x 2 (\ — x) 2 dx 


1/3 

1/30 


= 10 . 


(17.140) 


This result, A = 10, is a fairly good approximation (1.3% error) 20 of Xq — tt 2 — 9.8696. 
You may have noted that y(x), Eq. (17.139), is not normalized to unity. The denominator 
in F[ v(a )] compensates for the lack of unit normalization. F may also be calculated from 
Eq. (17.131) since Eq. (17.130) is satisfied by y from Eq. (17.139). 

In the usual scientific calculation the eigenfunction would be improved by introducing 
more terms and adjustable parameters, such as 

y = x(\ — x) + ci 2 X 2 (\ — x) 2 . (17.141) 


It is convenient to have the additional terms orthogonal, but it is not necessary. The parame¬ 
ter 02 is adjusted to minimize F[y(x)]. In this case, choosing ai = 1.1353 drives f’[y(x)] 
down to 9.8697, very close to the correct eigenvalue value. ■ 


Exercises 


17.8.1 From Eq. (17.128) develop in detail the argument when A > 0 or A < 0. Explain the 
circumstances under which A = 0, and illustrate with several examples. 


17.8.2 


An unknown function satisfies the differential equation 


/ + 



2 

y = 0 


and the boundary conditions 


y(0) = 1, y(l) = 0. 


-°The closeness of the fit may be checked by a Fourier sine expansion (compare Exercise 14.2.3 over the half-interval [0, 1] or, 
equivalently, over the interval [— 1, 1], with y(x) taken to be odd). Because of the even symmetry relative to x = 1/2, only odd 
n terms appear: 


y(x) = x(l-x) = 



sin ji x + 


sin 3 ,t.v 


+ 


sin 5 jtx 

5^ 
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(a) Calculate the approximation 


A = F [jtrial] 


for 


Atrial — 1 X 


(b) Compare with the exact eigenvalue. 


17.8.3 In Exercise 17.8.2 use a trial function 


ANS. (a) A = 2.5, (b) A/A exa ct = 1-013. 


y=\-x n . 

(a) Find the value of n that will minimize /^[ Vtrial] - 

(b) Show that the optimum value of n drives the ratio A/A ex act down to 1.003. 


ANS. (a) n = 1.7247. 


17.8.4 A quantum mechanical particle in a sphere (Example 11.7.1) satisfies 

V 2 f + k 2 f = 0, 


with k 2 — 2mE/ft 2 . The boundary condition is that i j/(r — a) = 0, where a is the radius 
of the sphere. For the ground state [where f = i//(r)] try an approximate wave function 


fa (r ) = 1 - 



2 


17.8.5 


and calculate an approximate eigenvalue kj r 

Hint. To determine p(r) and w(r), put your equation in self-adjoint form (in spherical 
polar coordinates). 


ANS. ki = 


10.5 


k 2 - — 

^exact 2 ' 


The wave equation for the quantum mechanical oscillator may be written as 


d 2 f(x ) 
dx 2 


+ (A — x 2 )f(x) = 0, 


with A = 1 for the ground state (Eq. (13.18)). Take 


V'trial — 



< a 
> a 


2 

2 


for the ground-state wave function (with a 2 an adjustable parameter) and calculate the 
corresponding ground-state energy. How much error do you have? 

Note. Your parabola is really not a very good approximation to a Gaussian exponential. 
What improvements can you suggest? 
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17.8.6 The Schrodinger equation for a central potential may be written as 

h 2 l(l+ 1) 

£■ u (r) H- ^—j—u(r) = Eu(r). 

The l (l + 1) term, the angular momentum barrier, comes from splitting off the angu¬ 
lar dependence (Section 9.3). Treating this term as a perturbation, use your variational 
technique to show that E > Eq, where Eq is the energy eigenvalue of Cu o = Eqiiq cor¬ 
responding to l = 0. This means that the minimum energy state will have / = 0, zero 
angular momentum. 

Hint. You can expand u(r ) as uo(r) + c/iq, where Cut — EjUj, £)• > Eq. 

17.8.7 In the matrix eigenvector, eigenvalue equation 

Ar i = Xj Vj , 


where X is an n x n Hermitian matrix. For simplicity, assume that its n real eigenvalues 
(Section 3.5) are distinct, X\ being the largest. If r is an approximation to iq, 

n 

r = r i +J2 8 ‘ r <’ 

i=2 


show that 


r + Ar 




and that the error in is of the order <5; | 2 . Take 15/1 <<C 1. 

Hint. The n r, form a complete orthogonal set spanning the n-dimensional (complex) 
space. 


17.8.8 The variational solution of Example 17.8.1 may be refined by taking y — x(l — x) + 
ci 2 X 2 (l — x) 2 . Using the numerical quadrature, calculate 7 a pp rox = F\y{x)], Eq. (17.128), 
for a fixed value of aj■ Vary <72 to minimize X. Calculate the value of <72 that minimizes 
X and calculate X itself, both to five significant figures. Compare your eigenvalue X 
with 7 r 2 . 


Additional Readings 


Bliss, G. A., Calculus of Variations. The Mathematical Association of America. LaSalle, IL: Open Court Pub¬ 
lishing Co. (1925). As one of the older texts, this is still a valuable reference for details of problems such as 
minimum-area problems. 

Courant, R., and H. Robbins, What Is Mathematics? 2nd ed. New York: Oxford University Press (1996). Chapter 
VII contains a fine discussion of the calculus of variations, including soap film solutions to minimum-area 
problems. 

Lanczos, C., The Variational Principles of Mechanics, 4th ed. Toronto: University of Toronto Press (1970), 
reprinted, Dover (1986). This book is a very complete treatment of variational principles and their applica¬ 
tions to the development of classical mechanics. 

Sagan, H., Boundary and Eigenvalue Problems in Mathematical Physics. New York: Wiley (1961), reprinted, 
Dover (1989). This delightful text could also be listed as a reference for Sturm-Liouville theory, Legendre and 
Bessel functions, and Fourier Series. Chapter 1 is an introduction to the calculus of variations, with applications 
to mechanics. Chapter 7 picks up the calculus of variations again and applies it to eigenvalue problems. 
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Sagan, H., Introduction to the Calculus of Variations . New York: McGraw-Hill (1969), reprinted, Dover (1983). 
This is an excellent introduction to the modem theory of the calculus of variations, which is more sophisticated 
and complete than his 1961 text. Sagan covers sufficiency conditions and relates the calculus of variations to 
problems of space technology. 

Weinstock, R., Calculus of Variations. New York: McGraw-Hill (1952); New York: Dover (1974). A detailed, 
systematic development of the calculus of variations and applications to Sturm-Liouville theory and physical 
problems in elasticity, electrostatics, and quantum mechanics. 

Yourgrau, W., and S. Mandelstam, Variational Principles in Dynamics and Quantum Theory, 3rd ed. Philadelphia: 
Saunders (1968); New York: Dover (1979). This is a comprehensive, authoritative treatment of variational 
principles. The discussions of the historical development and the many metaphysical pitfalls are of particular 
interest. 
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Chapter 18 


Nonlinear Methods 
and Chaos 


Our mind would lose itself in the complexity of the world if that complexity were not 
harmonious; like the short-sighted, it would only see the details, and would be obliged 
to forget each of these details before examining the next, because it would be incapable 
of taking in the whole. The only facts worthy of our attention are those which introduce 
order into this complexity and so make it accessible to us. 

Henri Poincare 

18.1 Introduction 

The origin of nonlinear dynamics goes back to the work of the renowned French mathe¬ 
matician Henri Poincare on celestial mechanics at the turn of the twentieth century. Clas¬ 
sical mechanics is, in general, nonlinear in its dependence on the coordinates of the par¬ 
ticles and the velocities, one example being vibrations with a nonlinear restoring force. 
The Navier-Stokes equations are nonlinear, which makes hydrodynamics difficult to han¬ 
dle. For almost four centuries however, following the lead of Galileo, Newton, and others, 
physicists have focused on predictable, effectively linear responses of classical systems, 
which usually have linear and nonlinear properties. 

Poincare was the first to understand the possibility of completely irregular, or “chaotic,” 
behavior of solutions of nonlinear differential equations that are characterized by an ex¬ 
treme sensitivity to initial conditions: Given slightly different initial conditions, from er¬ 
rors in measurements for example, solutions can grow exponentially apart with time, so 
the system soon becomes effectively unpredictable, or “chaotic.” This property of chaos, 
often called the “butterfly” effect, will be discussed in Section 18.3. Since the rediscovery 
of this effect by Lorenz in meteorology in the early 1960s, the field of nonlinear dynamics 
has grown Uemendously. Thus, nonlinear dynamics and chaos theory now have entered the 
mainstream of physics. 


1079 
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Numerous examples of nonlinear systems have been found to display irregular behavior. 
Surprisingly, order, in the sense of quantitative similarities as universal properties, or other 
regularities may arise spontaneously in chaos; a first example. Feigenbaum’s universal 
numbers a and <5 will appear in Section 18.2. Dynamical chaos is not a rare phenomenon 
but is ubiquitous in nature. It includes irregular shapes of clouds, coast lines, and other 
landscapes, which are examples of fractals, to be discussed in Section 18.3, and turbulent 
flow of fluids, water dripping from a faucet, and the weather, of course. The damped, driven 
pendulum is among the simplest systems displaying chaotic motion. 

Necessary conditions for chaotic motion in dynamical systems described by first-order 
differential equations are 

• at least three dynamical variables, and 

• one or more nonlinear terms coupling two or several of them. 

As in classical mechanics, the space of the time-dependent dynamical variables of a system 
of coupled differential equations is called its phase space. In such deterministic systems, 
trajectories in phase space are not allowed to cross. If they did, the system would have a 
choice at each intersection and would not be deterministic. In two dimensions such nonlin¬ 
ear systems allow only for fixed points. An example is a damped pendulum, whose second 
derivative, 9 — f(9, 9), can be written as two first-order derivatives, co = 9, co = /(&>, 9), 
involving just two dynamic variables, co(t) and OU). In the undamped case, there will 
only be periodic motion and equilibrium points. With three or more dynamic variables (for 
example, damped, driven pendulum, written as first-order coupled ODEs again), more 
complicated nonintersecting trajectories are possible. These include chaotic motion and 
are called deterministic chaos. 

A central theme in chaos is the evolution of complex forms from the repetition of simple 
but nonlinear operations; this is being recognized as a fundamental organizing principle 
of nature. While nonlinear differential equations are a natural place in physics for chaos to 
occur, the mathematically simpler iteration of nonlinear functions provides a quicker entry 
to chaos theory, which we will pursue first in Section 18.2. In this context, chaos already 
arises in certain nonlinear functions of a single variable. 


18.2 The Logistic Map 

The nonlinear one-dimensional iteration, or difference equation, 

x„+i — — x n ), x n e [0,1]; l< i u<4, (18.1) 

is called the logistic map. It is patterned after the nonlinear differential equation dx/dt — 
!±x (1 — %), used by P. F. Verhulst in 1845 to model the development of a breeding popula¬ 
tion whose generations do not overlap. The density of the population at time n is x„. The 
linear term simulates the birth rate and the nonlinear term the death rate of the species in a 
constant environment controlled by the parameter fi . 

The quadratic function f), (x) — /ix(\ — x) is chosen because it has one maximum in the 
interval [0,1] and is zero at the endpoints, / /x (0) = 0 = f], (I). The maximum at x m = 1/2 
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0.6 
0.5 
0.4 
t 0.3 
0.2 
0.1 
0.0 

Figure 18.1 Cycle (.to, x \,.. .) for the logistic map for /x = 2, 
starting value xo — 0.1 and attractor x* = 1 /2. 

is determined from f'{x) — 0, that is, 

f’^iXm) = /x(l - 2x m ) = 0, x m — (18.2) 

where /, t (l/2) = /i/4. 

• Varying the single parameter \x controls a rich and complex behavior, including one¬ 
dimensional chaos, as we shall see. More parameters or additional variables are hardly 
necessary at this point to increase the complexity. In a rather qualitative sense the sim¬ 
ple logistic map of Eq. (18.1) is representative of many dynamical systems in biology, 
chemistry, and physics. 

Figure (18.1) shows a plot of /^(x) — /xx( 1 — x) along with the diagonal and a series 
of points (.ro, x \,...) called a cycle. To construct a cycle for a fixed value of /x (= 2 in 
Fig. 18.1), we choose some xo € [0,1] [xo = 0.1 in Eq. (18.1)]. The vertical line through 
xo intersects the curve (x) at x\ — /^(xo) (= 0.18 in Fig. 18.1). Proceeding horizontally 
from x'i leads us to xi on the diagonal. Going vertically from the abscissa xj gives X 2 = 
fi_,(xi) on the curve (.X 2 = 0.2952 in Fig. 18.1), etc. That is, straight vertical lines show 
the intersections with the curve f fl and horizontal lines convert f IJL (x,-) = x,-+ 1 to the next 
abscissa. 

For any initial value xo with 0 < xo < 1, the x, converge toward the fixed point x*, or 
attractor [= (0.5, 0.5) in Fig. 18.1]: 

i.e., x* = 1 ——. (18.3) 

/x 

The interval (0, 1) defines a basin of attraction for the fixed point x*. The attractor x* is 
stable provided the slope \f' fl (x*)\ = |2 — fx\ < 1, or 1 < /x <3. This can be seen from a 
Taylor expansion of an iteration near the attractor: 

x n +1 = fniXn) = fn(x*) + /^(x*)(x„ - x*) H-, i.e., X ” + 1 _ = fax*), 

Xn x 
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M' 

Figure 18.2 Part of the bifurcation plot for the logistic 
map: fixed points x* versus ji. 


upon dropping all higher-order terms. Thus, if < 1, the next iterate, x n+ \, lies 

closer to x* than does x n , implying convergence to and stability of the fixed point. How¬ 
ever, if \f'{x*)\ > 1, x l1+ i moves farther from x* than does x n implying divergence and 
instability. Given the continuity of f' in ji. the fixed point and its properties persist when 
the parameter (here //) is slightly varied. 

For [x > 1 and xq < 0 or xq > 1 , it is easy to verify graphically or analytically that 
the Xi —> —oo. The origin, x = 0, is a repellent fixed point since f' jL (0) = /i > 1 and the 
iterates move away from it. Since f (I) = — /x, the point x: = 1 is a repellor for // > I. 
When 

/;(**) = /r( 1 — 2x*) = 2 —/* = —1 

is reached for fi — 3, two fixed points occur, shown as the two branches in Fig. 18.2, as // 
increases beyond the value 3. They can be located by solving 

4 = 4{4(4)) = v 2 4 (i - 4 )[ 1 - 1^4( ] - 4)] 

for x|. Here it is convenient to abbreviate f^\x) = /^(x), f {2 \x) — f4f44) for the 
second iterate, etc. Now we drop the common x* and then reduce the remaining third- 
order polynomial to second-order by recalling that a fixed point of / /x is also a fixed point 
of because 4(fn( x *)) — 4( x *) — x *- 4 ~ x * one s °l ut; i on - Factoring out the 

quadratic polynomial we obtain 

0 = /r 2 [l - (yu + l)x? + 2(x|) 2 - /x(x|) 3 ] - 1 

= (m — i — +1 - +1)^| + i j2 (4) 2 '\- 

The roots of the quadratic polynomial are 

^2 = ^(F+l±y(F + l)(M-3)), 

which are the two branches in Fig. 18.2 for /x > 3 starting at x | = 2/3. This shows that both 
fixed points bifurcate at the same value of ji. Each x* is a point of period 2 and invariant 
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under two iterations of the map f lt . The iterates oscillate between both branches of fixed 
points x|. A point x„ is defined as a periodic point of period n for f lt if / ( ">(xo) = 
xo, but f (>> (x()) / xo for 0 < i < n. Thus, for 3 < /r < 3.45 (see Fig. 18.2) the stable 
attractor bifurcates, or splits, into two fixed points x*. The bifurcation for /r = 3, where the 
doubling occurs, is called a pitchfork bifurcation because of its characteristic (rounded Y-) 
shape. A bifurcation is a sudden change in the evolution of the system, such as a splitting 
of one curve into two curves. 

As n increases beyond 3, the derivative df i2) /dx decreases from unity to —1. For // = 
1 + V6 ~ 3.44949, which can be derived from 


dfV 

dx 


= -l ,/ (2) (x*) = x*, 

X=X* 


each branch of fixed points bifurcates again, so x% — f^\x%), that is, has period 4. For 
H= 1 + \/6 these are x\ — 0.43996 and x| — 0.849938. 

With increasing period doublings it becomes impossible to obtain analytic solutions. The 
iterations are better done numerically on a programmable pocket calculator or a personal 
computer, whose rapid improvements (computer-driven graphics, in particular) and wide 
distribution since the 1970s has accelerated the development of chaos theory. The sequence 
of bifurcations continues with ever longer periods until we reach /Xoo = 3.5699456..., 
where an infinite number of bifurcations occur. Near bifurcation points, fluctuations, 
rounding errors in initial conditions, etc., play an increasing role because the system has to 
choose between two possible branches and becomes much more sensitive to small pertur¬ 
bations. In the present case the x n never repeat. The bands of fixed points x* begin forming 
a continuum (shown dark in Fig. 18.2); this is where chaos starts. This increasing period 
doubling is the route to chaos for the logistic map that is characterized by a universal con¬ 
stant 5, called a Feigenbaum number. If the first bifurcation occurs at //1 = 3, the second 
at [x 2 = 3.45,..., then the ratio of spacings between the fx n converges to S: 


lim ——=8 = 4.66920161.... 

fl n+ 1 - )X n 


(18.4) 


From the bifurcation plot in Fig. 18.2 we obtain 

fx 2 —Ml 3.45 — 3.00 
/u-3 — yu-2 3.54 — 3.45 

as a first approximation for the dimensionless 8. The corresponding critical-period-2n 
points x* lead to another universal and dimensionless quantity: 


r * _ 

lim a = 2.5029.... 

H—>-oo X*. - X* 


Again reading off Fig. 18.2’s approximate values for x* we obtain 

0.44 - 0.67 

- =33 

0.37-0.44 


(18.5) 


as a first approximation for a. 
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The Feigenbaum number 5 is universal for the route to chaos via period doublings for 
all maps with a quadratic maximum similar to the logistic map. It is an example of or¬ 
der in chaos. Experience shows that its validity is even wider, including two-dimensional 
(dissipative) systems and twice continuously differentiable functions with subharmonic bi¬ 
furcations. 1 When the maps behave like \x — x m | 1 +f; near their maximum x m for some e 
between 0 and 1, the Feigenbaum number will depend on the exponent e; thus 5(e) varies 
between 5(1) given in Eq. (18.4) for quadratic maps to 5(0) = 2 for s — 0. 2 


Exercises 

18.2.1 Show that x* = 1 is a nontrivial fixed point of the map x n +i = x„ exp|r(l — x n )] with 
a slope 1 — r, so that the equilibrium is stable if 0 < r < 2. 

18.2.2 Draw a bifurcation diagram for the exponential map of Exercise 18.2.1 for r > 1.9. 

18.2.3 Determine fixed points of the cubic map x n+ \ — ax^ + (1 — a)x n for 0 < a < 4 and 

0 < x n < 1 • 

18.2.4 Write the time-delayed logistical map x n+ \ = nx n (I — x„ _ i) as a two-dimensional map 
x n +i — nx n ( 1 — y«), y n + 1 = x„, and determine some of its fixed points. 

18.2.5 Show that the second bifurcation for the logistical map that leads to cycles of period 4 
is located at /x — 1 + V6. 

18.2.6 Construct a nonlinear iteration function with Feigenbaum 5 in the interval 2 < 5 < 
4.6692.... 

18.2.7 Determine the Feigenbaum 5 for (a) the exponential map of Exercise 18.2.1, (b) some 
cubic map of Exercise 18.2.3, (c) the time-delayed logistic map of Exercise 18.2.4. 

18.2.8 Repeat Exercise 18.2.7 for Feigenbaum’s a instead of 5. 

18.2.9 Find numerically the first four points /x for period doubling of the logistic map, and then 
obtain the first two approximations to the Feigenbaum 5. Compare with Fig. 18.2 and 
Eq. (18.4). 

18.2.10 Find numerically the values /x where the cycle of period 1, 3, 4, 5, 6 begins and then 
where it becomes unstable. 

3, /x = 3.8284, 

„ l c • , 4, /X — 3.9601, 
Check values. For period , „ 

5, /x = 3.7382, 

6, /x = 3.6265. 

18.2.11 Repeat Exercise 18.2.9 for Feigenbaum’s a. 


1 More details and computer codes for the logistic map are given by G. L. Baker and J. P. Gollub, Chaotic Dynamics: An 
Introduction , Cambridge, UK: Cambridge University Press (1990). 

2 For other maps and a discussion of the fascinating history how chaos became again a hot research topic, see D. Holton and 
R. M. May in The Nature of Chaos (T. Mullin, ed.), Oxford, UK: Clarendon Press (1993), Section 5, p. 95; and Gleick’s Chaos 
(1987) — see the Additional Readings. 
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18.3 Sensitivity to Initial Conditions and Parameters 


Lyapunov Exponents 


In Section 18.2 we described how, as we approach the period-doubling accumulation para¬ 
meter value /too = 3.5699 ... from below, the period n + 1 of cycles (.to, x\ ,..., x n ) with 
x n +\ = xq gets longer. It is also easy to check that the distances 

d n = \f (n \xo + e)- f M (x 0 )\ (18.6) 

grow as well for small e > 0. From experience with chaotic behavior we find that this 
distance increases exponentially with n —> oo; that is, cl n /e — e' n , or 

,= ll n (l/<">(». + «)-/<- ) (»o)l) | (187) 

where A is a Lyapunov exponent for the cycle. For 6->0we may rewrite Eq. (18.7) in 
terms of derivatives as 


1 

X — — In 

n 


df w (xo ) 
dx 


1 

n 


^ln|/'(x,)|, 

i=0 


using the chain rule of differentiation for df^(x)/dx, where 


df {2) (x o) 

_ dU 

dfn 

dx 

dx 

x=U{xq) dx 


X=XQ 


&(*)%(*>) 


(18.8) 


(18.9) 


and /jj = dfn/dx, etc. Our Lyapunov exponent has been calculated at the point aq, and 
Eq. (18.8) is exact for one-dimensional maps. 

As a measure of the sensitivity of the system to changes in initial conditions, one point is 
not enough to determine X in higher-dimensional dynamical systems in general, where the 
motion often is bounded, so the d n cannot go to oo. In such cases, we repeat the procedure 
for several points on the trajectory and average over them. This way, we obtain the average 
Lyapunov exponent for the sample. This average value is often called and taken as the 
Lyapunov exponent. 

The Lyapunov exponent X is a quantitative measure of chaos: A one-dimensional iterated 
function similar to the logistic map has chaotic cycles (xq, x\ , ...) for the parameter /z if 
the average Lyapunov exponent is positive for that value of /z. Any such initial point 
xq is called a strange or chaotic attractor (the shaded region in Fig. 18.2). For cycles 
of finite period, X is negative. This is the case for /z, < 3, for /z < Hoo* and even in the 
periodic window at fx ~ 3.627 inside the chaotic region of Fig. 18.2. At bifurcation points, 
X = 0. For /z > ji to the Lyapunov exponent is positive, except in the periodic windows, 
where X < 0, and X grows with /z. In other words, the system becomes more chaotic as the 
control parameter [x increases. 

In the chaos region of the logistic map there is a scaling law for the average Lyapunov 
exponent (we do not derive it), 

X( t x) = X 0 ( t i- t x oo ) ln2/lnS , ( 18 . 10 ) 
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where In 2/ In <5 ~ 0.445, S is the universal Feigenbaum number of Section 18.2, and Xq 
is a constant. This relation (18.10) is reminiscent of a physical observable at a (second- 
order) phase transition. The exponent in Eq. (18.10) is a universal number; the Lyapunov 
exponent plays the role of an order parameter, while // — Hoo is the analog of T — T c , 
where T c is the critical temperature at which the phase transition occurs. 


Fractals 


In dissipative chaotic systems (but rarely in conservative Hamiltonian systems) often new 
geometric objects with intricate shapes appear that are called fractals because of their 
noninteger dimension. Fractals are irregular geometric objects whose dimension is typi¬ 
cally not integral and that exist at many scales, so their smaller parts resemble their larger 
parts. Intuitively a fractal is a set which is (approximately) self-similar under magnifica¬ 
tion. A set of attracting points with noninteger dimension is called a strange attractor. 

We need a quantitative measure of dimensionality in order to describe fractals. Unfortu¬ 
nately, there are several definitions with usually different numerical values, none of which 
has yet become a standard. For strictly self-similar, sets, one measure suffices. More com¬ 
plicated (for instance, only approximately self-similar) sets require more measures for their 
complete description. The simplest is the box-counting dimension, due to Kolmogorov 
and Hausdorff. For a one-dimensional set, we cover the curve by line segments of length 
R. In two dimensions the boxes are squares of area R 2 , in three dimensions cubes of vol¬ 
ume R 3 , etc. Then we count the number N(R) of boxes needed to cover the set. Letting R 
go to zero we expect N to scale as N(R ) ~ R~ d . Taking the logarithm the box-counting 
dimension is defined as 


d 


1 im 

R^O 


In N(R) 
In R 


(18.11) 


For example, in a two-dimensional space a single point is covered by one square, so 
In N(R) = 0 and d — 0. A finite set of isolated points also has dimension d = 0. For a 
differentiable curve of length L, N{R) ~ L/R as R —> 0, so d = 1 from Eq. (18.11), as 
expected. 

Let us now construct a more irregular set, the Koch curve. We start with a line segment 
of unit length in Fig. 18.3 and remove the middle third. Then we replace it with two seg¬ 
ments of length 1/3, which form a triangle in Fig. 18.3. We iterate this procedure with 
each segment ad infinitum. The resulting Koch curve is infinitely long and is nowhere dif¬ 
ferentiable because of the infinitely many discontinuous changes of slope. At the nth step 
each line segment has length R n = 3~" and there are N(R n ) = 4" segments. Hence its 
dimension is d — In 4/In 3 = 1.26..., which is more than a curve but less than a surface. 
Because the Koch curve results from iteration of the first step, it is strictly self-similar. 

For the logistic map the box-counting dimension at a period-doubling accumulation 
point fi a o is 0.5388..., which is a universal number for iterations of functions in one 
variable with a quadratic maximum. To see roughly how this comes about, consider the 
pairs of line segments originating from successive bifurcation points for a given parameter 
jjL in the chaos regime (see Fig. 18.2). Imagine removing the interior space from the chaotic 
bands. When we go to the next bifurcation, the relevant scale parameter is a — 2.5029 ... 
from Eq. (18.5). Suppose we need 2" line segments of length R to cover 2" bands. In the 
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Figure 18.3 Construction of the Koch curve by 
iterations. 

next stage then we need 2" +1 segments of length R/a to cover the bands. This yields a 

dimension d = — ln(2"/2" +1 )/lna = 0.4498_This crude estimate can be improved by 

taking into account that the width between neighboring pairs of line segments differs by 

1/a (see Fig. 18.2). The improved estimate, 0.543, is closer to 0.5388_This example 

suggests that when the fractal set does not have a simple self-similar structure, then the 
box-counting dimension depends on the box-construction method. 

Finally, we turn to the beautiful fractals that are surprisingly easy to generate and 
whose color pictures had considerable impact. For complex c = a + ib, the correspond¬ 
ing quadratic complex map involving the complex variable z = x + iy , 

Zn+l=zl + C, (18.12) 

looks deceptively simple, but the equivalent two-dimensional map in terms of the real 
variables 

x n +i=xl-yl + a, y n+ \ — 2x n y n + b (18.13) 

reveals already more of its complexity. This map forms the basis for some of Mandelbrot’s 
beautiful multicolor fractal pictures (we refer the reader to Mandelbrot (1988) and Peitgen 
and Richter (1986) in the Additional Readings), and it has been found to generate rather 
intricate shapes for various c/0. For example, the Julia set of a map z n +i — F(z„) is 
defined as the set of all its repelling fixed or periodic points. Thus it forms the boundary 
between initial conditions of a two-dimensional iterated map leading to iterates that diverge 
and those that stay within some finite region of the complex plane. For the case c = 0 and 
F(z) — z 2 , the Julia set can be shown to be just a circle about the origin of the complex 
plane. Yet, just by adding a constant c/0, the Julia set becomes fractal. For instance, for 
c — — 1 one finds a fractal necklace with infinitely many loops (see Devaney (1989) in the 
Additional Readings). 

While the Julia set is drawn in the complex plane, the Mandelbrot set is constructed 
in the two-dimensional parameter space c — (a, b) = a + bi. It is constructed as follows. 
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Starting from the initial value zo — 0 = (0,0) one searches Eq. (18.12) for parameter val¬ 
ues c so that the iterated {z„} do not diverge to oo. Each color outside the fractal boundary 
of the Mandelbrot set represents a given number of iterations m, say, needed for the z n 
to go beyond a specified absolute (real) value R, \z. m \ > R > |z m -i|. For real parame¬ 
ter value c = a, the resulting map, x n+ \ — x„ + a, is equivalent to the logistic map with 
period-doubling bifurcations (see Section 18.2) as a increases on the real axis inside the 
Mandelbrot set. 


Exercises 

18 . 3.1 Use a programmable pocket calculator (or a personal computer with BASIC or FOR¬ 
TRAN or symbolic software such as Mathematica or Maple) to obtain the iterates Xj 
of an initial 0 < xq < I and f' (x,) for the logistic map. Then calculate the Lyapunov 
exponent for cycles of period 2,3,... of the logistic map for 2 < fi < 3.7. Show that 
for /i < fioc the Lyapunov exponent A, is 0 at bifurcation points and negative elsewhere, 
while for fi > fi ^ it is positive except in periodic windows. 

Hint. See Fig. 9.3 of Hilborn (1994) in the Additional Readings. 

18 . 3.2 Consider the map x n +\ = F(x n ) with 

I n + bx, x < 1, 
c + ax, x > 1, 

for b > 0 and d < 0. Show that its Lyapunov exponent is positive when b > 1, d < — 1. 
Plot a few iterations in the (x„+i, x n ) plane. 

18.4 Nonlinear Differential Equations 

In Section 18.1 we mentioned nonlinear differential equations (abbreviated as NDEs) as 
the natural place in physics for chaos to occur, but continued with the simpler iteration of 
nonlinear functions of one variable (maps). Here we briefly address the much broader area 
of NDEs and the far greater complexity in the behavior of their solutions. However, maps 
and systems of solutions of NDEs are closely related. The latter can often be analyzed in 
terms of discrete maps. One prescription is the so-called Poincare section of a system of 
NDE solutions. Placing a plane transverse into a trajectory (of a solution of a NDE), it in¬ 
tersects the plane in a series of points at increasing discrete times, for example, in Fig. 18.4 
(x(t\), yUi)) = (x\ , yi), (x 2 , >’ 2 ),..., which are recorded and graphically or numerically 
analyzed for fixed points, period-doubling bifurcations, etc. This method is useful when 
solutions of NDEs are obtained numerically in computer simulations so that one can gen¬ 
erate Poincare sections at various locations and with different orientations, with further 
analysis leading to two-dimensional iterated maps 

x n +\ — F\{x n ,y n ), y n +i = F 2 (x n , y n ) (18.14) 

stored by the computer. Extracting the functions Fj analytically or graphically is not al¬ 
ways easy, though. 

Let us start with a few classical examples of NDEs. In Chapter 9 we have already dis¬ 
cussed the soliton solution of the nonlinear Korteweg-de Vries PDE, Eq. (9.11). 
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Figure 1 8.4 Schematic of a Poincare section. 


Exercise 

18.4.1 For the damped harmonic oscillator 

x + 2 ax + x — 0, 

consider the Poincare section {.r > 0, y — x — 0}. Take 0 < a <Cl and show that the 
map is given by x n+ \ = bx n with b < 1. Find an estimate for b. 

Bernoulli and Riccati Equations 

Bernoulli equations are also nonlinear, having the form 

y'(x) = p{x)y(x) + q(x)[y(x)]', (18.15) 

where p and q are real functions and n / 0, I to exclude first-order linear ODEs. If we 
substitute 

u(x) = [yC*)] 1 ", (18.16) 

then Eq. (18.15) becomes a first-order linear ODE, 

u — (1 — n)y~ n y' — (1 — ri)\p{x)u{x) + q(xj\, (18.17) 

which we can solve as described in Section 9.2. 

Riccati equations are quadratic in y(x): 

y' = p(x)y 2 + q(x)y + r(x), 


(18.18) 
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where p ^ 0 to exclude linear ODEs and r ^ 0 to exclude Bernoulli equations. There is no 
general method for solving Riccati equations. However, when a special solution yo(x) of 
Eq. (18.18) is known by a guess or inspection, then one can write the general solution in 
the form y — yo + u, with u satisfying the Bernoulli equation 

u = pu 2 + (2 pyo + q)u, (18.19) 

because substitution of y = yo + u into Eq. (18.18) removes r(x) from Eq. (18.18). 

Just as for Riccati equations there are no general methods for obtaining exact solutions of 
other nonlinear ODEs. It is more important to develop methods for finding the qualitative 
behavior of solutions. In Chapter 9 we mentioned that power-series solutions of ODEs 
exist except (possibly) at regular or essential singularities, which are directly given by 
local analysis of the coefficient functions of the ODE. Such local analysis provides us with 
the asymptotic behavior of solutions as well. 


Fixed and Movable Singularities, Special Solutions 

Solutions of NDEs also have such singular points, independent of the initial or boundary 
conditions and called fixed singularities. In addition they may have spontaneous, or mov¬ 
able, singularities that vary with the initial or boundary conditions. They complicate the 
(asymptotic) analysis of NDEs. This point is illustrated by a comparison of the linear ODE 

y' + ^- = 0 , (18.20) 

x — 1 

which has the obvious regular singularity at x = 1, with the NDE y' — y 2 . Both have the 
same solution with initial condition y(0) = 1, namely, y(x) — 1/(1 — x). For v(0) = 2, 
though, the pole in the (obvious, but check) solution y(x) = 2/(1 — 2x) of the NDE has 
moved to x = 1 / 2 . 

For a second-order ODE we have a complete description of (the asymptotic behavior 
of) its solutions when (that of) two linearly independent solutions are known. For NDEs 
there may still be special solutions whose asymptotic behavior is not obtainable from 
two independent solutions. This is another characteristic property of NDEs, which we 
illustrate again by an example. 

The general solution of the NDE y" = yy'/x is given by 

y(x) — 2c\ tan(ci ln.v + C 2 ) — 1 , (18.21) 

where c\ are integration constants. An obvious (check it) special solution is y = C 3 = 
constant, which cannot be obtained from Eq. (18.20) for any choice of the parameters 
ci, C 2 - Note that using the substitution x — e r , Y(t) = y(e t ) so that x dy/dx = dY/dt, we 
obtain the ODE Y" = Y'(Y + 1). This ODE can be integrated once to give Y' — | Y 2 + 
Y + c with c = 2(c 2 + 1 /4) an integration constant, and again according to Section 9.2 to 
lead to the solution of Eq. (18.21). 
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Autonomous Differential Equations 

Differential equations that do not explicitly contain the independent variable, taken to be 
the time t here, are called autonomous. Verhulst’s NDE y — dy/dt — fiy{ 1 — y), which 
we encountered briefly in Section 18.2 as motivation for the logistic map, is a special case 
of this wide and important class of ODEs . 3 For one dependent variable v( t) they can be 
written as 


y = f(y), (18.22a) 

and for several dependent variables as a system 

yi = fi(yuy2,---,y n ), ; = 1,2,(l 8.22b) 

with sufficiently differentiable functions /, //.A solution of Eq. (18.22b) is a curve or 
trajectory y(f) for n — 1 and in general a trajectory (yi(f), yi(f),..., y„(f)) in an n- 
dimensional (so-called) phase space. As discussed already in Section 18.1, two trajectories 
cannot cross because of the uniqueness of the solutions of ODEs. Clearly, solutions of the 
algebraic system 


ft(yi,y2, ■■■,y n ) = o 


(18.23) 


are special points in phase space, where the position vector f;v i, yi ,..., y «) does not move 
on the trajectory; they are called critical (or fixed) points. It turns out that a local analysis 
of solutions near critical points leads to an understanding of the global behavior of the 
solutions. First let us look at a simple example. 

For Verhulst’s ODE, f(y) = fiy{ 1 — y) = 0 gives y — 0 and y = 1 as the critical points. 
For the logistic map, y — 0 and y — 1 are repellent fixed points because df/dy( 0) = // 
at y = 0 and df/dy(l) = —fi at y = I for /x > 1. A local analysis near y = 0 suggests 
neglecting the y 2 term and solving y = jiy instead. Integrating f dy/y = lit + Inc gives 
the solution y(f) = ce /ir , which diverges as t —» oo, so y = 0 is a repellent critical point. 
(Note that for /x < 0 of the logistic map the critical point y — 0 would be attracting, leading 
to a converging y ~ solution.) Similarly at y = 1, / dy/{ 1 — y) = fit — Inc leads to 
y(t) — 1 — ce _/jr -> 1 for t -* oo. Hence y = 1 is an attracting critical point. Because the 
ODE is separable, its general solution is given by 


/ 


dy 

yd - -v) 



l ' 


= In 


y 

\-y 


— fit + Inc. 


Hence y(t) — ce 1 ' 1 /( \ + ce 1 ") for t -> oo converges to 1, thus confirming the local analy¬ 
sis. This example motivates us to look next at the properties of fixed points in more detail. 
For an arbitrary function /, it is easy to see that 


• in one dimension, fixed points y, with /(yy) = 0 divide the y-axis into dynamically 
separate intervals because, given an initial value in one of the intervals, the trajectory 
y(t) will stay there, for it cannot go beyond either fixed point where y = 0 . 


3 Solutions of nonautonomous equations can be much more complicated. 



1092 Chapter 18 Nonlinear Methods and Chaos 


y 


(a) (b) 

Figure 18.5 Fixed points: (a) repellor, (b) sink. 

If f(yo) > 0 at the fixed point yo where /(yo) = 0 , then at yo + s for s > 0 sufficiently 
small, y = f'(yo)s + 0(s 2 ) > 0 in a neighborhood to the right of yo, so the trajectory y(t) 
keeps moving to the right, away from the fixed point vo- To the left of vo, >' = —/'(yo)e + 
0(s 2 ) < 0, so the trajectory moves away from the fixed point here as well. Hence, 

• a fixed point [with f(yo) = 0] at yo with /'(yo) > 0, as shown in Fig. 18.5a, repels 

trajectories; that is, all trajectories move away from the critical point: it 

is a repellor. Similarly, we see that 

• a fixed point at yo with /'(yo) < 0, as shown in Fig. 18.5b, attracts trajectories; that 
is, all trajectories converge toward the critical point yo: • • • —»■ •«—•••; it is a sink or 
node. 

Let us now consider the remaining case when also /'(yo) = 0. 

Let us assume /"(yo) > 0. Then at yo + e to the right of fixed point yo, y — 
f"(yo)s 2 /2 + 0(e 3 ) > 0 , so the trajectory moves away from the fixed point there, while 
to the left it moves closer to yo. In other words, we have a saddle point. For /"(y 0 ) < 0, 
the sign of y is reversed, so we deal again with a saddle point with the motion to the right 
of yo toward the fixed point and at left away from it. Let us summarize the local behavior 
of trajectories near such a fixed point yo: We have a 

• a saddle point at yo when /(yo) = 0, and /'(yo) = 0, as shown in Fig. 18.6a,b corre¬ 
sponding to the cases where (a) /"(yo) > 0 and trajectories on one side of the critical 
point, converge toward it and diverge from it on the other side: •••—»■ • —> • • •; and 
(b) /"(yo) < 0. Here the direction is simply reversed compared to (a). Figure 18.6(c) 
shows the cases where /"(yo) = 0 . 

So far we have ignored the additional dependence of /(y) on one or more parameters, 
such as n for the logistic map. When a critical point maintains its properties qualitatively 
as we adjust a parameter slightly, we call it structurally stable. This is reasonable be¬ 
cause structurally unstable objects are unlikely to occur in reality because noise and other 
neglected degrees of freedom act as perturbations on the system that effectively prevent 
such unstable points from being observed. Let us now look at fixed points from this point 
of view. Upon varying such a control parameter slightly we deform the function /, or we 
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(c) 

Figure 18.6 Saddle points. 


may just shift / up or down or sideways in Fig. 18.5 a bit. This will move a little the 
location yo of the fixed point with /(yo) = 0, but maintain the sign of /'(yo). Thus, both 
sinks and repellors are stable, while a saddle point in general is not. For example, shift¬ 
ing / in Fig. 18.6a down a bit creates two fixed points, one a sink and the other a repellor, 
and removes the saddle point. Since two conditions must be satisfied at a saddle point, 
they are less common and important, being unstable with respect to variations of parame¬ 
ters. However, they mark the border between different types of dynamics and are useful 
and meaningful for the global analysis of the dynamics. We are now ready to consider the 
richer, but more complicated, higher-dimensional cases. 

Local and Global Behavior in Higher Dimensions 

In two or more dimensions we start the local analysis at a fixed point (y®, y®,...) with 
yy = f] (y|, y^,...) — 0 using the same Taylor expansion of the /• in Eq. (18.22b) as 
for the one-dimensional case. Retaining only the first-order derivatives, this approach lin¬ 
earizes the coupled NDEs of Eq. (18.22b) and reduces their solution to linear algebra as 
follows. We abbreviate the constant derivatives at the fixed point as a matrix F with ele¬ 
ments 


, ».// 


(18.24) 
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In contrast to the standard linear algebra in Chapter 3, however, F is neither symmetric nor 
Hermitian in general. As a result, its eigenvalues may not be real. If we shift the fixed point 
to the origin and call the shifted coordinates Xj = y, — }y, then the coupled NDEs of Eq. 
(18.22b) become 


= ( 18 - 25 > 

j 

that is, coupled linear ODEs with constant coefficients. We solve Eq. (18.25) with the 
standard exponential Ansatz, 


x i {t) = Y J Ci j e Xit , (18.26) 

j 

with constant exponents Xj and a constant matrix C of coefficients c/j , so c/ = (cjj , i — 
1,2,...) forms the / th column vector of C. Substituting Eq. (18.26) into Eq. (18.25) yields 
a linear combination of exponential functions, 

E nj'-jt"' = E f‘kCkje Xjt , (18.27) 

j M 

which are independent if A.,- ^ Xj . This is the general case on which we focus, while degen¬ 
eracies where two or more X are equal require special treatment similar to saddle points in 
one dimension. Comparing coefficients of exponential functions with the same exponent 
yields the linear eigenvalue equations 

'y ' fikX'kj — Xj Cjj . or Fc, = Aycy. (18.28) 

k 

A nontrivial solution comprising the eigenvalue Xj and eigenvector c, of the homoge¬ 
neous linear equations (18.28) requires Xj to be a root of the secular equation (compare 
with Section 3.5): 


det(F — X - 1) = 0. (18.29) 

Equation (18.28) means that C diagonalizes F, so we can write Eq. (18.28) also 
as 


C _1 FC = [A-i, A-2 ,...]. (18.30) 

In the new but in general nonorthogonal coordinates defined as C| = x, we have 
a fixed point for each direction fas where the Xj play the role of f'(yo) 

in the one-dimensional case. The X are characteristic exponents and complex num¬ 
bers in general. This is seen by substituting x — C^ into Eq. (18.25) in conjunction with 
Eqs. (18.28) and (18.30). Thus, this solution represents the independent combination of 
one-dimensional fixed points, one for each component of § and each independent of the 
other components. In two dimensions for < 0 and ki < 0, then, we have a sink in all 
directions. When both X are greater than 0, we have repellor in all directions. 



Example 18.4.1 Stable Sink 
The coupled ODEs 
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x = -x, y = -x - 3y 

have an equilibrium point at the origin. The solutions have the form 

x(t) = c n e Xlt , y(t) = c 21 e Xl ' + c 2 2 e Xlt , 

so the eigenvalue X\ = —1 results from X i c ]1 = -cy, and the solution is x — cne~ r . The 
determinant ofEq. (18.29), 

_1 _7 A _3°_ x = (1 + *)(3 + » = 0, 

yields the eigenvalues Ai = — 1, A 2 = —3. Because both are negative we have a stable sink 
at the origin. The ODE for y gives the linear relations 

^lQl = —Cll — 3c 2 1 = — C21, X 2 C22 — —3C22, 


from which we infer 2c 2 \ — —cn, or c 2 1 = —cn/2. Because the general solution will 
contain two constants, it is given by 

x(t) =cue~‘, y(t) = - C ~^-e~' +C 22 e _3, ■ 

As the time t —»• oo, we have y ~ — x/2 and x -* 0 and y -> 0, while for t -> —oo, y ~ x 3 
and x, y —>• ±oo. The motion toward the sink is indicated by arrows in Fig. 18.7. To find 
the orbit, we eliminate the independent variable, r, and find the cubics: 


y = - 


C 22 3 
— X . 

C 11 


When both A are greater than 0, we have repellor. In this case the motion is away from 
the fixed point. However, when the X have different signs, we have a saddle point, that is, 
a combination of a sink in one dimension and a repellor in the other. This type of behavior 
generalizes to higher dimensions. 


Example 18.4.2 Saddle Point 
The coupled ODEs 

x = — 2 x — y, y — —x + 2 y 

have a fixed point at the origin. The solutions have the form 

x(f) = cue Xl ' + cne X2t , y(t) = C 2 ie Al? + c 22 e Xl ‘. 

The eigenvalues X — ± </5 are determined from 

= A 2 —5 = 0. 


—2 — X -1 
-1 2-X 
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y 



Figure 1 8.7 Stable sink. 


Substituting the general solutions into the ODEs yields the linear equations 


Men = — 2c\\ — C 21 = \/5cn, 
Me 12 = —2ci2 — C22 = —V5ci2, 


MC21 = —Cll + 2C21 = V5C21, 
\lC22 = — C12 + 2C22 = — \/5c22, 


(V5 + 2)cn = — C21, 
(V5 — 2)C21 = —cm 


(V5 — 2)C12 = C22, 
(V5 + 2)C22 = C12, 


so C 21 = — (2 + V5)cn, C 22 = (\/5 — 2)ci2- The family of solutions depends on two 
parameters, cn, cn- For large time t —> oo, the positive exponent prevails and y ~ 
— (V5 + 2)x, while for t —> — oo we have y = (V5 — 2)x. These straight lines are the 
asymptotes of the orbits. Because — (V5 + 2)(-s/5 — 2) = — 1 they are orthogonal. We find 
the orbits by eliminating the independent variable, t, as follows. Substituting the ci j we 
write 


y =—2x — — c\ 2 e v ^ < ), 


Now we add and subtract the solution x(t) to get 


y^ = . cne ^, +cue -^. 


—-(y + 2x) + x = 2 c\ 2 e ^, ——{y + 2x) — x = — 2c\\e'^ >t , 

v 5 v 5 
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y 



Figure 18.8 Saddle point. 


which we multiply to obtain 

-(y + 2x) 2 — x 2 = —4 ci2Cji = const. 

The resulting quadratic form, y 2 + 4xy — x 2 = const., is a hyperbola because of the 
negative sign. The hyperbola is rotated in the sense that its asymptotes are not aligned 
with the x, y-axes (Fig. 18.8). Its orientation is given by the direction of the as¬ 
ymptotes that we found earlier. Alternatively we could find the direction of minimal 
distance from the origin, proceeding as follows. We set the x and y derivatives of 
/ + A g = x 2 + v 2 + A(y 2 + 4 xy — x 2 ) equal to zero, where A is the Lagrange multiplier 
for the hyperbolic constraint. The four branches of hyperbolas correspond to the differ¬ 
ent signs of the parameters cn and C12. Figure 18.8 is plotted for the cases cn = ±1, 
C12 = ±2. ■ 

However, a new kind of behavior arises for a pair of complex conjugate eigenvalues 
71,2 = p ± iK. If we write the complex solutions t;i,2 = exp (pt ± iict) in real variables 
£+ = (§1 + §2)/2, §_ = (§1 — £2)/2i upon using the Euler identity exp(ix) = cos x + i sinx 
(see Section 6.1), 

§ + = exp(pf)cos(Arf), = exp(pr) sin(/rr) (18.31) 

describe a trajectory that spirals inward to the fixed point at the origin for p < 0, a spiral 
node, and spirals away from the fixed point for p > 0, a spiral repellor. 
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The coupled ODEs 

x — —x + 3 y, y = —3x + 2 y 
have a fixed point at the origin and solutions of the form 

x(t) — cne x,t + c\ 2 e Xlt , y(t ) = C 2 \e Xl ' + C22£ k2 ‘ ■ 

The exponents are solutions of 

= (1 + A)(A-2) + 9 = 0, 

or A 2 — A + 7 = 0. The eigenvalues are complex conjugate, A = 1/2 ± i V27/2, so we deal 
with a spiral fixed point at the origin (a repellor because 1/2 > 0). Substituting the general 
solutions into the ODEs yields the linear equations 

Men = —cn + 3 c 2 i, Mc 2 i = — 3cn + 2 c 2 i, 

A 2 C 12 = — C 12 + 3C22, A 2 C 22 = — 3ci2 + 2C22, 

or 

(Ai + l)cii = 3c2i, (M — 2 )c 2 i = —3cn, 

(A 2 + 1)C12 = 3C22, (A 2 — 2)C22 = — 3ci2, 

which, using the values of A 12 , imply the family of curves 

x(f) = e t/2 {c n e iV ^ t/2 + ci 2 e~ iVTJr/2 ), 

3 >(,) = | + - cne-^ 2 ), 

which depends on two parameters, cn, cn- To simplify we can separate real and imaginary 
parts of x(t) and y(t) using the Euler identity e ,x = cos x + i sinx. It is equivalent, but more 
convenient, to choose cn = c \2 = c/2 and rescale t —> 2 1, so with the Euler identity we 
have 

x(t) — ce' cos(\/27r), y(t)= - ^ ce* sin(\/27f). 

2 6 

Here we can eliminate t and find the orbit 


— 1 — A 3 
-3 2-A 



For fixed t this is the positive definite quadratic form x 2 — xy + y 2 — const., that is, an 
ellipse. But there is no ellipse in the solutions because t is not fixed. Nonetheless, it is 
useful to find its orientation. We proceed as follows. With A the Lagrange multiplier for 
the elliptical constraint we seek the directions of maximal and minimal distance from the 
origin, forming 


f{x, y) + Ag(x, y)=x 2 + y 2 + A(x 2 - xy + y 2 ) 
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Figure 18.9 Spiral point. 



2(A + l)x = Ay, 2(A + l)y = Ax 

we obtain the directions 

x A 2(A + 1) 
v 2(A +1) A 

or A 2 + §A + j = 0. This yields the values A = —2/3, —2 and the directions y — ±x. 
In other words, our ellipse is centered at the origin and rotated by 45°. As we vary the 
independent variable, f, the size of the ellipse changes, so we get the rotated spiral shown 
in Fig. 18.9 for c = 1. ■ 

In the special case when p = 0 in Eq. (18.31), the circular trajectory is called a cycle. 
When trajectories near it are attracted as time goes on, it is called a limit cycle, representing 
periodic motion for autonomous systems. 
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Example 18.4.4 Center OR Cycle 

The undamped linear harmonic oscillator ODE x + u> 2 x — 0 can be written as two coupled 
ODEs: 

x = —coy, y — cox. 

Integrating the resulting ODE xx + yy = 0 yields the circular orbits x 2 + y 2 — const., 
which define a center at the origin and are shown in Fig. 18.10. The solutions can be para¬ 
meterized as x — R cos t, y = R sin t. where R is the radius parameter. They correspond to 
the complex conjugate eigenvalues X\ 2 — ±ico. We can check them if we write the general 
solution as 


x(t) — + cue llt , 


y(t) = c 21 e Xir +c 2 2 e X2t . 


Then the eigenvalues follow from 


—A, 

co 


—CO 

-A 


= A 2 + or = 0 = 0. 


Another classic attractor is quasiperiodic motion, such as the trajectory 


x(t) — A 1 sin(&>ir + b\) + A 2 sin(co 2 t + b 2 ), 


(18.32) 
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where the ratio a>\ j an is an irrational number. Such combined oscillations occur as solu¬ 
tions of a damped anharmonic oscillator (Van der Pol nonautonomous system) 

x + 2 yx + co^x + fix 3 — fcos(oo\t). (18.33) 

In three dimensions, when there is a positive characteristic exponent and an attracting 
complex conjugate pair in the other directions, we have a spiral saddle point as a new 
feature. Conversely, a negative characteristic exponent in conjunction with a repelling pair 
also gives rise to a spiral saddle point, where trajectories spiral out in two dimensions but 
are attracted in a third direction. 

In general, when some form of damping (or dissipation of energy) is present, the tran¬ 
sients decay and the system settles either in equilibrium, that is, a single point, or in pe¬ 
riodic or quasiperiodic motion. Chaotic motion in dissipative systems is now recognized 
as a fourth state, and its attractors are often called strange. In dissipative systems, initial 
conditions are not important because trajectories end up on some attractor. They are cru¬ 
cial in Hamiltonian systems. In nonintegrable Hamiltonian systems, chaos may also occur, 
and then it is called conservative chaos. We refer to Chapter 8 of Hilborn (1994) in the 
Additional Readings for this more complicated topic. 

For the driven damped pendulum when trajectories near a center (closed orbit) are at¬ 
tracted to it as time goes on, this closed orbit is defined as a limit cycle, representing 
periodic motion for autonomous systems. A damped pendulum usually spirals into the ori¬ 
gin (the position at rest); that is, the origin is a spiral fixed point in its phase space. When 
we turn on a driving force, then the system formally becomes nonautonomous, because of 
its explicit time dependence, but also more interesting. In this case, we can call the explicit 
time in a sinusoidal driving force a new variable, cp, where &>o is a fixed rate, in the equation 
of motion 

6o+yco + smO = f sirup, co = 9, cp — coot. 

Then we increase the dimension of our phase space by 1 (adding one variable, cp) because 
cp — ooq — const., but we keep the coupled ODEs autonomous. This driven damped pen¬ 
dulum has trajectories that cross a closed orbit in phase space and spiral back to it; it is 
called limit cycle. This happens for a range of strength / of the driving force, the control 
parameter of the system. As we increase /, the phase space trajectories go through sev¬ 
eral neighboring limit cycles and eventually become aperiodic and chaotic. Such closed 
limit cycles are called Hopf bifurcations of the pendulum on its road to chaos, after the 
mathematician E. Hopf, who generalized Poincare’s results on such bifurcations to higher 
dimensions of phase space. 

Such spiral sinks or saddle points cannot occur in one dimension, but we might ask if 
they are stable when they occur in higher dimensions. An answer is given by the Poincare- 
Bendixson theorem, which says that either trajectories (in the finite region to be specified 
in a moment) are attracted to a fixed point as time goes on, or they approach a limit cycle 
provided the relevant two-dimensional subsystem stays inside a finite region, that is, does 
not diverge there as t —> oo. For a proof we refer to Hirsch and Smale (1974) and Jackson 
(1989) in the Additional Readings. 

In general, when some form of damping is present, the transients decay and the system 
settles either in equilibrium, that is, a single point, or in periodic or quasiperiodic motion. 
Chaotic motion is now recognized as a fourth state, and its attractors are often strange. 
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Exercise 

18.4.2 Show that the (Rossler) coupled ODEs 

X| = — X2 — Xt,, XT — X\ + CI[X2, X 3 = fl2 + (-H — «3)^3 

(a) have two fixed points for a 2 — 2, <73 = 4, and 0 < a 1 <2, 

(b) have a spiral repellor at the origin, and 

(c) have a spiral chaotic attractor for a \ — 0.398. 

Dissipation in Dynamical Systems 

Dissipative forces often involve velocities, that is, first-order time derivatives, such as fric¬ 
tion (for example, for the damped oscillator). Let us look for a measure of dissipation, 
that is, how a small area A — c i, 2 Afi A §2 at a fixed point shrinks or expands, first in two 
dimensions for simplicity. Here cp 2 = sin(fi, £ 2 )- involving the sine of the characteristic 
directions, is a time-independent angular factor that takes into account the nonorthogonal¬ 
ity of the characteristic directions £1 and £2 of Eq. (18.28). If we take the time derivative of 
A and use = Xj^j of the characteristic coordinates, implying A t-j — XjA^j, we obtain, 
to lowest order in the A l-j, 

A — ci,2[A^il2 A^2 + A§2 ^i A^i] = ci,2 A^i A^2 (/A-i + X 2 ). (18.34) 

In the limit A l-j —> 0, we find from Eq. (18.34) that the rate 

A 

— = Li + Xt — trace(F) = V • f| Vn , (18.35) 

with f = (/ 1 , f 2 ) the vector of time evolution functions of Eq. (18.22b). Note that the time- 
independent sine of the angle between and £2 drops out of the rate. The generalization 
to higher dimensions is obvious. Moreover, in n dimensions, 

trace(F) = (18.36) 

i 

This trace formula follows from the invariance of the secular polynomial in Eq. (18.29) 
under a linear transformation, C£ = x in particular, and it is a result of its determinental 
form using the product theorem for determinants (see Section 3.2), viz. 

det(F — X ■ 1) = [det(C)] 1 det(F — X ■ l)[det(C)] = det(C -1 (F — X ■ 1)C) 

n 

= det(C -1 FC — A. • l) = ]~~[(L; — X). (18.37) 

i=i 

Here the product form comes about by substituting Eq. (18.30). Now, trace(F) is the coef¬ 
ficient of (—A )" -1 upon expanding det(F — X ■ 1) in powers of X, while it is X, from 
the product form J~[. (X, — X ), which proves Eq. (18.36). Clearly, according to Eqs. (18.35) 
and (18.36), 
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• it is the sign (and more precisely the trace) of the characteristic exponents of the deriv¬ 
ative matrix at the fixed point that determines whether there is expansion or shrinkage 
of areas and volumes in higher dimensions near a critical point. 

In summary then, Eq. (18.35) states that dissipation requires V • f(y) / 0, where v/ = //, 
and does not occur in Hamiltonian systems where V • f = 0. 

Moreover, in two or more dimensions, there are the following global possibilities: 

• The trajectory may describe a closed orbit (cycle). 

• The trajectory may approach a closed orbit (spiraling inward or outward toward the 
orbit) as t —> oo. In this case we have a limit cycle. 

The local behavior of a trajectory near a critical point is also more varied in general 
than in one dimension: At a stable critical point all trajectories may approach the critical 
point along straight lines or spiral inward (toward the spiral node) or may follow a more 
complicated path. If all time-reversed trajectories move toward the critical point in spirals 
as t -> — oo, then the critical point is a divergent spiral point, or spiral repellor. When 
some trajectories approach the critical point while others move away from it, then it is 
called a saddle point. When all trajectories form closed orbits about the critical point, it is 
called a center. 

Bifurcations in Dynamical Systems 

A bifurcation is a sudden change in dynamics for specific parameter values, such as the 
birth of a node-repellor pair of fixed points or their disappearance upon adjusting a control 
parameter; that is, the motions before and after the bifurcation are topologically different. 
At a bifurcation point, not only are solutions unstable when one or more parameters are 
changed slightly, but the character of the bifurcation in phase space or in the parameter 
manifold may change. Thus we are dealing with fairly sudden events of nonlinear dynam¬ 
ics. Rather sudden changes from regular to random behavior of trajectories are character¬ 
istic of bifurcations, as is sensitive dependence on initial conditions: Nearby initial condi¬ 
tions can lead to very different long-term behavior. If a bifurcation does not change quali¬ 
tatively with parameter adjustments, it is called structurally stable. Note that structurally 
unstable bifurcations are unlikely to occur in reality because noise and other neglected 
degrees of freedom act as perturbations on the system that effectively eliminate unstable 
bifurcations from our view. Bifurcations (such as doublings in maps) are important as one 
among many routes to chaos. Others are sudden changes in trajectories associated with 
several critical points called global bifurcations. Often they involve changes in basins of 
attraction and/or other global structures. The theory of global bifurcations is fairly compli¬ 
cated and is still in its infancy at present. 

Bifurcations that are linked to sudden changes in the qualitative behavior of dynamical 
systems at a single fixed point are called local bifurcations. More specifically, a change 
in stability occurs in parameter space where the real part of a characteristic exponent of 
the fixed point alters its sign, that is, moves from attracting to repelling trajectories, or vice 
versa. The center-manifold theorem says that at a local bifurcation only those degrees 
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of freedom matter that are involved with characteristic exponents going to zero: JHA,- = 0 . 
Locating the set of these points is the first step in a bifurcation analysis. Another step 
consists in cataloguing the types of bifurcations in dynamical systems, to which we turn 
next. 

The conventional normal forms of dynamical equations represent a start in classifying 
bifurcations. For systems with one parameter (that is, a one-dimensional center manifold) 
we write the general case of NDE as follows: 

OO OO OO 

x — +cy , ,a| 1 V + c 2 yH-, (18.38) 

.7=0 7=0 ' 7=0 

where the superscript on the a (ln 1 denotes the power of the parameter c they are associated 
with. One-dimensional iterated nonlinear maps such as the logistic map of Section 18.2 
(which occur in Poincare sections) of nonlinear dynamical systems can be classified simi¬ 
larly, viz. 

OO OO OO 

x n +\ — y^fl; 0) Xn + c + c 2 ^ a H-. (18.39) 

7=0 7=0 7=0 

Thus, one of the simplest NDEs with a bifurcation is 

x — x 2 — c, (18.40) 

which corresponds to all a ( "‘ 1 = 0 except for 1 = — 1 and = 1. For c > 0, there are 
two fixed points (recall, x = 0) x± = ±>/c with characteristic exponents 2x± , so X- is a 
node and x+ is a repellor. For c < 0 there are no fixed points. Therefore, as c —>■ 0 the 
fixed point pair disappears suddenly; that is, the parameter value c — 0 is a repellor-node 
bifurcation that is structurally unstable. This complex map (with c —»• —c) generates the 
fractal Julia and Mandelbrot sets discussed in Section 18.3. 

A pitchfork bifurcation occurs for the undamped (nondissipative and special case of the 
Duffing) oscillator with a cubic anharmonicity 

x + ax + bx 2 = 0, b > 0. (18.41) 

It has a continuous frequency spectrum and is, among others, a model for a ball bouncing 
between two walls. When the control parameter a > 0, there is only one fixed point, at 
x — 0, a node, while for a < 0 there are two more nodes, at x± = ± sj—cijb. Thus, we 
have a pitchfork bifurcation of a node at the orgin into a saddle point at the origin and two 
nodes, at x± ^ 0. In terms of a potential formulation, V (x) — ax 2 /2 + bx 4 /4 is a single 
well for a > 0 but a double well (with a maximum at x = 0 ) for a <0. 

When a pair of complex conjugate characteristic exponents p ± ik crosses from a spiral 
node (p < 0 ) to a repelling spiral (p > 0 ) and periodic motion (limit cycle) emerges, then 
we call the qualitative change a Hopf bifurcation. They occur in the quasiperiodic route 
to chaos that will be discussed in the next section, on chaos. 

In a global analysis we piece together the motions near various critical points, such as 
nodes and bifurcations, to bundles of trajectories that flow more or less together in two 
dimensions. (This geometric view is the current mode of analyzing solutions of dynamical 
systems.) But this flow is no longer collective in the case of three dimensions, where they 
diverge from each other in general, because chaotic motion is possible that typically fills 
the plane of a Poincare section with points. 
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Chaos in Dynamical Systems 

Our previous summaries of intricate and complicated features of dynamical systems due 
to nonlinearities in one and two dimensions do not include chaos, although some of them, 
such as bifurcations, sometimes are precursors to chaos. In three- or more-dimensional 
NDEs, chaotic motion may occur, often when a constant of the motion (an energy integral 
for NDEs defined by a Hamiltonian, for example) restricts the trajectories to a finite volume 
in phase space and when there are no critical points. Another characteristic signal for chaos 
is when for each trajectory there are nearby ones, some of which move away from it, while 
others approach it with increasing time. The notion of exponential divergence of nearby 
trajectories is made quantitative by the Lyapunov exponent X (see Section 18.3 for more 
details) of iterated maps of Poincare sections associated with the dynamical system. If two 
nearby trajectories are at a distance do at time t — 0 but diverge with a distance d(t) at a 
later time r, then d ( t ) ~ doe' J holds. Thus, by analyzing the series of points, that is, iterated 
maps generated on Poincare sections, one can study routes to chaos of three-dimensional 
dynamical systems. This is the key method for studying chaos. As one varies the location 
and orientation of the Poincare plane, a fixed point on it often is recognized to originate 
from a limit cycle in the three-dimensional phase space whose structural stability can be 
checked there. For example, attracting limit cycles show up as nodes in Poincare sections, 
repelling limit cycles as repellors of Poincare maps, and saddle cycles as saddle points of 
associated Poincare maps. 

Three or more dimensions of phase space are required for chaos to occur because of the 
interplay of the necessary conditions we just discussed, viz. 

• bounded trajectories (are often the case for Hamiltonian systems), 

• exponential divergence of nearby trajectories (is guaranteed by positive Lyapunov ex¬ 
ponents of corresponding Poincare maps), 

• no intersection of trajectories. 

The last condition is obeyed by deterministic systems in particular, as we discussed in 
Section 18.1. A surprising feature of chaos, mentioned in Section 18.1, is how prevalent 
it is and how universal the routes to chaos often are, despite the overwhelming variety of 
NDEs. 

An example for spatially complex patterns in classical mechanics is the planar pendu¬ 
lum, whose one-dimensional equation of motion 

dQ dL 

I — = L , — =—Img sin$ (18.42) 

dt dt 

is nonlinear in the dynamic variable 9(t). Here I is the moment of inertia, / is the distance 
to the center of mass, m is the mass, and g is the gravitational acceleration constant. When 
all parameters in Eq. (18.42) are constant in time and space, then the solutions are given in 
terms of elliptic integrals (see Section 5.8) and no chaos exists. However, a pendulum under 
a periodic external force can exhibit chaotic dynamics, for example, for the Lagrangian 

L = yf 2 - mg(l - z), (x - x 0 ) 2 + y 2 + z 2 — I 2 , 

.ro = si cos cot. 


(18.43) 

(18.44) 



1106 Chapter 18 Nonlinear Methods and Chaos 


(See Moon (1992) in the Additional Readings.) 

Good candidates for chaos are multiple well potential problems, 

d 2 r ( dr \ 

^ + VV(r) = F(r,-,,), (18.45) 

where F represents dissipative and/or driving forces. Another classic example is rigid-body 
rotation, whose nonlinear three-dimensional Euler equations are familiar, viz. 

d 

— I\a>i — (h — h)(02C03 + Mi, 

dt 

d 

— IiWi — (It, — /l)tt>lft)3 + Mi, (18.46) 

dt 

d 

—/ 3 CU 3 = (/1 — / 2 )ft>l &>2 + M 3 . 

dt 

Here the I are the principal moments of inertia and to is the angular velocity with compo¬ 
nents (Dj about the body-fixed principal axes. Even free rigid-body rotation can be chaotic, 
for its nonlinear couplings and three-dimensional form satisfy all requirements for chaos to 
occur (see Section 18.1). A rigid-body example of chaos in our solar system is the chaotic 
tumbling of Hyperion, one of Saturn’s moons that is highly nonspherical. It is a world 
where the Saturn rise and set is so irregular as to be unpredictable. Another is Halley’s 
comet, whose orbit is perturbed by Jupiter and Saturn. In general, when three or more ce¬ 
lestial bodies interact gravitationally, stochastic dynamics are possible. Note, though, that 
computer simulations over large time intervals are required to ascertain chaotic dynamics 
in the solar system. For more details on chaos in such conservative Hamiltonian systems 
we refer to Chapter 8 of Hilborn (1994) in the Additional Readings. 


Exercise 

18 . 4.3 Construct a Poincare map for the Duffing oscillator in Eq. (18.41). 

Routes to Chaos in Dynamical Systems 

Let us now look at some routes to chaos. The period-doubling route to chaos is exemplified 
by the logistic map in Section 18.2, and the universal Feigenbaum numbers a, 8 are its 
quantitative features, along with Lyapunov exponents. It is common in dynamical systems. 
It may begin with limit cycle (periodic) motion that shows up as a fixed point in a Poincare 
section. The limit cycle may have originated in a bifurcation from a node or some other 
fixed point. As a control parameter changes, the fixed point of the Poincare map splits into 
two points; that is, the limit cycle has a characteristic exponent going through zero from 
attracting to repelling, say. The periodic motion now has a period twice as long as before, 
etc. We refer to Chapter 11 of Barger and Olsson (1995) in the Additional Readings for 
period-doubling plots of Poincare sections for the Duffing equation (18.41) with aperiodic 
external force. Another example for period doubling is a forced oscillator with friction (see 
Helleman in Cvitanovic (1989) in the Additional Readings). 
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The quasiperiodic route to chaos is also quite common in dynamical systems, for exam¬ 
ple, starting from a time-independent node, a fixed point. If we adjust a control parameter, 
the system undergoes a Hopf bifurcation to the periodic motion corresponding to a limit 
cycle in phase space. With further change of the control parameter, a second frequency 
appears. If the frequency ratio is an irrational number, the trajectories are quasiperiodic, 
eventually covering the surface of a torus in phase space; that is, quasiperiodic orbits never 
close or repeat. Further changes of the control parameter may lead to a third frequency or 
directly to chaotic motion. Bands of chaotic motion can alternate with quasiperiodic mo¬ 
tion in parameter space. An example for such a dynamic system is a periodically driven 
pendulum. 

A third route to chaos goes via intermittency, where the dynamical system switches 
between two qualitatively different motions at fixed control parameters. For example, at 
the beginning, periodic motion alternates with an occasional burst of chaotic motion. With 
a change of the control parameter, the chaotic bursts typically lengthen until, eventually, no 
periodic motion remains. The chaotic parts are irregular and do not resemble each other, but 
one needs to check for a positive Lyapunov exponent to demonstrate chaos. Intermittencies 
of various types are common features of turbulent states in fluid dynamics. The Lorenz 
coupled NDEs also show intermittency. 


Exercise 

18 . 4.4 Plot the intermittency region of the logistic map at /i — 3.8319. What is the period of 
the cycles? What happens at /x = 1 + 2\/2? 

ANS. There is a tangent bifurcation to period 3 cycles. 
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Probability 


Probabilities arise in many problems dealing with random events or large numbers of parti¬ 
cles defining random variables. An event is called random if it is practically impossible to 
predict from the initial state. This includes those cases where we have merely incomplete 
information about initial states and/or the dynamics, as in statistical mechanics, where we 
may know the energy of the system that corresponds to very many possible microscopic 
configurations, preventing us from predicting individual outcomes. Often the average prop¬ 
erties of many similar events are predictable, as in quantum theory. This is why probability 
theory can be and has been developed. 

Random variables are involved when data depend on chance, such as weather reports and 
stock prices. The theory of probability describes mathematical models of chance processes 
in terms of probability distributions of random variables that describe how some “random 
events” are more likely than others. In this sense probability is a measure of our igno¬ 
rance, giving quantitative meaning to qualitative statements such as “It will probably rain 
tomorrow” and “I’m unlikely to draw the heart queen.” Probabilities are of fundamental 
importance in quantum mechanics and statistical mechanics and are applied in meteorol¬ 
ogy, economics, games, and many other areas of daily life. 

To a mathematician, probabilities are based on axioms, but we will discuss here practical 
ways of calculating probabilities for random events. Because experiments in the sciences 
are always subject to errors, theories of errors and their propagation involve probabilities. 
In statistics we deal with the applications of probability theory to experimental data. 

19.1 Definitions, Simple Properties 

All possible mutually exclusive 1 outcomes of an experiment that is subject to chance 
represent the events (or points) of the sample space S. For example, each time we toss a 
coin we give the trial a number i = 1,2,... and observe the outcomes x ,. Here the sample 

1 This means that given that one particular event did occur, the others could not have occurred. 
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consists of two events: heads and tails, and the Xj represent a discrete random variable 
that takes on one of two values, heads or tails. When two coins are tossed, the sample 
contains the events two heads, one head and one tail, two tails; the number of heads is a 
good value to assign to the random variable, so the possible values are 2, 1, and 0. There 
are four equally probable outcomes, of which one has value 2, two have value 1, and one 
has value 0. So the probabilities of the three values of the random variable are 1 /4 for two 
heads (value 2), 1 /4 for no heads (value 0), and 1 /2 for value 1. In other words, we define 
the theoretical probability P of an event denoted by the point Xj of the sample as 


P(x.) 


number of outcomes of event Xj 
total number of all events 


(19.1) 


An experimental definition applies when the total number of events is not well defined (or 
is difficult to obtain) or equally likely outcomes do not always occur. Then 


P(Xi) 


number of times event Xj occurs 
total number of trials 


(19.2) 


is more appropriate. A large, thoroughly mixed pile of black and white sand grains of the 
same size and in equal proportions is a relevant example, because it is impractical to count 
them all. But we can count the grains in a small sample volume that we pick. This way we 
can check that white and black grains turn up with roughly equal probability 1 /2, provided 
we put back each sample and mix the pile again. It is found that the larger the sample 
volume, the smaller the spread about 1 /2 will be. The more trials we run, the closer the 
average occurrence of all trial counts will be to 1/2. We could even pick single grains and 
check if the probability 1 /4 of picking two black grains in a row equals that of two white 
grains, etc. There are lots of statistics questions we can pursue. Thus, piles of colored sand 
provide for instructive experiments. 

The following axioms are self-evident. 


• Probabilities satisfy 0 < P < 1. Probability 1 means certainty; probability 0 means 
impossibility. 

• The entire sample has probability 1. For example, drawing an arbitrary card has prob¬ 
ability 1. 

• The probabilities for mutually exclusive events add. The probability for getting one 
head in two coin tosses is 1 /4 + 1 /4 = 1/2 because it is 1 /4 for head first and then tail, 
plus 1 /4 for tail first and then head. 


Example 19.1.1 probability for a or b 

What is the probability for drawing 2 a club or a jack from a shuffled deck of cards? Because 
there are 52 cards in a deck, each being equally likely, 13 cards for each suit and 4 jacks, 
there are 13 clubs including the club jack, and 3 other jacks; that is, there are 16 possible 
cards out of 52, giving the probability (13 + 3)/52 = 16/52 = 4/13. ■ 


“These are examples of non-mutually exclusive events. 
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If we represent the sample space by a set S of points, then events are subsets A, B, ... of 
S , denoted as A C S, etc. Two sets A, B are equal if A is contained in B, A C B, and B is 
contained in A, B C A. The union AU5 consists of all points (events) that are in A or B 
or both (see Fig. 19.1). The intersection A D B consists of all points, that are in both A 
and B. If A and B have no common points, their intersection is the empty set, A fl B — 0, 
which has no elements (events). The set of points in A that are not in the intersection of A 
and B is denoted by A - A fl /l. defining a subtraction of sets. If we take the club suit in 
Example 19.1.1 as set A and the four jacks as set B, then their union comprises all clubs 
and jacks, and their intersection is the club jack only. 

Each subset A has its probability P(A ) > 0. In terms of these set theory concepts and 
notations, the probability laws we just discussed become 

0< P(A) < 1. 

The entire sample space has P(S) = 1. The probability of the union A U B of mutually 
exclusive events is the sum 

P(AU B) = P(A) + P(B), Anfi = 0. 

The addition rule for probabilities of arbitrary sets is given by the following theorem. 

Addition rule: 


P(A U B) = P(A) + P{B) - P(A n B). (19.3) 

To prove this, we decompose the union into two mutually exclusive sets A U B — A U 
(B — B fl A), subtracting the intersection of A and B from B before joining them. Their 
probabilities are P(A), P(B) — P(BC1 A), which we add. We could also have decomposed 
A U B — (A — A fl B) U B, from which our theorem follows similarly by adding these 
probabilities, P(A U B ) = [P(A) — P(A fl B)] + P{B). Note that A fl B = B fl A. (See 
Fig. 19.1.) 

Sometimes the rules and definitions of probabilities that we have discussed so far are not 
sufficient, however. 



Figure 19.1 The shaded area gives the 
intersection ACi B, corresponding to the 
A and B events, the dashed line encloses 
AUB, corresponding to the A or B 
events. 
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Example 19.1.2 Conditional Probability 


A simple example consists of a box of 10 identical red and 20 identical blue pens, arranged 
in random order, from which we remove pens successively, that is, without putting them 
back. Suppose we draw a red pen first, event A. That will happen with probability P(A) — 
10/30 = 1/3 if the pens are thoroughly mixed up. The conditional probability P(B\A) 
of drawing a blue pen in the next round, event B, however, will depend on the fact that 
we drew a red pen in the first round. It is given by 20/29. There are 10 • 20 possible 
sample points (red/blue pen events) in two rounds, and the sample has 30 • 29 events, so 
the combined probability is 

10 20 10-20 20 

P(A,B)= -=-= —. ■ 

30 29 30-29 87 ■ 

In general, the combined probability P(A , B) that A and B happen (in this order) is 
given by the product of the probability that A happens, P(A ), and the probability that B 
happens if A does, P(B\A): 


P(A,B) = P(A)P(B\A). 


(19.4) 


In other words, the conditional probability P(B\A ) is given by the ratio 


P(B\A) = 


P(A,B) 
P(A ) 


(19.5) 


If the conditional probability P(B\A) = P(B) is independent of A, then the events A and 
B are called independent, and the combined probability 


P(ADB)= P(A)P(B) 


(19.6) 


is simply the product of both probabilities. 


Example 1 9 . 1.3 Scholastic Aptitude Tests 

Colleges and universities rely on the verbal and mathematics SAT scores, among others, as 
predictors of a student’s success in passing courses and graduating. A research university 
is known to admit mostly students with a combined verbal and mathematics score above 
1400 points. The graduation rate is 95%; that is, 5% drop out or transfer elsewhere. Of 
those who graduate, 97% have an SAT score of more than 1400 points, while 80% of those 
who drop out have an SAT score below 1400. Suppose a student has an SAT score below 
1400. What is his/her probability of graduating? 

Let A be the cases having an SAT test score below 1400, B represent those above 1400, 
mutually exclusive events with P(A) + P(B) = 1, and C be those students who graduate. 
That is, we want to know the conditional probabilities P(C\A) and P(C\B). To apply 
Eq. (19.5) we need P(A) and P(B). There are 3% of students with scores below 1400 
among those who graduate (95%) and 80% of those 5% who do not graduate, so 

P(A) = 0.03 • 0.95 + \o5 = 0.0685, 


0.05 

P(B) = 0.97 ■ 0.95 + — = 0.9315, 
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and also 


P(C n A) = 0.03 • 0.95 = 0.0285 and P(C D B) = 0.97 • 0.95 = 0.9215. 


Here the combined probabilities P(C, A) — P{C fl A), P(C, B) = P(C fl B) as C and A 
(and C and B) are parts of the same sample space. Therefore, 


P(C\A) — 


P(CDA) 

P(A) 


P(C\B) — 


P(CDB) 
P(B) 


0.0285 

0.0685 


41.6%, 


0.9215 

0.9315 


98.9%; 


that is, a little less than 42% is the probability for a student with a score below 1400 to 
graduate at this particular university. ■ 

As a corollary to the definition of a conditional probability, Eq. (19.5), we compare 
P(A\B) = P(AnB)/P(B ) and P(B\A) — P(AD B)/P(A), which leads to the following 
theorem. 


Bayes theorem: 

P(A) 

P{A\ B ) = y^- ) P(B\ A ). (19.7) 

This can be generalized to the following. 

Theorem: If the random events A, with probabilities P(Aj) > 0 are mutually exclusive 
and their union represents the entire sample S, then an arbitrary random event B C S has 
the probability 


n 

P(B) = J>(A,)/’CB|A,). (19.8) 

i=1 



Figure 19.2 The shaded area B is 
composed of mutually exclusive subsets of 
B belonging also to Ai, A 2 , A 3 , where the 
A, are mutually exclusive. 
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This decomposition law resembles the expansion of a vector into a basis of unit vectors 
defining the components of the vector. This relation follows from the obvious decomposi¬ 
tion B = U, (5 Cl A/), Fig. 19.2, which implies P(B ) = P(B fl A,) for the probabil¬ 
ities because the components B fl A, are mutually exclusive. For each i, we know from 
Eq. (19.5) that P(B D A,) = P(Aj)P(B\Ai), which proves the theorem. 


Counting of Permutations and Combinations 

Counting particles in samples can help us find probabilities, as in statistical mechanics. 

If we have n different molecules, let us ask in how many ways we can arrange them in 
a row, that is, permute them. This number is defined as the number of their permutations. 
Thus, by definition, the order matters in permutations. There are n choices of picking 
the first molecule, n — I for the second, etc. Altogether there are n! permutations of n 
different molecules or objects. 

Generalizing this, suppose there are n people but only k < n chairs to seat them. In how 
many ways can we seat k people in the chairs? Counting as before, we get 

n ! 

n(n-l)---(n-k+l) = - -— 

(n — k )! 

for the number of permutations of n different objects. A: at a time. 

We now consider the number of combinations of objects when their order is irrelevant 
by definition. For example, three letters a, b , c can be combined, two letters at a time, in 
3 = ways: ab, ac, be. If letters can be repeated, then we add the pairs aa. bb. cc and have 
six combinations. Thus, a combination of different particles differs from a permutation in 
that their order does not matter. Combinations occur with repetition (the mathematician’s 
way of treating indistinguishable objects) and without, where no two sets contain the same 
particles. 

The number of different combinations of n particles. A: at a time and without repetitions, 
is given by the binomial coefficient 

n (n — 1) • • • (n — k + 1) /n \ 

k\ ~~ U/ ' 

If repetition is allowed, then the number is 

m- 

In the number n\/(n — k)\ of permutations of n particles. A: at a time, we have to divide 
out the number A ! of permutations of the groups of k particles because their order does 
not matter in a combination. This proves the first claim. The second one is shown by 
mathematical induction. 

In statistical mechanics, we ask in how many ways we can put n particles in k boxes so 
that there will be «, (distinguishable) particles in the ith box, without regard to order in 
each box, with \ n i — n ■ Counting as before, there are n choices for selecting the first 
particle, n — 1 for picking the second, etc., but the n \! permutations within the first box are 
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discounted, and permutations within the second box are disregarded, etc. Therefore the 
number of combinations is 


n! 

n\\ri2\ ■ ■ ■nk\ ’ 


n\ + «2 H-h nk = n. 


In statistical mechanics, particles that obey 


• Maxwell-Boltzmann (MB) statistics are distinguishable, without restriction on their 
number in each state; 

• Bose-Einstein (BE) statistics are indistinguishable, with no restriction on the number 
of particles in each quantum state; 

• Fermi-Dirac (FD) statistics are indistinguishable, with at most one particle per state. 


For example, putting three particles in four boxes, there are 4 3 equally likely arrangements 
for the MB case, because each particle can be put into any box in four ways, giving a total of 
4 3 choices. For BE statistics, the number of combinations with repetitions is ( 3+ 3 _1 ) = ( 3 ) 
for the Bose-Einstein case. For FD statistics, it is ( 3 ^*) = ( 3 ). More generally, for MB 
statistics the number of distinct arrangements of n particles among k states (boxes) is k ", 
for BE statistics it is (" + ^ -1 ), and for FD statistics it is . 


Exercises 

19.1.1 A card is drawn from a shuffled deck, (a) What is the probability that it is black, (b) a 
red nine, (c) or a queen of spades? 

19.1.2 Find the probability of drawing two kings from a shuffled deck of cards (a) if the first 

card is put back before the second is drawn, and (b) if the first card is not put back after 

being drawn. 

19.1.3 When two fair dice are thrown, what is the probability of (a) observing a number less 

than 4 or (b) a number greater than or equal to 4 but less than 6 ? 

19.1.4 Rolling three fair dice, what is the probability of obtaining six points? 

19.1.5 Determine the probability P(A D B IT C) in terms of P(A), P(B ), P(C), etc. 

19.1.6 Determine directly or by mathematical induction the probability of a distribution of A 
(Maxwell-Boltzmann) particles in k boxes with /V] in box 1, Ni in box 2,.... in 

the /:th box for any numbers Nj > 1 with A) + N 2 H-h At = A, k < A. Repeat this 

for Fermi-Dirac and Bose-Einstein particles. 

19.1.7 Show that P(AU B U C) = P(A) + P(B ) + P(C) - P (AD B) - P (A PC) 

- P(BPC) + P(APBPC). 

19.1.8 Determine the probability that a positive integer n < 100 is divisible by a prime number 
p < 100. Verify your result for p — 3,5, 7. 

19.1.9 Put two particles obeying Maxwell-Boltzmann (Fermi-Dirac, or Bose-Einstein) statis¬ 
tics in three boxes. How many ways are there in each case? 
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19.2 Random Variables 

Each time we toss a die, we give the trial a number i = 1,2,... and observe the point 
Xj = 1, or 2, 3, 4, 5, 6 with probability 1/6. If i denotes the trial number, then x; is a 
discrete random variable that takes the discrete values from 1 to 6 with a definite probability 
P{xd= 1/6. 


Example 19.2.1 discrete random variable 


If we toss two dice and record the sum of the points shown in each trial, then this sum is 
also a discrete random variable, which takes on the value 2 when both dice show 1 with 
probability (1/6) 2 ; the value 3 when one die has 1 and the other 2, hence with proba¬ 
bility (1/6) 2 + (1/6) 2 = 1/18; the value 4 when both dice have 2 or one has 1 and the 
other 3, so with probability (1 /6) 2 + (1/6) 2 + (1/6) 2 = 1/12; the value 5 with probability 
4(l/6) 2 = 1/9; the value 6 with probability 5/36; the value 7 with the maximum proba¬ 
bility, 6(l/6) 2 = 1/6; up to the value 12 when both dice show 6 points with probability 
(1/6) 2 . This probability distribution is symmetric about 7. This symmetry is obvious from 
Fig. 19.3 and becomes visible algebraically when we write the rising and falling linear 
parts as 


P(x) = 
P(.x) = 

In summary, then. 


1 _ 6 - (7 - x) 
36 ’ 

6 + (7 - x ) 


36 

13-x 


36 


36 


x — 2,3,... ,1, 
x = 7,8,..., 12. 


• The different values x; that a random variable X assumes denote and distinguish the 
events in the sample space of an experiment; each event occurs by chance with a prob- 


P(x) 


6 _ 

36 

_5_ 

36 

36 

3 ^ 

36 

_ 2 _ 

36 

J_ 

36 


0 



J_L 

4 5 



10 11 


12 


Figure 19.3 Probability distribution P(x) of the sum of points when two 

dice are tossed. 
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ability P(X — x ( ) = /;, > 0 that is a function of the random variable X. A random 
variable X (e/) = Xj is defined on the sample space, that is, for the events e, e S. 

• We define the probability density f(x) of a continuous random variable X as 

P(x < X < x + dx) = f{x)dx\ (19.9) 

that is, f(x)dx is the probability that X lies in the interval x < X < x + dx. For 
f(x ) to be a probability density, it has to satisfy fix ) > 0 and f fix) dx — 1. The 
generalization to probability distributions depending on several random variables is 
straightforward. Quantum physics abounds in examples. 


Example 19.2.2 Continuous Random Variable: Hydrogen Atom 


Quantum mechanics gives the probability | r/r | 2 d 3 r of finding a I s electron in a hydrogen 
atom in volume 3 d 3 r, where i// = Ne~ r ^ a is the wave function that is normalized to 

1 = J \\js\ 2 dV — 4-jt N 2 J e~ 2r ^ a r 2 dr = na 3 N 2 , dV — r 2 dr d cos 9 dcp 

being the volume element and a the Bohr radius. The radial integral is found by repeated 
integration by parts or by rescaling it to the gamma function 



e ~ 2r l a r 2 dr 



v o u a 

e x x~ dx — — T(3) = —. 

8 4 


Here all points in space constitute the sample and represent three random variables, but 
the probability density \iJ/\ 2 in this case depends only on the radial variable because of the 
spherical symmetry of the 1 s state. 

A measure for the size of the H atom is given by the average radial distance of the elec¬ 
tron from the proton at the center, which in quantum mechanics is called the expectation 
value: 

/ poo 3 

r\fr\ 2 dV = 4 jtN 2 J re~ 2 '^ a r 2 dr = -a. 

We shall define this concept for arbitrary probability distributions shortly. ■ 


• A random variable that takes only discrete values x\,X 2 ,. ■ ■ ,x n with probabilities 

pi, p 2 ,..., p n , respectively, is called a discrete random variable, so ^T ( = 1. If an 

“experiment” or trial is performed, some outcome must occur, with unit probability. 

• If the values comprise a continuous range of values a < x < b, then we deal with 
a continuous random variable, whose probability distribution may or may not be a 
continuous function as well. 


3 Note that |i/r|~47rr 2 dr gives the probability for the electron to be found between r and r + dr, at any angle. 
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When we measure a quantity x n times, obtaining the values Xj , we define the average 
value 

1 " 

x =-J'x j (19.10) 

j= 1 

of the trials, also called the mean or expectation value, where this formula assumes that 
every observed value Xj is equally likely and occurs with probability 1 /n. This connection 
is the key link of experimental data with probability theory. This observation and practical 
experience suggest defining the mean value for a discrete random variable X as 

(X) = J2 X ‘Pi (19.11) 

i 


and that for a continuous random variable characterized by probability density f(x) as 


w = 


J xf (x)dx. 


(19.12) 


These are linear averages. Other notations in the literature are X and E(X). 

The use of the arithmetic mean x of n measurements as the average value is suggested 
by simplicity and plain experience, assuming equal probability for each x\ again. But why 
do we not consider the geometric mean 

x g = (x i-x 2 . X n ) 1/n (19.13) 

or the harmonic mean x/, determined by the relation 

-) (19.14) 

or that value x that minimizes the sum of absolute deviations \x, — Jt|? Here the Xj are 
taken to increase monotonically. When we plot O(x) — \ x > ~~ x \’ as i n Fig- 19.4a, 

for an odd number of points, we realize that it has a minimum at its central value i — n. 


Xh n \x\ x\ 




Figure 19.4 (a) |x,- — x\ for an odd 

number of points; (b) |x,- — x\ for an even 

number of points. 
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while for an even number of points E(x) — YLi'h \ x i — x| is flat in its central region, as 
shown in Fig. 19.4b. These properties make these functions unacceptable for determining 
average values. Instead, when we minimize the sum of quadratic deviations. 


■ Xj)~ — minimum, 


(19.15) 


setting the derivative equal to zero yields 2 JT (x — x,) = 0 , or 

x = - y^Xi = x, 
i 

that is, the arithmetic mean. It has another important property: If we denote by Vj = Xj — x 
the deviations, then JT v,- = 0 , that is, the sum of positive deviations equals the sum of 
negative deviations. This principle of minimizing the quadratic sum of deviations, called 
the method of least squares, is due to C. F. Gauss, among others. 

How close a fit of the mean value to a set of data points is depends on the spread of the 
individual measurements from this mean. Again, we reject the average sum of deviations 
t \ x i ~ x \/ n as a measure of the spread because it selects the central measurement 
as the best value for no good reason. A more appropriate definition of the spread is the 
average of the deviations from the mean, squared, or standard deviation 


1 " 

= -y>-i) 2 , 

n ‘ J 


where the square root is motivated by dimensional analysis. 


Example 19 . 2.3 Standard Deviation of Measurements 

From the measurements x\ = 7, X 2 = 9, xj = 10, X4 =11, X5 = 13 we extract x = 10 
for the mean value and a = V(9 + 1 + 1 + 9)/4 = 2.2361 for the standard deviation, or 
spread, using the experimental formula (19.2) because the probabilities are not known. ■ 

There is yet another interpretation of the standard variation, in terms of the sum of 
squares of measurement differences 

- Xk) 2 — ^ ^ ^2( x f + x l ~ 2 XjXk) 

i <k i =1 ^=1 

= \(2n 2 [x 2 )-2n 2 {x) 2 )=n 2 o 2 , (19.16) 

because by multiplying out the square in the definition of a 2 we obtain 

o’ 2 = - Y] i x ‘ ~ M) 2 - ~ y 2 x i ~ ~^~y ~]xj + (x) 2 

n L —^ n L —^ n L —^ 

i 1 1 

= -y]x 2 -(x ) 2 = (x 2 )-(x> 2 . (19.17) 

n z —' 
i 

This formula is often used and widely applied for a 2 . 
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Now we are ready to generalize the spread in a set of n measurements with equal prob¬ 
ability \/n to the variance of an arbitrary probability distribution. For a discrete random 
variable X with probabilities p, at X — Xj we define the variance 

a 2 = Y,{xj-{X)f Pj , (19.18) 


and similarly for a continuous probability distribution 


a 


2 



(* - {X)) 2 f(x)dx. 


These definitions imply the following. 


(19.19) 


THEOREM: If a random variable Y — aX + b is linearly related to X, then we can imme¬ 
diately derive the mean value (Y) — a(X) + b and variance cr 2 (Y ) = a 2 a 2 (X) from these 
definitions. 


We prove this theorem only for a continuous distribution and leave the case of a discrete 
random variable as an exercise for the reader. For the infinitesimal probability we know 
that f(x) dx = g(y) dy with y = ax + b , because the linear transformation has to preserve 
probability, so 

/ OO POO 

yg(y)dy= 1 (ax + b)f(x) dx — a(X) + b, 

-oo J — OO 

since / f(x) dx — 1. For the variance we similarly obtain 

/ OO P OO 

{y- (Y)) 2 g(y)dy= / (ax + b - a(X) - b) 2 f(x)dx 

-OO J —OO 

= a 2 o 2 (X) 


after substituting our result for the mean value ( Y ). 

Finally we prove the general Chebychev inequality 

p(\x-{X)\>ka)<^, (19.20) 

which demonstrates why the standard deviation serves as a measure of the spread of an 
arbitrary probability distribution from its mean value (X) and shows why experimental or 
other data are often characterized according to their spread in numbers of standard devia¬ 
tions. We first show the simpler inequality 

(Y) 

P(Y > K)< — 

K 

for a continuous random variable Y whose values y > 0. (The proof for a discrete random 
variable follows along similar lines.) This inequality follows from 

POO P K POO 

(Y)= yf(y)dy= yf (y) dy + / yf(y)dy 

Jo Jo Jk 

POO POO 

>/ yf(y)dy>K f(y)dy — KP(Y > K). 

Jk Jk 
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Next we apply the same method to the positive variance integral 


= J (x - {X)) 2 f(x)dx 

f 

J h 


>-l 


(-* - (X)) 2 f(x)dx 


>k 2 a 2 


>\x-(X)\>k<j 


\x-(X)\>ko 
f(x)dx — k 2 o 2 P[\x — (X>| > ka), 


decreasing the right-hand side first by omitting the part of the positive integral with 
\x — (X}| < ka and then again by replacing (x — ( X}) 2 in the remaining integral by its 
lowest limit, k 2 a 2 . This proves the Chebychev inequality. For k — 3 we have the conven¬ 
tional three-standard-deviation estimate 


P(\x~(X)\>3ct)< 1 -. 


(19.21) 


It is straightforward to generalize the mean value to higher moments of probability dis¬ 
tributions relative to the mean value (X): 


«x-m)‘) = £ (xj — (X)) k pj, discrete distribution. 


(19.22) 


, r °° , 

((X — (X)) )= / (v — (X)) f(x)dx, continuous distribution. 

J —OO 


The moment-generating function 

r t 2 

[e ,X ) = J e tx f(x)dx = l+t(X)+-(X 2 )+■■■ (19.23) 

is a weighted sum of the moments of the continuous random variable X upon substituting 
the Taylor expansion of the exponential functions. So (X) = ' dt ' | f _ Q . Notice that the 
moments here are not relative to the expectation value; they are called central moments. 

^nigtXs | 

The nth central moment, (X' 1 ) = dt „ ' | Q , is given by the nth derivative of the moment¬ 
generating function at t — 0. By a change of the parameter t -* it the moment-generating 
function is related to the characteristic function ( e ,tX ), which is the often-used Fourier 
transform of the probability density fix). 

Moreover, mean values, moments, and variance can be defined similarly for probability 
distributions that depend on several random variables. For simplicity, let us restrict our 
attention to two continuous random variables X , Y and list the corresponding quantities; 


<*> 

(Y) 

a 2 (X) 

cr 2 (Y) 




xf(x, y)dxdy, 
yf(x , y) dx dy, 

(x - (X)) 2 fix,y)dxdy, 
(}’ ~ {Y}) 2 fix, y)dxdy. 


(19.24) 


(19.25) 
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Two random variables are said to be independent if the probability density f(x, y ) 
factorizes into a product ,f(x)g(y) of probability distributions of one random variable 
each. 

The covariance, defined as 

cov(X 7) = {{X - (X))(Y - (F»), (19.26) 

is a measure of how much the random variables X, Y are correlated (or related): It is zero 
for independent random variables because 

cov(X, r) - / (* - {X))(y - {Y))f(x,y)dxdy 

= J (x-(X))f(x)dx J (y — {Y))g(y)dy = ({X) — (2f})((7) — (T)) = 0 . 

The normalized covariance , which has values between — 1 and +1, is often called 

correlation. 

In order to demonstrate that the correlation is bounded by 

cov(X, Y) 

-1 <---< 1 

^ a(X)a(Y) ~ 

we analyze the positive mean value 

Q = ([u(X-(X)) + v{Y-(Y))f) 

= « 2 {[X - (X)f) + 2« v{[X - {X)][Y - (7)]) + tr([7 - (Y)f) 

— u 2 cr(X) 2 + 2uvco\(X, Y) + v 2 o(Y) 2 > 0, (19.27) 

where u, v are numbers, not functions. For this quadratic form to be nonnegative, its dis¬ 
criminant must obey cov( A", Y) 2 — a(X) 2 cr(Y) 2 < 0, which proves the desired inequality. 

The usefulness of the correlation as a quantitative measure is emphasized by the follow¬ 
ing. 

THEOREM: P(Y = aX + b) = 1 is valid if, and only if, the correlation is equal to ±1. 

This theorem states that a ±100% correlation between X, Y implies not only some func¬ 
tional relation between both random variables but also a linear relation between them. We 
denote by (B\A) the expectation value of the conditional probability distribution Pdf A). 

To prove this strong correlation property, we apply Bayes’ decomposition law 
(Eq. (19.8)) to the mean value and variance of the random variable 7, assuming first that 
P(Y = aX + b) = 1, so P(Y f:aX + b) = 0. This yields 

(7) = P(Y = aX + b)(Y\Y = aX + b) 

± P(Y^aX + b){Y\Y f^aX + b) 

= (aX ± b) =a{X) + b, 

ct(7) 2 = P(Y =aX + b)([Y - (7)f|7 = aX + b) 

+ P(Y^aX + b)([Y-(Y)f\Y^aX + b) 

= [[aX + b- (7)] 2 ) = ( a 2 [X - {X)f) = a 2 a(X) 2 , 
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substituting ( Y) = a(X) + b. Similarly we obtain cov(W, Y) = cro(X) 2 . These results 
show that the correlation is ± 1. 

Conversely, we start from co v{X,Y) 2 — a{X) 2 a{Y) 2 . Hence the quadratic form in 
Eq. (19.27) must be zero for (practically) all x for some (mo, i’o) ^ (0, 0): 

([ M o(2f — {X)) + u 0 (T — (T>)] 2 ) = 0. 

Because the argument of this mean value is positive definite, this relationship is satisfied 
only if P(uo(X — (X)) + i>o(T — (F» = 0) = 1, which means that Y and X are linearly 
related. 

When we integrate out one random variable, we are left with the probability distribution 
of the other random variable, 


F(x) = J f(x,y)dy, or G(y) = J f(x, y) dx, (19.28) 

and analogously for discrete probability distributions. When one or more random variables 
are integrated out, the remaining probability distribution is called marginal, motivated 
by the geometric aspects of projection. It is straightforward to show that these marginal 
distributions satisfy all the requirements of properly normalized probability distributions. 

If we are interested in the distribution of the random variable X for a definite value y = 
yo of the other random variable, then we deal with a conditional probability distribution 
P(X = x\Y — yo). The corresponding continuous probability density is f(x , yo). 


Example 19 . 2.4 Repeated Draws OF Cards 

When we draw cards repeatedly, we shuffle the deck often because we want to make sure 
these events stay independent. So we draw the first card at random from a bridge deck 
containing 52 cards and then put it back at a random place. Now we repeat the process for 
a second card. Then the deck is reshuffled, etc. We now define the random variables 

• X — number of so-called honors, that is, 10s, jacks, queens, kings, or aces; 

• Y — number of 2s or 3s. 

In a single draw the probability of a 10 to an ace is a = 5 ■ 4/52 = 5/13, and b — 
2 • 4/52 = 2/13 for two or three to be drawn and c — (13 — 5 — 2)/13 = 6/13 for anything 
else, with a + b + c = 1 . 

In two drawings X and Y can be x = 0 = y, when no 10 to ace show up or 2 or 3. This 
case has probability c 2 . In general X , Y have the values 0, 1, and 2, so 0 < x + y < 2 
because we will have drawn two cards. The probability function of (X = x, Y — y) is 
given by the product of the probabilities of the three possibilities a x , b y , c 2 ~ x ~ y times the 
number of distributions (or permutations) of two cards over the three cases with probabil¬ 
ities a , b , c, which is 2!/[x!y!(2 — x — y)!]. This number is the coefficient of the power 
a x b y c 2 ~ x ~ y in the generalized binomial expansion of all possibilities in two drawings with 
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probability 1: 


1 = (a + b + c) 2 — Y, 


2 ! 


0<x+y<2 


x!y!(2 — x — y)\ 


r x b y c 2 ~ x ~ y 


— a 2 + b 2 + c 2 + 2 (ab + ac + be). 

Hence the probability distribution of our discrete random variables is given by 


(19.29) 


f {X — x,Y = y) = 


2 ! 


> f ' I i 


2—x—y 


or more explicitly as 


x\y\(2-x-yy.\l3J \13J \13 
x, y = 0,1,2; 0 < x + y < 2, 


5 6 60 

f( 1,0) = 2-= —r, 

7 13 13 13 2 

2 6 24 

/(0, i) = 2— — = y^2 , 
/( 1 , 1 ) = 2 —• — = —y. 

7 13 13 13 2 


(19.30) 


/(0 ’ 0) = 'l3. 

i 5 \ 2 
. 2 \ 2 

/(°. 2 ) = ) —) , 


The probability distribution is properly normalized according to Eq. (19.29). Its expecta¬ 
tion values are given by 

(X)= y xf{x, y) = /(l, 0) + f{\, 1) + 2/(2,0) 

0<x+y<2 


60 20 
13 2 + 13 2 


5V 130 10 


21 — I = 


13/ 13 2 13 


= — = 2a. 


and 


(Y)= y yf(x, y) = /(o, l) + /(i, l) + 2/(0,2) 

0<a:+v<2 


24 20 


13 2 13 2 


— T^T + T ^+ 2 ~ ~ 


13 


52 


13 2 13 


as expected because we are drawing a card two times. The variances are 
a 2 (X)= y (x- f(x,y) 


0<x+y<2 
2 


= (i?) [fW’W + fW’V + fW’V] 


13 


[/(TO) + /(!,!)] 


/( 2 , 0 ) 


10 z • 64 + 3“ • 80 + 16 2 • 5 2 4 Z • 5 • 169 80 


13 4 


13 4 


13 2 ’ 



19.2 Random Variables 


1125 


-m= (y- n) f{x ’ y) 

0<x+y<2y ' 


= [/(0,0) + /(l, 0) + /(2,0)] 

+ (n) 2 [ /<0, " +/(1, ')] + (§) 2/<0 ' 2> 


4 2 • 11 2 + 9 2 • 44 + 22 2 • 2 2 
13 4 


11 - 4-169 
O 5 


It is reasonable that a 2 (Y ) < a 2 (X), because Y takes only two values, 2 and 3, while X 
varies over the five honors. The covariance is given by 

cov(X, Y) — (x- 

0<x+y<2 ' ' ^ ' 

_ 10-4 6 2 10-9 24 10-22 4 3-4 60 

~~ 13 2 ’ 13 2 _ 13 2 ’ 13 2 13^ ' 13 2 ~~ T3 2 ’ 13 2 

3-9 20 16-4 5 2 _ 20-169 _ 20 

+ T3 2 ' 13 2 _ 13 2 ' 13 2 _ l¥~~~ 13 2 ' 


20 • 169 
13 4 


Therefore the correlation of the random variables X , Y is given by 

cov(z, y) 20 1 rr 

o(X)g(Y) sV^TT 2V 11 ’ 

which means that there is a small (negative) correlation between these random variables, 
because if a card is an honor it cannot be a 2 or a 3, and vice versa. 

Finally, let us determine the marginal distribution: 


F(X = x) = f(x,y), 

y =0 


or explicitly 


F( 0) = /(0,0) + /(0,1) + /(0, 2 ) = J + 

60 20 80 

F(1) =/(1.0)+ /(!,!) = TP + TP = TP , 


F(2) — f ( 2 , 0 ) = I — 


which is properly normalized because 


(19.31) 


F(0) + F(l) + F{2) = 


64 + 80 + 25 
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Its mean value is given by 


(X) F = J^xFix) = F{\) + 2F{2) = 


80 


x=0 


f 2 • 25 130 10 

132 _ T 32 _ 13 _ '’ 


and its variance 



From the definitions it follows that these results hold generally. ■ 

Finally we address the transformation of two random variables X, Y into U(X,Y), 
V(X, Y). We treat the continuous case, leaving the discrete case, as an exercise. If 


u — u(x,y ), v = v(x,y)\ x = x(u,v), y = y(u,v ) (19.32) 


describe the transformation and its inverse, then the probability stays invariant and the 
integral of the density transforms according to the rules of Jacobians of Chapter 2, so the 
transformed probability density becomes 


with the Jacobian 


g(u, v ) = f{x(u, v),y(u, v))\J 


J = 


d(x,y) 
3 (u, v) 


, y(u 

, v] 

dx 

dx 

d u 

dv 


dy 

du 

dv 


(19.33) 


(19.34) 


Example 19 . 2.5 Sum, Product, and Ratio of Random Variables 

Let us consider three examples. (1) The sum Z = X + Y, where the transformation may 
be taken to be 

r 1 1 

x=x, Z = * + y, /= o ! , 

using 

9r _ J 9(z -y) _ l _o 3(z - x) _ 1 

3 t ’ 3 z ’ dx ’ 3 z 

so the probability is given by 

/ Z r 00 

/ f(x,z-x)dxdz. (19.35) 

-OO J —OO 

If the random variables X, Y are independent with densities f\, f 2 , then 

/ Z n OO 

/ 

-OO J — OO 


f\ (x) f 2 (z - X) dx dz. 


(19.36) 
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(2) The product / — XY, taking X, Z as the new variables, leads to the Jacobian 


J = 


1 

x ’ 


using 


dx 

dx 

so the probability is given by 


9(f) _ 1 

dz y ’ 




8t|) = I 

dz X ’ 


/ Z n OO 

-oo J - 


F(Z) = 


/( x, -\^-dz. 


—oo J —oo 


X \X 


If the random variables X , F are independent with densities fa, fa, then 


Z poo 


f(Z) = 


a 


, z\dx 


(3) The ratio Z = y-, taking T, Z as the new variables, has the Jacobian 


using 


9(yz) 

9y 


= z, 


/ = 


9(yz ) 

dz 


z y 

1 o 


= y> 


-y, 




9y 


^ = o, 

dz 


so the probability is given by 


Z roo 


F(Z) = 


-j j 


f(yz,y)\y\dydz. 


-oo J —OO 

If the random variables X, Y are independent with densities fa, fa, then 

r* Z 


F(Z) = 


=/ 7 

J —oo J —oo 


fa(yz)fa(y)\y\dydz. 


(19.37) 


(19.38) 


(19.39) 


(19.40) 


Exercises 

19.2.1 Show that adding a constant c to a random variable X changes the expectation value 
(X) by that same constant but not the variance. Show also that multiplying a random 
variable by a constant multiplies both the mean and variance by that constant. Show that 
the random variable X — (X) has mean value zero. 

19.2.2 If (X), (Y) are the average values of two independent random variables X, Y, what is 
the expectation value of the product X ■ F? 
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19.2.3 A velocity vj = Xj/tj is measured by recording the distances xj at the corresponding 
times t j. Show that xIt is a good approximation for the average velocity t>, provided all 
the errors \xj — x\ \x\ and \tj — t\ <?C |F| are small. 

19.2.4 Define the random variable Y in Example 19.2.4 as the number of 4s, 5s, 6 s, 7s, 8 s, or 
9s. Then determine the correlation of the X and Y random variables. 

19.2.5 If X and Y are two independent random variables with different probability densities 
and the function f(x, y ) has derivatives of any order, express (f(X, Y)) in terms of (X) 
and (Y). Develop similarly the covariance and correlation. 

19.2.6 Let f{x,y) be the joint probability density of two random variables X, Y. Find the 
variance a 2 (aX + bY), where a, b are constants. What happens when X , Y are inde¬ 
pendent? 

19.2.7 The probability that a particle of an ideal gas travels a small distance dx between col¬ 
lisions is dx , where / is the constant mean free path. Verify that / is the aver¬ 

age distance between collisions, and determine the probability of a free path of length 
/ > -V. 

19.2.8 Determine the probability density for a particle in simple harmonic motion in the inter¬ 
val —A <x<A. 

Hint. The probability that the particle is between x and x + dx is proportional to the 
time it takes to travel across the interval. 


19.3 Binomial Distribution 


Example 19.3.1 Repeated Tosses of Dice 


What is the probability of three 6s in four tosses, all trials being independent? Getting one 
6 in a single toss of a fair die has probability « = 1/6, and anything else has probability 
b — 5/6 with a + b — 1. Let the random variable X = x be the number of 6s. In four 
tosses, 0 < x < 4. The probability distribution f(X) is given by the product of the two 
possibilities, a x and £> 4-x , times the number of combinations of four tosses over the two 
cases with probabilities a , b. This number is the coefficient of the power a x b 4 ~ x in the 
binomial expansion of all possibilities in four tosses with probability 1: 


1 = (g + b) 4 — 


4! 


,A-x 


x=0 


x!(4 — t)! 


= a 4 + b 4 + Acr'b + 4 ab 3 + 6 a 2 b 2 . 


(19.41) 


Hence the probability distribution of our discrete random variable is given by 

4! 


f(X = x) = 


x\(4 — x)\ 


a x b A ~ x , 


0 < x < 4, 


or more explicitly 

/(0) = fe 4 , / (1) = 4ab 2 , f (2) = 6a 2 b 2 , /(3)=4a 3 6, /(4) = a 4 . 
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The probability distribution is properly normalized according to Eq. (19.41). The proba¬ 
bility of three 6s in four tosses is 


4a 3 £ = 4 


5/6 

6 3 


5 

4 • 3 4 ’ 


fairly small. 


This case dealt with repeated independent trials, each with two possible outcomes of 
constant probability p for a hit and q = 1 — p for a miss, and it is typical of many ap¬ 
plications, such as defective products, hits or misses of a target, and decays of radioactive 
atoms. The generalization to X = x successes in n trials is given by the binomial proba¬ 
bility distribution 

f(X = x) = xl( "[ x)[ P x q n ~ x = QpW‘- X , (19-42) 

using the binomial coefficients (see Chapter 5). This distribution is normalized to the prob¬ 
ability 1 of all possibilities in n trials, as can be seen from the binomial expansion 

1 = (p + q) n — p n + np n ] q 4- \-npq"~ l + q n . (19.43) 


Figure 19.5 shows typical histograms. The random variable X takes the values 0, 1,2 
in discrete steps and can also be viewed as a composition JT Xj of n independent random 
variables Xj, one for each trial, that have the value 0 for a miss and 1 for a hit. This 
observation allows us to employ the moment-generating functions 

(e rX ‘) = P(Xj = 0) + e'P(Xi = 1) = q + pe' (19.44) 

and 


[e ,X ) = Y\[e tXi ) = {pe‘ +qf, 

i 


(19.45) 


f(x = n) 



Figure 19.5 Binomial probability distributions 
for n — 20 and p — 0.1,0.3,0.5. 
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from which the mean values and higher moments can be read off upon differentiating and 
setting t = 0. Using 

d{e ,x ) tl t , \n-1 

—— = npe [pe + q) 


dt lr=( 


= {X} — 7>/Qr,-) = np , 


9 ^ ^ = npe‘(pe 1 + q) n 1 + n(n - l)p 2 e 2, (pe‘ + q) n 2 , 


d 2 {e tX ) 


dt 2 lt=( 


= J2 x if(xi) = np + n(n - 1 )p 2 


we obtain, with Eq. (19.17), 

o 2 {X) ={X 2 )- {X) 2 = np + n(n - 1 )p 2 -n 2 p 2 
= np(l — p) —npq. 


(19.46) 


Figure 19.5 illustrates these results with peaks at x = np — 2,6,10, which widen with 
increasing p. 


Exercises 

19.3.1 Show that the variable X — x number of heads in n coin tosses is a random variable, 
and determine its probability distribution. Describe the sample space. What are its mean 
value, the variance, and the standard deviation? Plot the probability function f(x) = 
n\/(x\(n — x)!2") for n — 10,20, 30 using graphical software. 

19.3.2 Plot the binomial probability function for the probabilities p = 1/6, q — 5/6 and n = 6 
throws of a die. 

19.3.3 A hardware company knows that the probability of mass-producing nails includes a 
small probability p — 0.03 of defective nails (without a sharp tip usually). What is the 
probability of finding more than two defective nails in its commercial box of 100 nails? 

19.3.4 Four cards are drawn from a shuffled bridge deck. What is the probability that they are 
all red? that they are all hearts? that they are honors? Compare the probabilities when 
the cards are put back at random places, or not. 

19.3.5 Show that for the binomial distribution of Eq. (19.42) the most probable value of x is 
np. 


19.4 Poisson Distribution 

The Poisson distribution typically occurs in situations involving an event repeated at a 
constant rate of probability, thereby depleting the population. The decay of a radioactive 
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sample is a case in point because, once a particle decays, it does not decay again. If the 
observation time dt is small enough so that the emission of two or more particles is neg¬ 
ligible, then the probability that one particle (He 4 in a decay or an electron in /3 decay) is 
emitted is n dt with constant // and /i d r <<C 1 - We can set up a recursion relation for the 
probability P„(t) of observing n counts during a time interval t. For n > 0 the probability 
P n (t + dt) is composed of two mutually exclusive events that (i) n particles are emitted in 
the time t , none in dt, and (ii) n — 1 particles are emitted in time t, one in dt. Therefore 

P„(t + dt) = P n (t)Po(dt) + P n -i(t)Pi(dt). 


Here we substitute the probability of observing one particle, P\ (dt ) = // dt, and no particle, 
Po(dt) = 1 — P\ (dt), in time dt. This yields 


P n (t + dt) — P„(t)( 1 - /xdt) + P n -i(t)fjtdt. 


So, after rearranging and dividing by dt, we get 


dP n ( t) 

dt 


P„(t + dt) — P,,(t) 
dt 


= pPn-\{t) - pP n (t). 


(19.47) 


For n — 0 this differential recursion relation simplifies, because there is no particle in times 
t and dt giving 


dPp(t) 

dt 


-pPo(t)- 


(19.48) 


The ODE says that particles have a constant decay probability and decay removes them 
from the distribution. This ODE integrates to Po(t) = e~^‘ if the probability that no particle 
is emitted during a zero time interval Pq(0) — 1 is used. Here Pq(0) = 1 means no decay 
takes place at t < 0. 

Now we go back to Eq. (19.47) for n = 1, 

P\ = li(e^ llt - Pi), P\ (0) = 0, (19.49) 


and solve the homogeneous equation, which is the same for P\ as Eq. (19.48). This yields 
Pi(t) — /i i e~ llt . Then we solve the inhomogeneous ODE (Eq. (19.49)) by varying the 
constant /rj to find /xi = /x, so P\(t) — /ite^ ,lt . The general solution is 

(, fxt) n 

P n (t) = , (19.50) 

/?! 

as may be confirmed by substitution into Eq. (19.47) and verifying the initial conditions, 
P n (0) = 0, n > 0. This is an example of the Poisson distribution. 

The Poisson distribution is defined with the probabilities 

a" 

p(n)=—e-> 1 , X = n=0, 1,2,... (19.51) 

n! 

and is exhibited in Fig. 19.6. The random variable X is discrete. The probabilities are 
properly normalized because e~' 1 Y^Lo = 1 ■ The mean value and variance. 


(■ X)=e /i ^n^-=/xe ^ X! = 

‘ J fi J ‘ J n i 


n=1 


n=0 


n\ 


a 1 = (X 2 ) - (X) 2 = ni/i + 1 ) - n 2 = fi. 


( 19 . 52 ) 
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P (n) 



Figure 19.6 Poisson distribution 
compared with binomial distribution. 


follow from the characteristic function 

(X) 72 

„ilX\ \ ' Jtn—u.r*' 


e 


) = J2 e “ n -^=e-»J2 


( f ie i, ) n _ 


n=0 n=0 

by differentiation and setting t = 0, using Eq. (19.17). 

A Poisson distribution becomes a good approximation of the binomial distribution for a 
large number n of trials and small probability p ~ // / n , /x a constant. 


Theorem: /« f/ze limit n — >■ oo auc/ p-xOso that the mean value np —> pt stays finite, 
the binomial distribution becomes a Poisson distribution. 

To prove this theorem, we apply Stirling’s formula (Chapter 8) /?! ~ \j2jrn(n/e) n for 
large n to the factorials in Eq. (19.42), keeping x finite while n — > oo. This yields for 
n —> oo: 


n\ 

(n — jt )! 





n—x 



and for n —> oo, p -> 0, with np —► /x: 




0-v 


(1 - p) n ~ x 
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Table 19.1 


01 23456789 10 

57 203 383 525 532 408 273 139 45 27 16 


Finally, p x n x —*■ n x , so altogether 

u n ' ., p*a - P) n ~ x n -> 00 , (19.53) 

x\(n — x)\ x\ 

which is a Poisson distribution for the random variable X — x with 0 < x < oo. This limit 
theorem is a particular example of the laws of large numbers. 


Exercises 

19.4.1 Radioactive decays are governed by the Poisson distribution. In a Rutherford-Geiger 
experiment the number n, of emitted a particles is counted in n — 2608 time intervals 
of 7.5 seconds each. In Table 19.1 n, is the number of time intervals in which i particles 
were emitted. Determine the average number X of emitted particles, and compare the n, 
of Table 19.1 with np\ computed from the Poisson distribution with mean value X. 

19.4.2 Derive the standard deviation of a Poisson distribution of mean value /i . 

19.4.3 The number of a decay particles of a radium sample is counted per minute for 40 hours. 
The total number is 5000. How many 1-minute intervals are there expected to be with 
(a) 2, (b) 5 a particles? 

19.4.4 For a radioactive sample, 10 decays are counted on average in 100 seconds. Use the 
Poisson distribution to estimate the probability of counting 3 decays in 10 seconds. 

19.4.5 238 U has a half-life of 4.51 x 10 9 years. Its decay series ends with the stable lead isotope 
206pb | ( le ratio of the number of 206 Pb to 238 U atoms in a rock sample is measured as 
0.0058. Estimate the age of the rock assuming that all the lead in the rock is from the 
initial decay of the 238 U, which determines the rate of the entire decay process, because 
the subsequent steps take place far more rapidly. 

Hint. The decay constant X in the decay law N ( t) — Ne~ Xr is related to the half-life T 
by T — In 2 /X. 

ANS. 3.8 x 10 7 years. 

19.4.6 The probability of hitting a target in one shot is known to be 20%. If five shots are fired 
independently, what is the probability of striking the target at least once? 

19.4.7 A piece of uranium is known to contain the isotopes 2 |, U and 2 ||U as well as from 0.80 
g of 299 Pb per gram of uranium. Estimate the age of the piece (and thus Earth) in years. 
Hint. Assume the lead comes only from the 2 | 8 U. Use the decay constant from Exer¬ 
cise 19.4.5. 
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19.5 Gauss’ Normal Distribution 


The bell-shaped Gauss distribution is defined by the probability density 


/(*)= — 7X = ex P 
aV27 t 


[X - /r] 2 
2 er 2 


-oo < X < 00, 


(19.54) 


with mean value ji and variance a 2 . It is by far the most important continuous probability 
distribution and is displayed in Fig. 19.7. 


It is properly normalized because, substituting y = - , /i , we obtain 

(TV 2 


Ty/lTZ J- 


OO (x-IJL) 1 

e 2 a 2 dx — 


V* J-C 


e r dy = -?= 

) , 


e y dy=l. 


Similarly, substituting y = x — ji, we see that 


(X)-fl: 


x- IX _(£=#_ 

- r=e 2 (t 2 rf.y — 


f 00 y _ FL 
/ — 2 “ 2 = 0 ’ 
/ —OO (7 V27T 


the integrand being odd in y, so the integral over y > 0 cancels that over y < 0. Similarly 
we check that the standard deviation is a. 

From the normal distribution (by the substitution y = x ^' X) ) 


P(\X-{X)\>kcr) = P^ 


X-(X)\ 


v* A e 


k\=P(\Y\>k) 

- y2/2 dy = J^ r e 

V 7T J k U 2 


f°° _,2 k 

f e z dz = e rfc—=, 

k/s/2 V2 


/ 


i 



Figure 1 9.7 Normal Gauss distribution for mean value zero and various 
standard deviations h = 1 ja \fl. 
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we can evaluate the integral for k— 1,2, 3 and thus extract the following numerical rela¬ 
tions for a normally distributed random variable: 

P(|X - <X>| > er) ~ 0.3173, P(\X ~{X)\> 2 a) ~ 0.0455, 

P(|X- {X )| >3er) ~ 0.0027, (19.55) 

of which the last one is interesting to compare with Chebychev’s inequality (see 
Eq. (19.21).) giving <1/9 for an arbitrary probability distribution instead of ~ 0.0027 
for the 3er-rule of the normal distribution. 


ADDITION THEOREM: If the random variables X , Y have the same normal distributions, 
that is, the same mean value and variance, then Z — X + Y has normal distribution with 
twice the mean value and twice the variance of X and Y. 


To prove this theorem, we take the Gauss density as 


fix) = 


1 


0 -*72 




with 


.L / e~ x2 ' 2 dx= 1, 

V 2,71 J—o o 


without loss of generality. Then the probability density of ( X , Y) is the product 


fix, y ) 




■ _ 


\Fhz \fljx 2.71 

Also, Eq. (17.36) gives the density for Z — X +Y as 


-(x 2 +v 2 )/2 


giz) = 


/ 


e -* 2 /2 2 -(- r -;) 2 /2 dx _ 

—oo v27 X v27T 


Completing the square in the exponent. 


2 .r 2 — 2xz + z 2 — [x\fl - +/-, 


we obtain 


giz) r/4 

2n 


£ 


exp 


V2 ) 


l) : 


dx. 


Using the substitution u = x — |, we find that the integral transforms into 




du — s/jr, 


so the density for Z = X + Y is 


giz) = 


1 c ~Z 2 /4 

2^/tt 


(19.56) 


which means it has mean value zero and variance 2, twice that of X and Y. 

In a special limit the discrete Poisson probability distribution is closely related to the 
continuous Gauss distribution. This limit theorem is another example of the laws of large 
numbers, which are often dominated by the bell-shaped normal distribution. 
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THEOREM: For large n and mean value p, the Poisson distribution approaches a Gauss 
distribution. 


To prove this theorem for n —>• oo, we approximate the factorial in the Poisson’s proba¬ 
bility p(n) of Eq. (19.51) by Stirling’s asymptotic formula (see Chapter 8 ), 


n! ~ V2mr(-\ , 


oo, 


and choose the deviation v — n — p from the mean value as the new variable. We let the 
mean value p -> oo and treat v/p as small but v 2 /p as finite. Substituting n = p + v and 
expanding the logarithm in a MacLaurin series, keeping two terms, we obtain 

In pin) — —p + n In p — n In n + n — In \f2nrc 

= (p + v) In p — (p + v) ln(/r + u) + v — In y/ 2n(p + v ) 

= (p + v) In ( 1-)+;.> — In y/li Tp 

V P + vJ 

= (M + v)f- - -+ v-ln yjlnp 

V P+V 2(p + v)-J 

- -In y/htp, 

2 p 


replacing p + v p because |i)| p. Exponentiating this result we find that for large n 
and p 


Pin) - 


„-r 2 / 


y/2n p 


(19.57) 


which is a Gauss distribution of the continuous variable v with mean value 0 and standard 
deviation o = ^fp. 

In a special limit the discrete binomial probability distribution is also closely related to 
the continuous Gauss distribution. This limit theorem is another example of the laws of 
large numbers. 


Theorem: In the limit n 00 , so that the mean value np -> 00 , the binomial distribu¬ 
tion becomes Gauss’ normal distribution. Recall from Section 19.4 that, when np —> p < 
00 , the binomial distribution becomes a Poisson distribution. 


Instead of the large number x of successes in n trials, we use the deviation v = x — pn 
from the (large) mean value pn as our new continuous random variable, under the condition 
that |i>| pn but 1 r/n is finite as n -> 00. Thus, we replace x by v + pn and n — x by 
qn — v in the factorials of Eq. (19.42), f(x) — > W(v) as n —> 00, and then apply Stirling’s 
formula. This yields 

„x n n—x„n+\/2 „—n+x+(n—x) 

W(v) = 1 --- - -. 

s/2ir(v + pn) x+l / 2 (qn — v) n 
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Here we factor out the dominant powers of n and cancel powers of p and q to find 


W(v) = 


1 


ypjtpqn 
In terms of the logarithm we have 

1 

In W(v) — In 


1 + — 

pn 


-(v+pn+l/ 2 ) 


1 - 

qn 


— (qn — v+1 /2) 


- (v + pn + 1/2) In I 1 H- 

pn 


■sjlnpqn 


(qn — v + 1 /2) In I 1- 

qn 


— In 


V 2jtpqn 


(v + pn + 


1/2) f— 


\pn 2p 2 n 2 


f v v L 

— (qn — u + 1/2) (- 

qn Zq-n z 


= In - 


1 


v ( 1 


1 


A fljtpqn \_n\2p 2 q) n \2p 2q 


where 


is finite and 


v v~ 

- 0 , — 

n n 


1 1 

2 p 2 q 


■q 


1 


2 pq 2 pq 

Neglecting higher orders in v/n, such as v 2 /p 2 n 2 and v 2 /q 2 n 2 , we find the large n limit 


W(v) = 


1 


+J2npqn 


— v 2 /2 pqn 


(19.58) 


which is a Gaussian distribution in the deviations x — pn, with mean value 0 and standard 
deviation a = y/npq. The large mean value pn (and the discarded terms) restricts the 
validity of the theorem to the central part of the Gaussian bell shape, excluding the tails. 


Exercises 

19.5.1 What is the probability for a normally distributed random variable to differ by more 
than 4(7 from its mean value? Compare your result with the corresponding one from 
Chebychev’s inequality. Explain the difference in your own words. 

19.5.2 Let X\, Xi,.,., X n be independent normal random variables with the same mean x and 
variance a 2 . Show that X 'J- n A is normal with mean zero and variance 1. 
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19 . 5.3 An instructor grades a final exam of a large undergraduate class, obtaining the mean 
value of points M and the variance a 2 . Assuming a normal distribution for the number 
M of points, he defines a grade F when M < m — 3<r/2, D when m — 3cr/2 < M < 
m — cr/2, C when m — a /2 < M < m + er/2, B when m + er/2 < M < m + 3a/2, 
A when M > in + 3ct/ 2. What is the percentage of As, Fs; Bs, Ds; Cs? Redesign the 
cutoffs so that there are equal percentages of As and Fs (5%), 25% Bs and Ds, and 
40% Cs. 

If the random variable X is normal with mean value 29 and standard deviation 3, what 
are the distributions of 2X — 1 and 3X + 2? 

For a normal distribution of mean value m and variance a 2 , find the distance r such that 
half the area under the bell shape is between m — r and m + r. 


19 . 5.4 

19 . 5.5 


19.6 Statistics 

In statistics, probability theory is applied to the evaluation of data from random experi¬ 
ments or to samples to test some hypothesis because the data have random fluctuations 
due to lack of complete control over the experimental conditions. Typically one attempts 
to estimate the mean value and variance of the distributions, from which the samples de¬ 
rive, and to generalize properties valid for a sample to the rest of the events at a prescised 
confidence level. Any assumption about an unknown probability distribution is called a 
statistical hypothesis. The concepts of tests and confidence intervals are among the most 
important developments of statistics. 


Error Propagation 


When we measure a quantity x repeatedly, obtaining the values xj at random, or select a 
sample for testing, we determine the mean value (see Eq. (19.10)) and the variance. 


x 



7 = 1 



- x ) 2 ’ 
j =i 


as a measure for the error, or spread from the mean value x. We can write xj—x + ej, 
where the error ej is the deviation from the mean value, and we know that ^ • ej — 0. (See 
the discussion after Eq. (19.15).) 

Now suppose we want to determine a known function fix) from these measurements; 
that is, we have a set fj — f(xj ) from the measurements of x. Substituting xj = x + ej 
and forming the mean value from 


/ = - X! f^ x + e f) 

j j 


= fix) + V(X)J> + ^/"(x) - 

j j 


= f(x)+ l -o 2 f"{x)3 -, 


(19.59) 
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we obtain the average value / as fix) in lowest order, as expected. But in second order 
there is a correction given by half the variance with a scale factor f"(x). It is interesting to 
compare this correction of the mean value with the average spread of individual /,• from 
the mean value /, the variance of /. To lowest order, this is given by the average of the 
sum of squares of the deviations, in which we approximate fj ~ / + f'ix)ej, yielding 

° 2 (f) s l - /> 2 = (z'w) 2 ^ E e2 j = (f'w) 2 ° 2 - ( 19 - 6 °) 

j j 

In summary we may formulate somewhat symbolically 

fix ±a) = fix) ± fix)o 


as the simplest form of error propagation by a function of one measured variable. 

For a function / (xj , yf) of two measured quantities xj = x+Uj, yu = y + Vk, we obtain 
similarly 


J r s J r s 

f = ~ E E fj* = — E E fix + Uj,y + V) t) 


7=1 k=\ 


j=lk=\ 


1 1 

= fix, y) + -fx2_ 11 j + ~fx v k ■ 
f s , 

J k 


where ^ . u j = 0 = 'f2 k Vk, so again / = fix, y) in lowest order. Here 

df 3/ 

fx = ^-ix,y), fy= ~X~ix, y) (19.61) 

ox ay 

denote partial derivatives. The sum of squares of the deviations from the mean value is 
given by 


E E ( /m - /> 2 =E'»//'+^/v) 2 

; = 1 <r+l j,k 


= s fxY. l,2 j + r fyH' 


because ■ k u j Vk — 12 j 11 j 12k v k = 0- Therefore the variance is 


= - E ( //* - /> 2 = f 2ff2 + f 2 ° 

rs y - 


j,k 


with f x , f y frornEq. (19.61); and 


: = ;E4 ^!e 


v\ 


(19.62) 


are the variances of the x and y data points. Symbolically the error propagation for a 
function of two measured variables may be summarized as 

fix ± a x , y ± (T y ) = fix, y) ± J f}a} + tfoj. 

As an application and generalization of the last result, we now calculate the error of 
the mean value x. — ^ 12j- i x j of a sample of n individual measurements xj, each with 
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spread a. In this case the partial derivatives are given by f x — ^ — f y = ■ ■ ■ and a x = a = 
<7y = • • • . Thus, our last error propagation rule tells us that errors of a sum of variables add 
quadratically, so the uncertainty of the arithmetic mean is given by 


1 

a — — 
n 




(19.63) 


decreasing with the number of measurements n. 

As the number n of measurements increases, we expect the arithmetic mean x to con¬ 
verge to some true value x. Let x differ from x by a and Vj — xj — x be the true deviations; 
then 


- *) 2 = 


+ na . 


Taking into account the error of the arithmetic mean, we determine the spread of the indi¬ 
vidual points about the unknown true mean value to be 

n • J ' n • ^ J 


According to our earlier discussion leading to Eq. (19.63), a 1 = -a 2 . As a result 


= ;X>? 


a 

n 


from which the standard deviation of a sample in statistics follows: 


l Y,j v ) _ Zjixj-x ) 2 


n — 1 


n — 1 


(19.64) 


with n — 1 being the number of control measurements of the sample. This modified mean 
etror includes the expected error in the arithmetic mean. 

Because the spread is not well defined when there is no comparison measurement, that 
is, when n = 1, the variance is sometimes defined by Eq. (19.64), in which we replace the 
number n of measurements by the number n — 1 of control measurements in statistics. 


Fitting Curves to Data 

Suppose we have a sample of measurements yj (for example, a particle moving freely, that 
is, no force) taken at known times tj (which are taken to be practically free of errors; that 
is, the time t is an ordinary independent variable) that we expect to be linearly related as 
y = at, our hypothesis. We want to fit this line to the data. 

First we minimize the sum of deviations — yj) 2 to determine the slope parame¬ 

ter a, also called the regression coefficient, using the method of least squares. Differenti¬ 
ating with respect to a we obtain 

2 ~ yfri =°> 
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.v 



Figure 19.8 Straight line fit to 
data points (tj, yj ) with tj 
known, v; measured. 


from which 




(19.65) 


follows. Note that the numerator is built like a sample covariance, the scalar product of the 
variables t, y of the sample. As shown in Fig. 19.8, the measured values v ; do not lie on 
the line as a rule. They have the spread (or root mean square deviation from the fitted line) 


T.j(yj-atj ) 2 
n — 1 


Alternatively, let the yj values be known (without error) while tj are measurements. As 
suggested by Fig. 19.9, in this case we need to interchange the role of t and v and to fit the 
line t = by to the data points. We minimize JA (byj — tj) 2 , set the derivative with respect 


,v 



Figure 19.9 Straight line fit to 
data points (tj, yj ) with yj 
known, tj measured. 
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y v 




Figure 19.10 (a) Straight line fit to data points (tj, yj). (b) Geometry of 

deviations Uj, vj, dj. 


to b equal to zero, and find similarly the slope parameter 


b — 


gz tjyj 

g jyj 


( 19.66) 


In case both tj and yj have errors (we take t and y to have the same units), we have to 
minimize the sum of squares of the deviations of both variables and fit to a parameterization 
t sin a — y cos a = 0, where t and y occur on an equal footing. As displayed in Fig. (19.10a) 
this means geometrically that the line has to be drawn so that the sum of the squares of the 
distances dj of the points (tj, yj) from the line becomes a minimum. (See Fig. 19.10b and 
Chapter 1.) Here dj = tj sin a — yj cos a, so f d 2 = minimum must be solved for the 
angle a. Setting the derivative with respect to the angle equal to zero. 


Y, (tj sin a — yj cos a) (tj cos a + yj sin a) = 0, 
j 


yields 


sin a cos a y^(r 2 — yj) — (cos 2 a — sin 2 a) tjyj — 0. 
j j 

Therefore the angle of the straight-line fit is given by 

2T /j t i y j 

tan 2ol — — 3 1 \ . (19.67) 

j-yP 

This least-squares fitting applies when the measurement errors are unknown. It allows as¬ 
signing at least some kind of error bar to the measured points. Recall that we did not use 
errors for the points. Our parameter a (or a) is most likely to reproduce the data under 
these circumstances. More precisely, the least-squares method is a maximum-likelihood 
estimate of the fitted parameters when it is reasonable to assume that the errors are in¬ 
dependent and normally distributed with the same deviation for all points. This fairly 
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strong assumption can be relaxed in “weighted” least-squares fits called chi square fits . 4 
(See also Example 19.6.1.) 


The x 2 Distribution 


This distribution is typically applied to fits of a curve y(t,a ,...) with parameters a,... 
to data tj using the method of least squares involving the weighted sum of squares of 
deviations; that is. 


X 


2 



yj — y(tj, a, ■■ ■) 
A Vj 


2 


is minimized, where N is the number of points and r is the number of adjusted parameters 
a,.... This quadratic merit function gives more weight to points with small measurement 
uncertainties Ay/. 

We represent each point by a normally distributed random variable X with zero mean 
value and variance a 2 — l, the latter in view of the weights in the y 2 function. In a first 
step, we determine the probability density for the random variable Y — X 2 of a single 
point that takes only positive values. Assuming a zero mean value is no loss of generality 
because, if (X) = m ^ 0, we would consider the shifted variable Y = X — m, whose mean 
value is zero. We show that if X has a Gauss normal density 

1 _ v 2/->_2 

f(x) =— r=e ' A —oo<x<oo, 


then the probability of the random variable Y is zero if y < 0, and 

P(Y <y)= P(X 2 < y) = P(-Vv < X < VX) if y > 0. 

From the continuous normal distribution P(y) — f l f(x)dx, we obtain the probability 
density g(y) by differentiation: 


g(y) = ^,[ p (Vy ) - p (~Vy)] = ^=(/(Vt) + f(~Vy )) 


i 


r-s/TjTy 


-y/2a z 


y > 0. 


(19.68) 


This density, ~ e y ^ 2a / s /y, corresponds to the integrand of the Euler integral of the 
gamma function. Such a probability distribution 


g(y) = 


T{p)(2a 2 )P 


e~y! 2 ° 2 


is called a gamma distribution with parameters p and a. Its characteristic function for 
our case, p — 1 /2, is proportional to the Fourier transform 


PY\ = 1 r e -y(i/^-it)dy_ = 1 r e ~x^_ 

aV2n Jo Vx — it) 1 ^ 2 Jo V* 

= (1—2 ita 2 y l/2 . 


4 For more details, see Chapter 14 of Press et al. in the Additional Readings of Chapter 9. 
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Since the x 2 sample function contains a sum of squares, we need the following theorem. 

ADDITION THEOREM: for the gamma distributions'. If the independent random variables 
Yi and Yi have a gamma distribution with p — 1 /2, and the same a then Y\ + Y 2 has a 
gamma distribution with p — 1. 

Since Y\ and Yi are independent, the product of their densities (Eq. (19.36)) generates 
the characteristic function 

[e it( ' Yl+Y2) ) = [e i,Yl e i,Y2 ) = [e i,Yl )[e i,Y2 )=(\-2ita 1 )~ l . (19.69) 


Now we come to the second step. We assess the quality of the fit by the random variable 
Y — Yl"j= 1 Xj, where n — N — r is the number of degrees of freedom for N data points 
and r fitted parameters. The independent random variables Xj are taken to be normally 
distributed with the (sample) variance a 2 . (In our case r = 1 and o = 1.) The y 2 analysis 
does not really test the assumptions of normality and independence, but if these are not 
approximately valid, there will be many outlying points in the fit. The addition theorem 
gives the probability density (Fig. 19.11) for F, 

n _ 1 

Sn O') = 2 n/2 (J n rr _ ) ^^ - F > 0, 

and g„ (y) = 0 if y < 0, which is the y 2 distribution corresponding to n degrees of freedom. 
Its characteristic function is 

[e ity ) = {l-2 ita 2 )~ n/2 . 

Differentiating and setting t — Owe obtain its mean value and variance 

(F> = no 2 , a 2 (Y) = 2no A . (19.70) 


dnly) 



gniy)- 
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Table 19.2 y 2 Distribution 


n 

OO 

© 

II 

t-- 

o 

II 

v = 0.5 

e 

II 

o 

u> 

<N 

o 

II 

s 

v = 0.1 

i 

0.064 

0.148 

0.455 

1.074 

1.642 

2.706 

2 

0.446 

0.713 

1.386 

2.408 

3.219 

4.605 

3 

1.005 

1.424 

2.366 

3.665 

4.642 

6.251 

4 

1.649 

2.195 

3.357 

4.878 

5.989 

7.779 

5 

2.343 

3.000 

4.351 

6.064 

7.289 

9.236 

6 

3.070 

3.828 

5.348 

7.231 

8.558 

10.645 


Entries are Xv for the probabilities v = P(x~ > Xv) = n —— f °° e > 7 ± 0 i/ 2 ) 1 f or = 1 . 

2 / r(n/2) ^Xu 


Tables give values for the y 2 probability for n degrees of freedom. 


P{x 2 > Jo) 


1 

2"/ 2 cr"r(|) 



y n / 2 ~ l e -y/ 2a2 


dy 


for er = 1 and yo > 0. To use Table 19.2 for a ^ 1, rescale yo = ooer 2 so that P(y 2 > i>o<r 2 ) 
corresponds to P(x 2 > t'o) of Table 19.2. The following example will illustrate the whole 
process. 


Example 19.6.1 


Let us apply the y 2 function to the fit in Fig. 19.8. The measured points ( tj , yj ± A yj) 
with errors Ayj are 

(1,0.8 ±0.1), (2,1.5 ±0.05), (3, 3 ±0.2). 

For comparison, the maximum-likelihood fit, Eq. (19.65), gives 
1-0.8 ±2-1.5 ±3-3 12.£ 


1 ± 4 ± 9 


14 


= 0.914. 


Minimizing instead. 


; =E 


yj - at j 

Ay: 


gives 


0= —= -2V 

da ^ 


<jlyi <"j> 
(Ay/) 2 


or 


E,- 


'jyj 

J (Av /) 2 


E, 


J (A yj ) 1 
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In our case 


IM + ?dA + , sns 

0.1 2 + 0,05- + 0.2 2 _ 1505 

Jl + _2i_ I Jl 1925 

n 1 2 i n n^2 ' 


= 0.782 


0 . 1 2 ^ 0 . 05 2 ^ 0 . 2 2 

is dominated by the middle point with the smallest error. Ay 2 = 0.05. The error propaga¬ 
tion formula (Eq. (19.62)) gives us the variance cr 2 of the estimate of a. 


da 




(Ay,) 2 


1 


(A »)' 


-) 2 J2- — 

> ^J (A yj) 


using 


da 

dyj 


(A yjY 


' k ( a_v a ,) 2 


For our case, o a — 1 /■%/1925 = 0.023; that is, our slope parameter is a = 0.782 ± 0.023. 

To estimate the quality of this fit of a, we compute the y 1 probability that the two 
independent (control) points miss the fit by two standard deviations; that is, on average each 
point misses by one standard deviation. We apply the / 2 distribution to the fit involving 
N — 3 data points and r = 1 parameter, that is, for n = 3—1=2 degrees of freedom. From 
Eq. (19.70) the y 2 distribution has a mean value 2 and a variance 4. A rule of thumb is that 
X 2 & n for a reasonably good fit. Then P(x 2 > 2) ~ 0.496 is read off Table 19.2, where 
we interpolate between P(x 2 > 1-386 2 ) = 0.50 and P(x 2 > 2.408 2 ) = 0.30 as follows: 


P(X 2 > 2) 


P( X 2 > 1-386 2 ) 


2 — 1.386 2 r , 
2.408 2 — 1.386 2 ^ X “ 


1.386 2 ) 


= 0.5 - 0.02 • 0.2 = 0.496. 


P( X 2 >2.408 2 )] 


Thus the / 2 probability that, on average, each point misses by one standard deviation is 
nearly 50% and fairly large. ■ 

Our next goal is to compute a confidence interval for the slope parameter of our fit. 
A confidence interval for an a priori unknown parameter of some distribution (for example, 
a determined by our fit) is an interval that contains a not with certainty but with a high 
probability p, the confidence level, which we can choose. Such an interval is computed for 
a given sample. Such an analysis involves the Student t distribution. 


The Student t Distribution 

Because we always compute the arithmetic mean of measured points, we now consider the 
sample function 
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where the random variables Xj are assumed independent with a normal distribution of 
the same mean value m and variance o 2 . The addition theorem for the Gauss distrib¬ 
ution tells us that X\ + ■■■ + X n has the mean value nm and variance no 2 . Therefore 
(Xi +-b X„)/n is normal with mean value m and variance no 2 /n 2 — o 2 /n. The prob¬ 

ability density of the variable X — m is the Gauss distribution 


fix - m) = 


■sfn 

o\[2tt 



n(x — m) 2 \ 

y 


(19.71) 


The key problem solved by the Student t distribution is to provide estimates for the mean 
value m, when a is not known, in terms of a sample function whose distribution is inde¬ 
pendent of a. To this end, we define a rescaled sample function (traditionally called) t : 


t 


X — m 
S 


Vn — 1, 


S 2 = -Y^{Xj-X) 2 . 
n L —' 


(19.72) 


It can be shown that t and S are independent random variables. Following the arguments 
leading to the y 2 distribution, the density of the denominator variable S is given by the 
gamma distribution 


d(s) = 


n (n-l)/2 s n-2 £ -ns 2 /2a 2 

2^T(^-)ct»- 1 


(19.73) 


The probability for the ratio Z = X/Y of two independent random variables X , Y with 
normal density for / and d as given by Eqs. (19.71) and (19.73) is (Eq. (19.40)) 

/ Z poo 

/ f(yz)d(y)\y\dydz, (19.74) 

-oo J—oo 


so the variable V — (X — m)/S has the density 

■s/ii 


r(v) = 


r 

Jo 


osflrc 
«"/ 2 


exp - 


nv 2 s 2 \if n -' L) l 2 s n - 2 e- nsl l 2al 


2o 2 


cr"V^2(”- 2 )/ 2 r(^) 

Here we substitute z = s 2 and obtain 

W 2 


hi 


2 5 2 1 r(^-)cr''- 1 

e -ns 2 (v 2 +l)/2a 2 s n-l ds _ 


-s ds 


n a poo 

r(v) =--- r / e- n ^ 2+1 V2* 2 z (»-2)l2 dZ ' 

cr»V)r2' , / 2 r(^) Jo 


cr"V7r2'‘/2r( V) 

Now we substitute T( 1/2) = ^/tt, define the parameter 

n( v 2 + 1) 

and transform the integral into Y{n/2)/a n i 2 to find 

T {n/2) 


r(v) = 


V^r(^)(v 2 + 1)”/ 2 ’ 


—oo < v < oo. 
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g(t) 



Figure 19.12 Student t probability 
density g„(y) for n — 3. 


Table 19.3 Student t Distribution 


p 

n = 1 

n = 2 

n = 3 

n = 4 

n = 5 

0.8 

1.38 

1.06 

0.98 

0.94 

0.92 

0.9 

3.08 

1.89 

1.64 

1.53 

1.48 

0.95 

6.31 

2.92 

2.35 

2.13 

2.02 

0.975 

12.7 

4.30 

3.18 

2.78 

2.57 

0.99 

31.8 

6.96 

4.54 

3.75 

3.36 

0.999 

318.3 

22.3 

10.2 

7.17 

5.89 


Entries are the values C in P(C) = K n ' (1 + '—) ("+1)/ 2 dt = p.n is the number of degrees of freedom. 


Finally we rescale this expression to the variable 1 in Eq. (19.72) with the density 
(Fig. 19.12) 


g(t) = 


T(n/2) 


Vtr(n-l)r(^)(l + ^)"/ 2 


-oo < t < oo, 


(19.75) 


for the Student t distribution, which manifestly does not depend on m or cr. The probability 
for t\ < t < t 2 is given by the integral 




T (n /2) r t2 dt 

Vtr(« - l)T(^) J n (1 ~F ~~j) n /2 ’ 


(19.76) 


and P(z ) = P{— oo, z) is tabulated. (See Table 19.3 for example.) Also, P(oo, —oo) = 1 
and P (—z) = 1 — P(z). because the integrand in Eq (19.76) is even in t, so 



i it 


(1 + )" /2 


l 


dt 


« d + ^)" /2 


j: 


dt 


i 


dt 


a + i£r)" /2 ■'-oo (i + ^y 1 ' 2 J ~™ d + ^r) ,?/2 


-£ 


dt 


and 
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Multiplying this by the factor preceding the integral in Eq. (19.76) yields P(—z) = 1 — 
P(z.). In the following example we show how to apply the Student t distribution to our fit 
of Example 19.6.1. 


Example 19 . 6.2 Confidence Interval 

Here we want to determine a confidence interval for the slope a in the linear y = at fit of 
Fig. 19.8. We assume 

• first that the sample points ( tj , yj) are random and independent, and 

• second that, for each fixed value r, the random variable Y is normal with mean /i(t) — 
at and variance a 2 independent of t. 

These values yj are measurements of the random variable Y, but we will regard them 
as single measurements of the independent random variables Yj with the same normal 
distribution as Y (whose variance we do not know). 

We choose a confidence level, p — 95%, say. Then the Student probability is 

P(-C, C) = P(C) - P(-C ) = p = -1 + 2 P(C), 


hence 

P(C) = ^(l + p), 

using P(—C) = 1 — P(C), and 


P(C) = l(l + p) = 0.975 = K n 



f 2\ —(n+l)/2 

It) d '■ 


where K n -\ is the factor preceding the integral in Eq. (19.76). Now we determine a solu¬ 
tion C = 4.3 from Table 19.3 of Student’s t distribution, with n — N — r — 3—1=2 the 
number of degrees of freedom, noting that (1 + p)/2 corresponds to p in Table 19.3. 

Then we compute A — Co a /\fN for sample size N — 3. The confidence interval is 
given by 


A < a < a + A, 


at p — 95% confidence level. 


From the y 2 analysis of Example 17.6.1 we use the slope a — 0.782 and variance a 2 — 
0.023 2 , so A — 4.3= 0.057, and the confidence interval is determined by a — A — 
0.782 - 0.057 = 0.725, a + A — 0.839, or 

0.725 < a < 0.839 at 95% confidence level. 


Compared to o a , the uncertainty of a has increased due to the high confidence level. A look 
at Table 19.3 shows that a decrease in confidence level, p, reduces the uncertainty inter¬ 
val, and increasing the number of degrees of freedom, n, would also lower the range of 
uncertainty. ■ 
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Exercises 

19 . 6.1 Let A A be the error of a measurement of A, etc. Use error propagation to show that 

m'-cfHTi 

holds for the product C — AB and the ratio C = A/B. 

19 . 6.2 Find the mean value and standard deviation of the sample of measurements x\ — 
6.0, x -2 = 6.5, xj = 5.9, x$ = 6.2. If the point X(, = 6.1 is added to the sample, how 
does the change affect the mean value and standard deviation? 

19 . 6.3 (a) Carry out a y 2 analysis of the fit of case b in Fig. 19.9 assuming the same errors for 
the ti, A ti — Ay,, as for the y, used in the y 2 analysis of the fit in Fig. 19.8. (b) Deter¬ 
mine the confidence interval at 95% confidence level. 

19 . 6.4 If a'i , X 2 , ■ ■ ■, x„ are a sample of measurements with mean value given by the arithmetic 
mean x and the corresponding random variables Xj that take the values xj with the 
same probability are independent and have mean value // and variance a 2 , then show 
that (x) — /x and a 2 (x) — a 2 /n. If a 2 = ^ JZjixj — x) 2 is the sample variance, show 
that (a 2 ) = 

' ' n 


Additional Readings 

Kreyszig, E., Introductory Mathematical Statistics: Principles and Methods. New York: Wiley (1970). 

Suhir, E., Applied Probability for Engineers and Scientists. New York: McGraw-Hill (1997). 

Papoulis, A., Probability, Random Variables, and Stochastic Processes, 3rd ed. New York: McGraw-Hill (1991). 
Ross, S. M., First Course in Probability, 5th ed., Vol. A. New York: Prentice-Hall (1997). 

Ross, S. M., Introduction to Probability Models, 7th ed. New York: Academic Press (2000). 

Ross, S. M., Introduction to Probability and Statistics for Engineers and Scientists, 2nd ed. New York: Academic 
Press (1999). 

Chung, K. L., A Course in Probability Theory Revised, 3rd ed. New York: Academic Press (2000). 

Devore, J. L., Probability and Statistics for Engineering and the Sciences, 5th ed. New York: Duxbury Pr. (1999). 

Montgomery, D. C., and G. C. Runger, Applied Statistics and Probability for Engineers, 2nd ed. New York: Wiley 
(1998). 

Degroot, M. H., Probability and Statistics, 2nd ed. New York: Addison-Wesley (1986). 

Bevington, P. R., and D. K. Robinson, Data Reduction and Error Analysis for the Physical Sciences, 3rd. ed. New 
York: McGraw-Hill (2003). 


General References 

Additional, more specialized references are listed at the end of each chapter. 

1. E. T. Whittaker and G. N. Watson, A Course of modern Analysis, 4th ed. Cambridge, UK: Cambridge Uni¬ 
versity Press (1962), paperback. Although this is the oldest of the references (original edition 1902), it still 
is the classic reference. It leans strongly toward pure mathematics, as of 1902, with full mathematical rigor. 

2. P. M. Morse and H. Feshbach, Methods of Theoretical Physics, 2 vols. New York: McGraw-Hill (1953). This 
work presents the mathematics of much of theoretical physics in detail but at a rather advanced level. It is 
recommended as the outstanding source of information for supplementary reading and advanced study. 



19.6 General References 


1151 


3. H. S. Jeffreys and B. S. Jeffreys, Methods of Mathematical Physics, 3rd ed. Cambridge, UK: Cambridge 
University Press (1972). This is a scholarly treatment of a wide range of mathematical analysis, in which 
considerable attention is paid to mathematical rigor. Applications are to classical physics and to geophysics. 

4. R. Courant and D. Hilbert, Methods of Mathematical Physics, Vol. 1 (1st English ed.). New York: Wiley 
(Interscience) (1953). As a reference book for mathematical physics, it is particularly valuable for existence 
theorems and discussions of areas such as eigenvalue problems, integral equations, and calculus of variations. 

5. F. W. Byron Jr., and R. W. Fuller, Mathematics of Classical and Quantum Physics, Reading, MA: Addison- 
Wesley, reprinted, Dover (1992). This is an advanced text that presupposes a moderate knowledge of math¬ 
ematical physics. 

6. C. M. Bender and S. A. Orszag, Advanced Mathematical Methods for Scientists and Engineers. New York: 
McGraw-Hill (1978). 

7. Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables, Applied Math¬ 
ematics Series-55 (AMS-55). Washington, DC: National Bureau of Standards, U.S. Department of Com¬ 
merce; reprinted, Dover (1974). As a tremendous compilation of just what the title says, this is an extremely 
useful reference. 



This page intentionally left blank 



Index 


Numbers 

1- forms, 304-5 

2- forms, 305-6 

3- forms, 306-7 

A 

Abelian group, 242 

Abel’s equation, 1016 

Abel’s test, 351,665, 882 

Abel’s theorem, 882 

absolute convergence, 340-42, 350, 363 

addition 

of matrices, 178-79 
of series, 324—25 
of tensors, 136 
addition rule, 1111 

addition theorem for spherical harmonics, 
797-802 

Bessel functions, 636 
derivation of addition theorem, 798-800 
Legendre polynomials, 798 
trigonometric identity, 797-98 
adjoint operator property, 208 
algebraic form, 405 
aliasing, 916-17 
alternating series, 339^42 
absolute convergence, 340-42 
exercises, 342 
Leibniz criterion, 339—40 
overview, 339 

analytic continuation, 432-34 
analytic functions, 415-18 
z*, 416 
z 2 . 415 

analytic landscape, 489-90 
angular Mathieu equation, 872 
angular momentum, 18, 215, 267, see also orbital 
angular momentum 
coupling, 266-78 

Clebsch-Gordan coefficients SU(2) and 
SO(3), 267-70 
exercises, 277-78 
overview, 266-67 
spherical tensors, 271-74 
young tableaux for SU (n), 274-77 


angular momentum operators, 261 
Clebsch-Gordan coefficients, 803 
orbital, 793-96 
spherical harmonics, 793 

vector spherical harmonics, 813-16 
annihilation operator, 824 
anomalous dispersion, 998 
anticommutation relation, 18 
anti-Hermitian matrices, 221-23 
eigenvalues 
degenerate, 223 

and eigenvectors of real symmetric matrices, 
221-22 
overview, 221 
antisymmetry 

antisymmetric matrices, 204 
and determinants, 168-72 
Gauss elimination, 170-72 
overview, 168-70 
of tensors, 137, 147 
area law for planetary motion, 116-19 
Argand diagram, 405 

associated Legendre equation functions, see 

Legendre equation, functions polynomials 
associative, 2 

asymptotic expansions, 719-25 
asymptotic forms 

of factorial function T(1 + s), 494-95 
of Hankel function, 493-94 
asymptotic series, 389-96 
Bessel functions, 722 
confluent hypergeometric functions, 393 
cosine and sine integrals, 392-93 
definition of, 393-94 
exercises, 394—96 

incomplete gamma function, 389-92 
overview, 389 

overview: integral representation expansion, 
719-23 

steepest descent, 489-95 
Stokes’ method, 719, 724 
asymptotic values, Bessel functions, 722, 729 
attractor, 1081 

autonomous differential equations, 1091-93 
average value, 1117-18 
axes, see rotations; symmetry 
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axial vector, 143—44 

axis, coordinate, 4-5, 7-11, 195-99 

azimuthal dependence — orthogonality, 787 

B 

Baker-Hausdorff formula, 225 

basin of attraction, 1081 

Bernoulli and Riccati equations, 1089-90 

Bernoulli numbers, 376-89, 473-74 

Euler-Maclaurin integration formula, 380-82 
exercises, 385-89 
improvement of convergence, 385 
overview, 376-79 
polynomials, 379-80 
Riemann Zeta function, 382-84 
Bessel functions, 675-739, 865 
asymptotic expansions, 719-25 
exercises, 723-25 

expansion of an integral representation, 
720-23 

asymptotic values, 722 
closure equation, 696 
of first kind, 675-93 

alternate approaches, 685-86 
Bessel functions of nonintegral order, 686 
Bessel’s differential equation, 678-79 
Bessel’s differential equation: self-adjoint 
form, 694 

confluent hypergeometric representation, 865 
cylindrical resonant cavity, 682-85 
cylindrical wave guide, 705 
exercises, 686-93 
Fourier transform, 933 
Fraunhofer diffraction, circular aperture, 
680-82 

generating function for integral order, 675-77 
integral representation, 679-80 
Laplace transform solution, 983-84 
orthogonality, 694 
recurrence relations, 677-78 
second kinds, 699-707 
series solution, 570-72, 676-79 
singularities, 564 
spherical, 725-39 
Wronskian, 702-5 
Fraunhofer diffraction, 680-82 
Hankel functions, 707-13 

contour integral representation of, 709-11 
cylindrical traveling waves, 708 
definitions, 707-8 
exercises, 711-13 
Helmholtz equation, 683-84, 725 
Laplace’s equation, 695 
modified, 713-19 
asymptotic expansion, 711,719 


exercises, 716-19 
Fourier transform, 716 
generating function, 709 
integral representation, 720-23 
Laplace transform, 933 
recurrence relations, 714-16 
series form, 714 

Neumann functions, Bessel functions of second 
kind, 699-707 
coaxial wave guides, 703^4 
definition and series form, 699-700 
exercises, 704-7 
other forms, 701 
recurrence relations, 702 
Wronskian formulas, 702-3 
of nonintegral order, 686 
orthogonality, 694-99 
Bessel series, 695 
continuum form, 696 

electrostatic potential in a hollow cylinder, 
695-96 

exercises, 697-99 
normalization, 695 
recurrence relations, 677 
spherical, 725-39 

asymptotic values, 729 
definitions, 726-29 
exercises, 732-39 
limiting values, 729-30 
orthogonality, 731 
particle in a sphere, 731-32 
recurrence relations, 730 
spherical waves, 730 
in wave guides, 703—4 
zeros, 682 

Bessel’s differential equation, 678-79, 684 
self-adjoint form, 694 
Bessel’s equation, 983-84 
Bessel series, 695 
Bessel’s inequality, 651-52 
beta function, 520-26 

definite integrals, alternate forms, 521-22 
derivation of Legendre duplication formula, 
522-23 

incomplete, 523 
Laplace convolution, 993 
verification of not/ sinna relation, 522 
bifurcates, 1083 

bifurcations in dynamical systems, 1103-4 
Hopf, 1101, 1103—4, 1107 
pitchfork, 1083, 1086, 1101, 1107 
binomial coefficient, 356 
binomial distribution, 1128-30 
binomial expansion, 1129 
binomial probability distribution, 1129 
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binomial theorem, 356-57 
Biot and Savart law, 780-82 
black hole, optical path near event horizon of, 
1041-42 
Bohr radius, 844 
Born approximation, 603 
Bose-Einstein statistics, 1064, 1115 
boundary conditions, 542-43 
Cauchy, 542 
Dirichlet, 543 
hollow cylinder, 695 
magnetic field of current loop, 778-82 
Neumann, 543 
ring of charge, 761 
sphere in uniform electric field, 759 
Sturm-Liouville theory, 627-29 
waveguide, coaxial cable, 703 
bound state, 627 
box counting dimension, 1086 
branch cut (cut line), 409 
branch points, 440^42 

and multivalent functions, 447-50 
of order 2, 440^42 
Bromwich integral, 994-95 
Butterfly effect, 1079 

c 

calculus of residues, 455-82, see also definite 
integrals 

Cauchy principal value, 457-60 
exercises, 474-82 
Jordan’s lemma, 466-68 
overview, 455 

pole expansion of meromorphic functions, 461 
product expansion of entire functions, 462-63 
residue theorem, 455-56 
calculus of variations, 1037-77 

applications of the Euler equation, 1044-52 
exercises, 1049-52 
soap film, 1045^-6 
soap film — minimum area, 1046-49 
straight line, 1044-45 
dependent and an independent variable, 
1038—44 

alternate forms of Euler equations, 1042 
concept of variation, 1038—41 
exercises, 1043—44 

missing dependent variables, 1042-43 
optical path near event horizon of a black 
hole, 1041-42 

Lagrangian multipliers, 1060-65 
constraints, 1060-72 
cylindrical nuclear reactor, 1062 
exercises, 1063-65 
particle in a box, 1061-62 


Rayleigh-Ritz variational technique, 1072-76 
exercises, 1074-76 
ground state eigenfunction, 1073 
Sturm-Liouville equation, 1072 
vibrating string, 1074 

several dependent and independent variables, 
1058-59 
exercises, 1059 
relation to physics, 1059 
several dependent variables, 1052-58 
exercises, 1055-56 
Hamilton’s principle, 1053-54 
Laplace’s equation, 1057-58 
moving particle — Cartesian coordinates, 
1054 

moving particle — circular cylindrical 
coordinates, 1054-55 

several independent variables, exercises, 1058 
surface of revolution, 1046 
uses of, 1037 

variation with constraints, 1065-72 
exercises, 1070-72 
Lagrangian equations, 1066-67 
Schrodinger wave equation, 1069-70 
simple pendulum, 1067-68 
sliding off a log, 1068-69 
Cartesian components, 4 
Cartesian coordinates, 554-55 
unit vectors, 5 
Casimir operators, 265 
Catalan’s constant, 384, 513 
catenoid, catenary of revolution, 1046 
Cauchy (Maclaurin) integral test, 327-30, 418-30 
contour integrals, 418-20 
derivatives, 426-27 
exercises, 424-25, 429-30 
Goursat proof, 421-23 
Morera’s theorem, 427-28 
multiply connected regions, 423-24 
overview, 418, 425-26 
Stokes’ theorem proof, 420-21 
Cauchy boundary conditions, 542 
Cauchy criterion, 322 
Cauchy inequality, 428 
Cauchy principal value, 457-60, 471 
Cauchy-Riemann conditions, 413-18 
analytic functions, 415-18 
z*, 416 
z 2 . 415 

exercises, 416-18 
overview, 413-15 
causality, 486-87 
cavities, cylindrical, 682-85 
Cayley-Klein parameters, 252 
center or cycle, 1100-1101 
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central force, 117 
central force field, 39-40, 44—46 
centrifugal potentials, 72 
chain rule, 34 

chaos in dynamical systems, 1105-6 
chaotic attractor, 1085 
character, 184, 293 
characteristics, 538—41 
Chebyshev differential equation, 559 
Chebyshev polynomials, 848-59 
generating functions, 848 
Gram-Schmidt construction, 646 
hypergeometric representations, 862 
orthogonality, 854-55 
recurrence relation, 850 
recurrence relations — derivatives, 852-53 
shifted, 646, 850 
trigonometric form, 853-54 
type I, 849-52 
type II, 849 

chi-squared (x 2 ) distribution, 1143—45 
Christoffel symbols, 154-56, 314 
circular cylinder coordinates, 115-23 
area law for planetary motion, 116-19 
exercises, 120-23 
Navier-Stokes term, 119 
overview, 115-16 

circular cylindrical coordinates, 555-56 
expansion, 601-2 

circular membrane, Bessel functions, 693, 708 

classes and character, 293 

Clausen functions, 909 

Clebsch-Gordan coefficients, 267-70, 803 

Clifford algebra, 211-12 

closed-form solutions, 810-12 

closure, of Bessel function, 89, 248, 696 

closure, of spherical harmonics, 790, 792 

coaxial wave guides, 703^4 

commutative, 1 

commutator, 180, 225, 231, 249, 253, 262, 264 
comparison tests, 325-26 
completeness of eigenfunctions 

of Fourier series: of Sturm-Liouville 
eigenfunctions, 649-51 
of Hilbert-Schmidt: of integral equations, 
1031-33 

complex variables, 403-54, 455-97, see also 
calculus of residues; Cauchy-Riemann 
conditions; functions; mapping; saddle 
points (steepest descent method); 
singularities 
algebra using, 404-13 

calculus of residues, 455-82 
complex conjugation, 407-8 
exercises, 409-13 


overview, 404-5 

permanence of algebraic form, 405-7 
Cauchy’s integral formula, 425-30 
derivatives, 426-27 
exercises, 429-30 
Morera’s theorem, 427-28 
overview, 425-26 
Cauchy’s integral theorem, 418-25 
Cauchy-Goursat proof, 421-23 
contour integrals, 418-20 
exercises, 424-25 

multiply connected regions, 423-24 
overview, 418 

Stokes’ theorem proof, 420-21 
dispersion relations, 482-89 
causality, 486-87 
exercises, 487-89 
optical dispersion, 484-85 
overview, 482-83 
Parseval relation, 485-86 
symmetry relations, 484 
Laurent expansion, 430-38 
analytic continuation, 432-34 
exercises, 437-38 

Schwarz reflection principle, 431-32 
Taylor expansion, 430-31 
overview, 403-4, 455 
conditional convergence, 340 
conditional probability, 1112 
condition number, of ill-conditioned systems, 234 
Condon-Shortley phase conventions, 270 
confidence interval, 1146, 1149 
confluent hypergeometric functions, 863-69 
asymptotic expansions, 866 
Bessel and modified Bessel functions, 865 
Hermite functions, 866 
integral representations, 865 
Laguerre functions, 837—48 
miscellaneous cases, 866 
Whittaker functions, 866 
Wronskian, 868 
conformal mapping, 451-54 
conjugation, complex, 407-8 
connected, simply or multiply, 60, 95, 420, 423, 
426, 435 

conservation theorem, 309 
conservative force, 34, 69 
constant 1-forms, 305 
constant B field, vector potentials of, 44 
contiguous function relations, 861 
continuation, analytic, 432-34 
continuity equation, 40-42 
continuity of power series, 364 
continuous random variable, 1117-19 
continuum form, 696 
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contour integral representation, Hankel functions, 
709-11 

contour integrals, 418-20 

contour of integration, simple pole on, 468-69 

contraction, 139 

contravariant tensor, 135, 156-58, 160, 162 
contravariant vector, 134 
convergence, rate of, 334, 345 
convergence of infinite series, 321, 903 
absolute, 340^-2, 350 

improvement of, and Bernoulli numbers, 385 
of infinite product, 397-98 
of power series, 363 
rate, 334, 345 

and rational approximations, 345 
tests, 325-39, see also Cauchy (Maclaurin) 
integral test 
comparison, 325-26 
exercises, 335-39 
Gauss’, 332-33, 357 
improvement of, 334-39 
Kummer’s, 330-32 
overview, 325 

partial sum approximation, 390 
Raabe’s, 332 

uniform and nonuniform, 348—49 
convolution (Faltungs) theorem, 951-55, 990-94 
driven oscillator with damping, 991-93 
Fourier transform, 931-32, 936^15 
Laplace transform, 965-1003 
Parseval’s relation, 952-53 
coordinates, see also circular cylinder coordinates; 
curved coordinates and vectors; orthogonal 
coordinates; spherical polar coordinates 
axes, rotation of, see rotations 
curvilinear, 104, 105, 110, 111, 112 
divergence of coordinate vector, 39 
Laplacian in orthogonal, 316 
rotation of, 199 
correlation, 1122 
cosets and subgroups, 293-94 
cosines 

asymptotic expansion, 392-93 
confluent hypergeometric representation, 867 
cosine transform, 939 
direction, 196-97 

direction cosines (orthogonal matrices), 4, 
196-97, 201 

functions of infinite products, 398-99 
infinite product, 398, 462 
integral, 392 

integral of in denominator, 464-65 
integrals in asymptotic series, 392-93 
law of, 16-17, 118, 745 
law of, theorem, 16 


theorem, 16 

coupling, angular momentum, see angular 
momentum 
covariance, 1122 

covariance of Maxwell’s equations, Lorentz, see 
Lorentz covariance of Maxwell’s equations 
covariant derivative, 151, 156 
covariant vectors, 134, 152-53 
tensor, 135, 156-58, 160, 162 
Cramer’s rule, 166 
creation operator, 824 
criterion, Leibniz, 339—40 
critical point, 1091-93 
critical strip, 897 
critical temperature, 1086 
crossing conditions, 484 
cross product, 18-22, see also triple vector 
products 
exercises, 22-25 
overview, 18-22 
of vectors, 315 

crystallographic point and space groups, 299-300 
curl, V x, 43^-9 

central force field, 44^6 
as differential vector operator, 112-13 
exercises, 47^-9 
gradient of dot product, 46 
integral definitions of gradient, divergence and, 
58-59 

integration by parts of, 47 
overview, 43 

as tensor derivative operator, 162-63 
vector potential of constant B field, 44 
curl, V x 

central force field 

in circular cylindrical coordinates, 118 
in curvilinear coordinates, 112-13 
in spherical polar coordinates, 126 
irrotational, 45 

curved coordinates and vectors, 103-33, see also 
circular cylinder coordinates; orthogonal 
coordinates; spherical polar coordinates 
differential operators, 110-14 
curl, 112-13 
divergence, 111-12 
exercises, 113-14 
gradient, 110 
overview, 110 
overview, 103 

special coordinate systems, 114-33 
curves, fitting to data, 1140—43 
curvilinear coordinates, 104, 105, 110, 111, 112 
cut line (branch cut), 409 

cylinder coordinates, circular, see circular cylinder 
coordinates 
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cylindrical coordinates, 104 
cylindrical symmetry, 617 
cylindrical traveling waves, 708 

D 

d’Alembertian, 141 
d’Alembert ratio test, 326-27 
damped oscillator, 979-80 
damped simple harmonic oscillation, 980 
decay, kaon, 282-83 
definite integral (Euler), 500-501 
definite integrals 
evaluation of, 463 
exponential forms, 471-82 
Bernoulli numbers, 473-74 
factorial function, 472-73 
f™cof(x)dx, 465-66 
/“ 0 f(x)e iax dx, 466-71 
quantum mechanical scattering, 469-71 
simple pole on contour of integration, 468-69 
Jq 7 * /(sin#, cos 9)d6, 464-65 
degeneracy, of Schrodinger’s wave equation, 638 
degenerate eigenfunctions, 638 
degenerate eigenvalues, 223, 638 
Del (V), 42, 43 

for central force, 127 
successive applications of, 49-54 
electromagnetic wave equation, 51-53 
exercises, 53-54 
Laplacian of potential, 50-51 
overview, 49-50 

delta function, Dirac, 83-85, 669-70, 975 
Bessel representation, 935 
in circular cylindrical coordinates, 601 
derivation, 937-38 
eigenfunction expansion, 89, 650 
exercises, 91-95 
Fourier integral, 90 
Fourier representation, 90 
Green’s function and, 592-610 
impulse force, 975 
integral representations for, 90 
Laplace transform, 975 
overview, 83-87 
phase space, 88 
point source, 88, 593 
quantum theory, 955-61 
representation by orthogonal functions, 88-89 
sequences, 83, 86 
sine, cosine representations, 943 
in spherical polar coordinates, 82, 599 
theory of distributions, 86 
total charge inside sphere, 88 
De Moivre’s formula, 408-13 


denominator, integral of cos in, 464-65 
dependent and independent variables, 1038-44 
alternate forms of Euler equations, 1042 
concept of variation, 1038—41 
missing dependent variables, 1042-43 
optical path near event horizon of a black hole, 
1041^12 

derivative operators, tensor 
curl, 162-63 
divergence, 160-61 
exercises, 162-63 
Laplacian, 161-62 
overview, 160 

derivatives, 426-27, see also exterior derivative 
covariant, 156 
gauge covariant, 76 

descending power series solutions, 369, 781 
descent, steepest, see saddle points (steepest 
descent method) 
determinants, 165-239 
antisymmetry, 168-72 
Gauss elimination, 170-72 
Gauss-Jordan elimination, inversion, 185-86 
overview, 168-70 
exercises, 174-76 
Gram-Schmidt procedure, 173-74 
overview, 173-74 
vectors by orthogonalization, 174 
homogeneous linear equations, 165-66 
inhomogeneous linear equations, 166-67 
Laplacian development by minors, 167-68 
linear dependence of vectors, 172-73 
overview, 165 
product theorem, 181 

representation of a vector product, 20 
secular equation, 218 

solution of a set of homogenous equations, 
165 

solution of a set of nonhomogenous 
equations, 166 
deuteron, 626-27 

diagonal matrices, 182-83, 215-31, see also 
anti-Hermitian matrices 
eigenvectors and eigenvalues, 216-19 
exercises, 226-31 
functions of, 224-26 
Hermitian, 219-21 
moment of inertia, 215-16 
differential equations, 535-619, 751-52 
first-order differential equations, 543-53 
exact differential equations, 545—47 
exercises, 550-53 
linear first-order ODEs, 547-50 
nonlinear, 1088-1102 
parachutist, 544^49 
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RL circuit, 549-50 
separable variables, 544^45 
Fuchs’ theorem, 573 
heat flow, or diffusion, PDE, 611-18 
alternate solutions, 614-15 
special boundary condition again, 615-16 
specific boundary condition, 612-13 
spherically symmetric heat flow, 616-17 
homogeneous, 536, 548-50, 565 
linear independence of solutions 
second solution, 581-83 
series form of the second solution, 583-85 
nonhomogeneous equation — Green’s function, 
592-610 

circular cylindrical coordinate expansion, 27, 
601-2 

exercises, 607-10 
form of Green’s functions, 596-98 
Legendre polynomial addition theorem, 
600-601 

quantum mechanical scattering — Green’s 
function, 603-6 

quantum mechanical scattering — Neumann 
series solution, 602-3 
spherical polar coordinate expansion, 
598-600 

symmetry of Green’s function, 595-96 
partial differential equations, 535-43 
boundary conditions, 542—43 
classes of PDEs and characteristics, 538-41 
examples of, 536-38 
introduction, 535-36 
nonlinear PDEs, 541^42 
particular solution, 548, 565 
second solution, 573-78 
exercises, 588-92 
linear dependence, 580-81 
linear independence, 580 
linear independence of solutions, 579-80 
second solution for the linear oscillator 
equation, 583 

second solution of Bessel’s equation, 586-87 
second solution logarithmic term, 585, 700 
separation of variables, 554-62 
Cartesian coordinates, 554-55 
circular cylindrical coordinates, 555-56 
exercises, 560-62 

spherical polar coordinates, 557-60 
series solutions — Frobenius’ method, 565-78 
exercises, 574-78 
expansion about xq, 569 
Fuchs’ theorem, 573 
limitations of series approach — Bessel’s 
equation, 570-71 

regular and irregular singularities, 572-73 


symmetry of solutions, 569 
singular points, 562-65 
differential forms, 304-19, see also pullbacks 

1- forms, 304-5 

2- forms, 305-6 

3- forms, 306-7 
exercises, 318-20 
exterior derivative, 307-9 
Hodge operator *,314-19 

cross product of vectors, 315 
Laplacian in orthogonal coordinates, 316 
Maxwell’s equations, 316-20 
overview, 314—15 
Legendre’s equation, 752 
overview, 304 

Stokes’ theorem on, 313-14 
differentials, exact, see thermodynamics 
differential vector operators, 110-14 
adjoint, 621, 623, 634-35 
curl, 112-13 
del, 33 

divergence, 111-12 
exercises, 113-14 
gradient, 110 
overview, 110 
differentiation, 904-5 
differentiation of power series, 364 
diffraction, 680-82, 1017 

diffusion equation, see differential equations, heat 
flow PDE 

digamma and poly gamma functions, 510-16 
digamma functions, 510-11 
Maclaurin expansion, computation, 512 
poly gamma function, 511-12 
series summation, 512 
dihedral groups, D n , 299 
dimension 

box-counting, 1086 
Hausdorff, 1086 
Kolmogorov, 1086 
dimensionality theorem, 298 
dipoles, interaction energy, magnetic dipole, 
radiation fields, see electric dipole 
Dirac bra-ket notation, 177 
Dirac delta function, see delta function, Dirac 
Dirac matrices, 209-12 
direction cosines (orthogonal matrices), 4, 

196-97, 201 
direct product, 139—41 
exercises, 140-41 
and matrix multiplication, 181-82 
overview, 139—40 
of tensors, 140 
direct tensor, 181 
direct tensor product, 139 
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Dirichlet conditions, 543, 882 
kernel, 910 

Dirichlet problem, 617 
Dirichlet series, 326 
discontinuities, behavior of, 886 
discontinuous functions, 888 
discrete Fourier transform, 914-19 
aliasing, 916-17 
fast Fourier transform, 917 
limitations, 916 

orthogonality over discrete points, 914-15 
discrete groups, 291-304 
classes and character, 293 
crystallographic point and space groups, 
299-300 

dihedral groups, D n , 299 
exercises, 300-304 
subgroups and cosets, 293-94 
threefold symmetry axis, 296-99 
twofold symmetry axis, 294-96 
discrete random variable, 1116-17 
dispersion relations, 482-89 
causality, 486-87 
crossing relations, 484 
exercises, 487-89 
Hilbert transform, 485 
optical dispersion, 484-85 
overview, 482-83 
Parseval relation, 485-86 
sum rules, 484 
symmetry relations, 484 
displacement, 158 
dissipation, 1101-3 
distributive, 13 
divergence, V, 38^13 

of central force field, 39—40 
circular cylindrical, 115-23 
coordinates, Cartesian, 4-7 
of coordinate vector, 39 
curvilinear coordinates, 111 
as differential vector operator, 111-12 
exercises, 42-43 

integral definitions of gradient, curl, and, 58-59 
integration by parts of, 40 
overview, 38-39 
physical interpretation, 40^42 
solenoidal, 42 
spherical polar, 123-33 
as tensor derivative operator, 160-61 
divergent series, 325-26 
Doppler shift, 360 
dot products, 12-17 
exercises, 17 
gradient of, 46 


invariance of scalar product under rotations, 
15-17 

overview, 12-15 

double series, rearrangement of, 345^-8 
driven oscillator with damping, 991-93 
dual tensors, 147^-8 

duplication formula for factorial functions, see 
Legendre duplication formula 
dynamical systems, dissipation in, 1102-3 

E 

E, Lorentz transformation of the electric field, 
287-88 

Earth’s gravitational field, 758-59 
Earth’s nutation, 973-74 
eigenfunctions, 624, 626-27 
Bessel’s inequality, 651-52 
completeness of, 649-61 

of Fourier series: of Sturm-Liouville 
eigenfunctions, 649-51 
of Hilbert-Schmidt: of integral equations, 
1031-33 

eigenvalue equation, 667-68 
expansion, Green’s function, 662-74 
of Dirac delta function, 88-90 
of Hermitian differential operators, 635, 
649-51 

of square wave, 637 
expansion coefficients, 658 
orthogonal, 636, 637, 1030-32 
Schwarz inequality, 652-54 
summary — vector spaces, completeness, 
654-58 

variational calculation, 1072-76 
eigenvalues, 217-18, 223, 624-27, 634-35 
of Hermitial differential operator, 634 
of Hermitial matrices, 219-23 
of Hilbert-Schmidt integral equation, 1030-36 
of normal matrices, 231-32 
of real symmetric matrices, 215-19 
variational principle for, 1072 
eigenvectors, 216-19, 221-22 
eightfold way (weight diagram), 257 
Einstein’s energy relation, 281 
Einstein’s summation convention, 136 
velocity addition law, 283, 290 
electrical charge inside spheres, 88 
electric dipole potential, Legendre polynomial 
expansion, 745 

electromagnetic invariants, 288 
electromagnetic wave equation, 51-53 
electromagnetic waves, 981-82 
electrostatic multipole expansion, 599 
electrostatic potential, 593 
in hollow cylinder, 695-96 
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of ring of charge, 761-62 
electrostatics, physical basis, 741-42 
elimination, see determinants 
elliptical drum, 872-73 
elliptic integrals, 370-76 
definitions of, 372 
exercises, 374-76 
of first kind, 372 

hypergeometric representations, 373, 860 
limiting values, 374 
overview, 370 

period of simple pendulum, 370-71 
of second kind, 372 
series expansion, 372-73 
elliptic PDEs, 538 
empty set, 1111 
energy 

potentials, 309 
relativistic, 356-57 
equality of matrices, 178 
equations, see also linear equations; Maxwell’s 
equations; Poisson’s equation 
of motion and field, 142 
error integrals, 530 

asymptotic expansion, 393 
confluent hypergeometric representation, 864 
error propagation, 1138—40 
essential (irregular) singular point, 563 
Euler angles, 202-3 
Euler equation, 1040 
alternate forms of, 1042 
applications of, 1044-52 
soap film, 1045^-6 
soap film — minimum area, 1046-49 
straight line, 1044-45 
Euler identity, 224 
product formula, 382-84 
Euler integrals, 502 

Euler-Maclaurin integration formula, 380-82, 517 
Euler-Mascheroni constant, 330 
Euler product for Riemann Zeta function, 382-84 
event horizon, 1041 
exact differential equations, 545^47 
exact differentials, see thermodynamics 
expansion, see also Laurent expansion; Taylor’s 
expansion 

pole, of meromorphic functions, 461 
product, of entire function, 462-63 
of series, 372-73 
expansion coefficients, 658 
expansion of functions, Legendre series, 757-58 
expectation value, 630, 955-56, 1117-18 
exponential forms, 471-82 
Bernoulli numbers, 473-74 
factorial function, 472-73 


exponential function, of Maclaurin theorem, 
354-55 

exponential integral, 527-30 

exponential of diagonal matrix, 225-26 

exponential transform, 938 

exterior derivative, 307-9 

extreme or stationary value, 36, 881, 1038^40 

F 

Factorial function T(1 + s) 
asymptotic form of, 494-95 
complex argument, 499-506 
contour integrals, 505 
digamma function, 510 
double factorial notation, 505 
Gamma functional relation, 503 
infinite product, 501 
integral (Euler) representation, 500 
Legendre duplication formula, 503 
Maclaurin expansion, 512 
polygamma functions, 511 
steepest descent asymptotic formula, 495 
Stirling’s (formula) series, 516-18 
factorial notation, 503-5 
faithful group, 243 
Faraday’s law, 66-68 
fast Fourier transform, 917 
Feigenbaum number, 1083-84 
Fermage equation, 950 
Fermat’s principle, 157, 1041, 1050 
Fermi-Dirac statistics, 1064, 1115 
field equations, 142 
finite wave train, 940^41 
first-order differential equations, 543-53 
exact differential equations, 545-47 
linear first-order ODEs, 547-50 
separable variables, 544-45 
fixed and movable singularities, special solutions, 
1090 

Floquet’s theorem, 877 
force as gradient of potentials, 36 
forced classical oscillators, 457-60 
force field, central, see central force field 
Fourier-Bessel series, 695 
Fourier expansions of Mathieu functions, 919-29 
integral equations and Fourier series for 
Mathieu functions, 919-23 
leading coefficients for ceq, 926-29 
leading coefficients of sej, 923-26 
Fourier integral theorem, 937 
development of, 936-38 
exponential form, 937 
Fourier-Mellin integral, 995 
Fourier representation, of Dirac delta function, 90 
Fourier series, 881-930 
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advantages, uses of, 888-92 
change of interval, 890-91 
completeness, see general properties of 
Fourier series 
convergence, 893, 903-10 
differentiation, see general properties of 
Fourier series 

discontinuous functions, 888 
exercises, 891-92 

integration, see general properties of Fourier 
series 

periodic functions, 888-90 
applications of, 892-903 
exercises, 898-903 
full-wave rectifier, 893-94 
infinite series, Riemann Zeta function, 

894-98 

square wave — high frequencies, 892-93 
discrete Fourier transform, 914-19 
discrete fourier transform, 915-16 
discrete Fourier transform — aliasing, 916-17 
exercises, 918-19 
fast Fourier transform, 917 
limitations, 916 

orthogonality over discrete points, 914—15 
Fourier expansions of Mathieu functions, 
919-29 
exercises, 929 

integral equations and Fourier series for 
Mathieu functions, 919-23 
leading coefficients for ceo, 926-29 
leading coefficients of se^, 923-26 
general properties, 881-88 

behavior of discontinuities, 886 
completeness, 883-84 
complex variables — Abel’s theorem, 882 
exercises, 886-88 
sawtooth wave, 885-86 
square wave, 892 
Sturm-Liouville theory, 885 
summation of a Fourier series, 882-83 
Gibbs phenomenon, 910-14 
calculation of overshoot, 912-13 
exercises, 913-14 
square wave, 911-12 
summation of series, 910 
orthogonality, 636-37 
properties of, 903-10 
convergence, 903 
differentiation, 904-5 
exercises, 905-10 
integration, 904 
summation of, 882-83 
Fourier transform, of Gaussian, 932 
Fourier transform of derivatives, 946-51 


heat flow PDE, 948^-9 
inversion of PDE, 949-50 
wave equation, 947-48 
Fourier transforms, 486-87, 931-32 
aliasing, 916 

convolution (Faltungs) theorem, 951 
delta function derivation, 937 
transfer functions, 961 

Fourier transforms — inversion theorem, 938—46 
cosine transform, 939 
exponential transform, 938 
fast Fourier transform, 917 
finite wave train, 940^-1 
Fourier integral, 931, 936-39 
momentum space representation, 955 
sine transform, 939—40 
uncertainty principle, 941 
Fourier transform solution, 1013 
fractals, 1086-88 
fractional order, 427 

Fraunhofer diffraction, Bessel function, 680-82 
Fredholm equation, 1005-6 
Frobenius’ method, series solutions, 565-78 
Fuchs’ theorem, 573 
full-wave rectifier, 893-94 

functional equation, Riemann Zeta function, 

896 

Gamma function, 500 

functions, 817-80, see also analytic functions 
Chebyshev polynomials, 848-59 
exercises, 855-59 
generating functions, 848 
orthogonality, 854-55 
recurrence relations — derivatives, 852-53 
trigonometric form, 853-54 
type I, 849-52 
type II, 849 

of complex variable, 408-13 
confluent hypergeometric functions, 863-69 
Bessel and modified Bessel functions, 865 
exercises, 867-69 
Hermite functions, 866 
integral representations, 865 
miscellaneous cases, 866 
entire, 415, 451, 462-63 
exponential, of Maclaurin theorem, 354—55 
factorial, 472-73 
Hermite functions, 817-36 
alternate representations, 819 
applications of the product formulas, 831-32 
direct expansion of products of Hermite 
polynomials, 828-30 
exercises, 832-36 

generating functions — Hermite polynomials, 
817-18 
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orthogonality, 821-22 
quantum mechanical simple harmonic 
oscillator, 822-27 
recurrence relations, 818-19 
Rodrigues’ representation, 820-21 
threefold Hermite formula, 827-28 
hypergeometric functions, 859-63 
contiguous function relations, 861 
exercises, 862-63 

hypergeometric representations, 861-62 
Laguerre functions, 837^48 

associated Laguerre polynomials, 841—43 
differential equation — Laguerre 
polynomials, 837-41 
exercises, 845-48 
hydrogen atom, 843-45 
Mathieu functions, 869-79 
elliptical drum, 872-73 
exercises, 879 

general properties of Mathieu functions, 874 
quantum pendulum, 873 
radial Mathieu functions, 874-79 
separation of variables in elliptical 
coordinates, 870-71 
of matrices, 224-26 
meromorphic, 451, 461-62, 478 
multivalent, and branch points, 447-50 
rotation of, 251 
series of, 348-52 
Abel’s test, 351 
exercises, 352 
overview, 348 

uniform and nonuniform convergence, 
348-49 

Weierstrass M test, 349-50 

G 

gamma distribution, 1143 
gamma function, see also factorial function, 
499-533 

beta function, 520-26 

definite integrals, alternate forms, 521-22 
derivation of Legendre duplication formula, 
522-23 

exercises, 523-26 
incomplete beta function, 523 
verification of na/ sin 710 ? relation, 522 
definitions, simple properties, 499-510 
definite integral (Euler), 500-501 
double factorial notation, 505 
exercises, 506-10 
factorial notation, 503-5 
infinite limit (Euler), 499-500 
infinite product (Weierstrass), 501-3 
integral representation, 505-6 


digamma and polygamma functions, 510-16 
Catalan’s constant, 513 
digamma functions, 510-11 
exercises, 513-16 

Maclaurin expansion, computation, 512 
polygamma function, 511-12 
series summation, 512 
incomplete gamma functions and related 
functions, 527-33 
error integrals, 530 
exercises, 530-33 
exponential integral, 527-30 
of infinite product, 398-99 
Stirling’s series, 516-20 

derivation from Euler-Maclaurin integration 
formula, 517 
exercises, 518-20 
Stirling’s series, 518 
gauge covariant derivative, 76 
theory, 259 
transformation, 76 
gauge theory, 76, 241 
Gauss elimination, 170-72 

Gauss’ differential equation, 312-13, 318, 
614-15, 617-18 

hypergeometric differential equation, 576, 
859-62, 873 

Gauss error integral, 500 
asymptotic expansion, 530 
Gauss’ fundamental theorem of algebra, 428, 463 
Gauss-Jordan matrix inversion, 185-87 
Gauss’ law, 52, 79-83, 594 
Gauss’ normal distribution, 1134-38 
Gauss’ notation, 503 
Gauss-Seidel iteration technique, 172 
Gauss-Seidel method, 226 
Gauss’ test, 332-33, 357 
Legendre series, 333 
Gauss’ theorem, 60-64 
alternate forms of, 62-64 
exercises, 62-64 
overview, 62 
overview, 60-61 
pullbacks, 312-13 

Gegenbauer polynomials, see ultraspherical 
polynomials 

general parabolic solution, 540 
general properties, 881-88 

behavior of discontinuities, 886 
completeness, 883-84 
complex variables — Abel’s theorem, 882 
of Mathieu functions, 874 
sawtooth wave, 885-86 
Sturm-Liouville theory, 885 
summation of a Fourier series, 882-83 
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general tensors, 151-60, see also Christoffel 
symbols 

covariant derivative, 156 
exercises, 158-60 

geodesics and parallel transport, 157-60 
metric tensor, 151-54 
overview, 151 

generating function, 741-49, 848, 1014-15 
associated Laguerre polynomials, 624-25, 
841-45 

associated Legendre functions, 771-82, 788 
associated Legendre polynomials, 773 
Bernoulli numbers, 376-89, 473-74, 517 
Bernoulli polynomials, 379-80 
Bessel functions, modified, 711, 713-19, 
723-24, 865 

Chebyshev polynomials, 848-59 
extension to ultraspherical polynomials, 747 
Hermite polynomials, 817-30 
for integral order, 675-77 
Laguerre polynomials, 647, 837-41, 843^15 
Legendre polynomials, 742-44 
linear electric multipoles, 744—45 
physical basis — electrostatics, 741—42 
ultraspherical polynomials, 747 
vector expansion, 745-47 
generators of continuous groups, 246-61, see also 
rotations; SU(2) 
exercises, 260-61 
overview, 246-50 
geodesic equation, 157 
geodesics, 157-60 

geometrical interpretation of gradient, 35-38 
integration by parts of, 36-37 
of potential, force as, 36 
geometric series, 322-23 
Gibbs phenomenon, 886, 910-14 
calculation of overshoot, 912-13 
square wave, 911-12 
summation of series, 910 
global behavior, 1093-1101 
Goursat proof of Cauchy’s integral theorem, 
421-23 
gradient 

in Cartesian coordinates, 37, 51, 113, 134 
in circular cylindrical coordinates, 118 
in curvilinear coordinates, 110 
in spherical polar coordinates, 126 
gradient, curvilinear coordinates, 110 
gradient, V, 32-38 

as differential vector operator, 110 
of dot product, 46 
exercises, 37-38 

geometrical interpretation, 35-38 
integration by parts of, 36-37 


of potential, force as, 36 
integral definitions of divergence, curl, and, 
58-59 

overview, 32-34 
of potential, 34 

Gram-Schmidt orthogonalization, 642-49 
Gram-Schmidt procedure, 173-74 
overview, 173-74 
vectors by orthogonalization, 174 
gravitational potentials, 72 
great circle, 1040 
Green’s function, 662-74 

construction of, one dimension, 598, 599, 
663-65, 670 

construction of, two dimension, 597-98 

construction of, three dimension, 597-98 

and Dirac delta function, 669-70 

eigenfunction, eigenvalue equation, 667-68 

eigenfunction expansion, 662-82 

electrostatic analog, 592, 665 

form of, 596-98 

Helmholtz, 598 

Helmholtz equation, 662 

integral — differential equation, 665-67 

Laplace operator, 598 

circular cylindrical expansion, 601-6 
spherical polar expansion, 598-600 
linear oscillator, 668-69 
modified Helmholtz, 598 
nonhomogeneous equation, 592-610 
one-dimensional, 663-65 
Poisson’s equation, 669-70 
symmetry of, 595-96 
Green’s theorem, 61-62, 593 
Gregory series, 362, 368 
ground state eigenfunction, 1073 
group theory, 241-320, see also angular 

momentum; differential forms; generators 
of continuous groups; homogeneous 
Lorentz group 
character, 184 
definition of, 242-43 
discrete, 291-93 

classes and character, 293 
crystallographic point and space, 299-300 
dihedral, D n , 299 
exercises, 300-304 
subgroups and cosets, 293-94 
threefold symmetry axis, 296-99 
twofold symmetry axis, 294-96 
faithfulness, 243 
homomorphic, 243 

homomorphism and isomorphism, 243-45 
homomorphism SU(2)-SO(3), 252-6 
isomorphic, 243 
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Lorentz covariance of Maxwell’s equations, 
283-91 

electromagnetic invariants, 288 
exercises, 289-91 
overview, 283-86 
transformation of E and B, 287-88 
overview, 241—42 
permutation groups, 301-3 
quantum chromodynamics (QCD), 258 
reducible and irreducible representations, 
245-46 

special unitary group SU(2), 251 
vierergruppe, 292-93, 296 
Gutzwiller’s trace formula, 898 

H 

Hadamard product, 208 
Hamilton-Jacobi equation, 539 
Hamilton’s principle, 1053-54 
Hankel functions and Lagrange equations of 
motion, 493-94, 707-13 
asymptotic forms, 493-94, 723 
contour integral representation of the Hankel 
functions, 709-11 
cylindrical traveling waves, 708 
definition, by Neumann function, 707-8 
definitions, 707-8 
series expansion, 707, 715 
spherical, 728-29 
Wronskian formulas, 708 
Hankel transforms, 933 
harmonic functions, 539 
harmonic oscillator, 822-27, 958-59 
harmonics, see also spherical harmonics, vector 
spherical harmonics 
harmonic series, 323-24 
Hausdorff, 225, 249, 1086 
heat flow PDE, 948^-9 
Heaviside expansion theorem, 442, 1003 
Heaviside shifting theorem, 981 
Heaviside unit step function, 93, 996 
Heisenberg uncertainty principle, 732, 941 
Helmholtz diffusion equation, 536, 537 
Helmholtz equation, 556, 557, 613 
Bessel function, 683-84, 725 
Green’s function, 662 
spherical coordinates, 725 
Helmholtz operators, 598 
Helmholtz’s theorem, 95-101 
exercises, 100-101 
overview, 95-96 
Hermite functions, 817-36, 866 
alternate representations, 819 
applications of the product formulas, 831-32 
confluent hypergeometric representation, 866 


direct expansion of products of Hermite 
polynomials, 828-30 

generating functions — Hermite polynomials, 
817-18 

Gram-Schmidt construction, 642 
orthogonality, 821-22 
quantum mechanical simple harmonic 
oscillator, 822-27 
recurrence relations, 818-19 
Rodrigues representation, 820-21 
threefold Hermite formula, 827-28 
Hermite polynomials 

direct expansion of products of, 828-30 
generating functions, 817-18 
orthogonality integral, 821 
recurrence relations, 818-19 
Rodrigues representation, 820-21 
Hermitian matrices, 184, 209 

and matrix diagonalization, 219-21 
unitary and, 208-15 
exercises, 212-15 
overview, 208-9 
Pauli and Dirac, 209-12 
Hermitian matrices, anti-, 221-23 
eigenvalues 
degenerate, 223 

and eigenvectors of real symmetric matrices, 
221-22 
overview, 221 

Hermitian operators, 629-30, 634-42 
completeness of eigenfunctions, 649-58 
degeneracy, 638 
expansion in orthogonal 

eigenfunctions — square wave, 637 
Fourier series — orthogonality, 636-37 
integration interval, 628-29 
orthogonal eigenfunctions, 636 
properties of, 634-38 
in quantum mechanics, 630 
real eigenvalues, 634-35 
Hilbert matrix, determinant, 235 
Hilbert-Schmidt theory, 1029-36 

nonhomogeneous integral equation, 1032-34 
orthogonal eigenfunctions, 1030-32 
symmetrization of kernels, 1029-30 
Hilbert space, 7, 535, 629, 638, 658, 885 
Hilbert transforms, 483 
Hodge * operator, 314—19 
cross product of vectors, 315 
Laplacian in orthogonal coordinates, 316 
Maxwell’s equations, 316-20 
overview, 314-15 

holomorphic functions (analytic or regular 
functions), 415 

homogeneous equations, 165-66, 565 
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homogeneous Lorentz group, 278-83 
exercises, 283 

kinematics and dynamics in Minkowski 
space-time, 280-83 
overview, 278-80 
homomorphic group, 243 
homomorphism, 243—45 
overview, 243 
rotations, 244-45 
SU(2) and SO(3), 252-56 
hooks, 275-76 
Hubble’s law, 7 

hydrogen atom, 843-45, 957-58 
Schrodinger’s wave equation, 843 
hyperbolic PDEs, 538 
hypercharge, 257 
hypergeometric equation 
alternate forms, 860, 864 
second independent solution, 860 
singularities, 564, 859, 864, 865, 873 
hypergeometric functions, 859-63 
contiguous function relations, 861 
hypergeometric representations, 861-62 

I 

ill-conditioned matrices, 234-35 
imaginary part, 407 
impulsive force, 975-76 
incomplete gamma function, 389-92 

confluent hypergeometric representation, 500, 
864 

recurrence relations, 399, 512 
independence, linear, 173, 579-81, 643, 665, 703 
of solutions of ordinary differential equations, 
579-81 

of vectors, 173, 579 
indicial equation, 566 
inertia matrix, moment of, 215-16 
infinite limit (Euler), 499-500 
infinite product (Weierstrass), 499-500, 501-3 
infinite products, 378, 383, 396-99, 499, 501-3 
convergence, 397-98 
cosine, 398-99 
entire functions, 462 
gamma function, 398-99 
sine, 398-99 

infinite series, 321-401, see also alternating 
series; power series; Taylor’s expansion 
algebra of, 342^-8 

alternating series, 342-43 
convergence, 342-45 
convergence: absolute, 342^44 
convergence: Cauchy integral, 327-29 
convergence: Cauchy root, 326 
convergence: comparison, 325-26 


convergence: conditional, Leibniz criterion, 
344 

convergence: D’Alembert ratio, 326-27 
convergence: Gauss’, 332-33 
convergence: improvement of, 345 
convergence: Kummer’s, 330-32 
convergence: Maclaurin integral, 327-30 
convergence: Raabe’s, 332 
convergence: tests of, 325-35 
convergence: uniform, 348-51, 363-64 
divergence of squares, 344 
double series, 345^-7 
exercises, 347^48 
overview, 342-44 
rearrangement of double, 345-48 
asymptotic series, 389-96 

cosine and sine integrals, 392-93 
definition of, 393-94 
exercises, 394-96 

incomplete gamma function, 389-92 
overview, 389 
Bernoulli numbers, 376-89 

Euler-Maclaurin integration formula, 380-82 
exercises, 385-89 
improvement of convergence, 385 
overview, 376-79 
polynomials, 379-80 
Riemann Zeta function, 382-84 
elliptic integrals, 370-76 
definitions of, 372 
exercises, 374-76 
limiting values, 374 
overview, 370 

period of simple pendulum, 370-71 
series expansion, 372-73 
of functions, 348-52 
Abel’s test, 351 
exercises, 352 
overview, 348 

uniform and nonuniform convergence, 
348^49 

Weierstrass M test, 349-50 
fundamental concepts, 321-25 

addition and subtraction of, 324-25 
exercises, 325 
geometric, 322-23 
harmonic, 323-24 
overview, 321-22 
power series, 363-66, 578-79 
products of, 396^-01 
convergence of, 397-98 
exercises, 399^401 
overview, 396-97 

sine, cosine, and gamma functions, 398-99 
Riemann’s theorem, 894-98 
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infinity, see singularity, pole, essential singularity 
inhomogeneous linear equations, 166-67 
inhomogeneous ordinary differential equation 

(ODE), Green’s function solutions, 663-64 
inner product and matrix multiplication, 179-81 
integral definitions of gradient, divergence, and 
curl, 58-59 

integral — differential equation, 665-67 
integral equations, 1005-36 

and Fourier series for Mathieu functions, 
919-23 

Fredholm equations, 1005, 1007, 1010, 1013, 
1018, 1021-24, 1030-32 
Hilbert-Schmidt theory, 1029-36 
exercises, 1034-36 

nonhomogeneous integral equation, 1032-34 
orthogonal eigenfunctions, 1030-32 
symmetrization of kernels, 1029-30 
integral transforms, generating functions, 
1012-18 

exercises, 1015-18 
Fourier transform solution, 1013 
generalized Abel equation, convolution 
theorem, 1014 

generating functions, 1014-15 
introduction, 1005-12 
definitions, 1005-6 
exercises, 1011 

linear oscillator equation, 1009-11 
momentum representation in quantum 
mechanics, 1006-7 

transformation of a differential equation into 
an integral equation, 1008-9 
Neumann series, separable (degenerate) kernels, 
1018-29 

exercises, 1025-29 
Neumann series, 1018-19 
Neumann series solution, 1020-21 
numerical solution, 1023-25 
separable kernel, 1021-22 
Volterra equations, 991, 1005-6, 1009-11, 1021 
integral form, Neumann functions, 701 
integral representations, 505-6, 679-80 
for Dirac delta function, 90 
expansion of, 720-23 

integrals, see also Cauchy (Maclaurin) integral 
test; definite integrals; elliptic integrals 
contour integration, 463, 471, 503, 522, 603 
differentiation of, 590 
evaluation of, 810 
Lebesgue, 649, 657 
line, 55-56, 65-67, 440 

of products of three spherical harmonics, 803-6 
Riemann, 55, 60-61, 605, 636 
Stieltjes, 86, 873 


surface, 56-57 
volume, 57-58 

integral test, Cauchy, see Cauchy (Maclaurin) 
integral test 

integral transforms, 931-1004 

convolution (Faltungs) theorem, 990-94 
driven oscillator with damping, 991-93 
exercises, 993 

convolution theorem, 951-55 
exercises, 953-55 
Parseval’s relation, 952-53 
development of the Fourier integral, 936-38 
Dirac delta function derivation, 937-38 
Fourier integral — exponential form, 937 
Fourier transform, 931-32 
Fourier transform of derivatives, 946-51 
heat flow PDE, 948^19 
inversion of PDE, 949-50 
wave equation, 947-48 
Fourier transform of Gaussian, 932 
Fourier transforms — inversion theorem, 
938^16 

cosine transform, 939 
exercises, 942^46 
exponential transform, 938 
finite wave train, 940-41 
sine transform, 939—40 
uncertainty principle, 941 
Fourier transforms of derivatives, 950-51 
generating functions, 1012-18 
Fourier transform solution, 1013 
generalized Abel equation, convolution 
theorem, 1014 

generating functions, 1014-15 
integral transforms, 931-35 
exercises, 934-35 
Fourier transform, 931-32 
Fourier transform of Gaussian, 932 
Laplace, Mellin, and Hankel transforms, 933 
linearity, 933-34 

inverse Laplace transform, 994-1003 
Bromwich integral, 994-95 
exercises, 1000-1003 
inversion via calculus of residues, 996 
summary — inversion of Laplace transform, 
999-1000 

velocity of electromagnetic waves in a 
dispersive medium, 997-99 
Laplace, Mellin, and Hankel transforms, 933 
Laplace transform of derivatives, 971-78 
Dirac delta function, 975 
Earth’s nutation, 973-74 
exercises, 976-78 
impulsive force, 975-76 
simple harmonic oscillator, 973 
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Laplace transforms, 965-71 
definition, 965 

elementary functions, 965-66 
exercises, 970-71 
inverse transform, 967-68 
partial fraction expansion, 968-69 
step function, 969-70 
linearity, 933-34 

momentum representation, 955-61 
exercises, 959-61 
harmonic oscillator, 958-59 
hydrogen atom, 957-58 
other properties, 979-89 
Bessel’s equation, 983-84 
damped oscillator, 979-80 
derivative of a transform, 982-83 
electromagnetic waves, 981-82 
exercises, 985-89 
integration of transforms, 984 
limits of integration — unit step function, 985 
RLC analog, 980-81 
substitution, 979 
translation, 981 
transfer functions, 961-64 
exercises, 964 

significance of 0(0, 963-64 
integration, 904, see also path-dependent work 
Euler-Maclaurin formula, 380-82 
by parts of curl, 47 
by parts of divergence, 40 
by parts of gradient, 36 
of power series, 364 
simple pole on contour of, 468-69 
of transforms, 984 
of vectors, 54-60 
exercises, 59-60 
overview, 54-56 

integration interval [a , b ], 628-29 
interpolating polynomials, 194 
interpretation, see geometrical interpretation of 
gradient; physical interpretation of 
divergence 
interitem, 1111 

invariance of scalar product under rotations, 15-17 
invariants, electromagnetic, 288 
inverse Laplace transform, 994-1003 
Bromwich integral, 994-95 
inversion via calculus of residues, 996 
summary — inversion of Laplace transform, 
999-1000 

velocity of electromagnetic waves in a 
dispersive medium, 997-99 
inverse matrix, 200 
inverse operator, 934, 1019 
inverse transform, 967-68 


inversion, 445-46 
matrix, 184-87 
Gauss-Jordan, 185-87 
overview, 184-85 
ofPDE, 949-50 
of power series, 366 
via calculus of residues, 996 
irreducible representations, 245-46 
irreducible tensors, 149-51 
irregular (essential) singular point, 563 
irregular sign changes, series with, 341—42 
irregular singularities, 572-73 
irrotational, 45 
isomorphic group, 243 
isomorphism, 243—45 
overview, 243 
rotations, 244—45 
isospin, SU(2), 256-60 
isospin I, 257 

j 

Jacobian, 107-8 

parity transformation, 146 
Jacobians for polar coordinates, 108-10 
Jacobi-Anger expansion, 687 
Jacobi identity, 248 
Jacobi technique, 226 
Jordan’s lemma, 468 
Julia set, 1087 

K 

kaon decay, 282-83 

Kepler’s laws of planetary motion, 116-17 
kinematics and dynamics in Minkowski 
space-time, 280-83 
Kirchhoff diffraction theory, 426 
Klein-Gordon equation, 537 
Korteweg-deVries equation, 542 
Kronecker delta, 10, 136-37 
Kronecker product, 181 

Kronig-Kramers optical dispersion relations, 484, 
485 

Kummer’s equation, see confluent hypergeometric 
equation 

Kummer’s test, 330-32 

L 

ladder operators, approach to orbital angular 
momentum, 262-64 
Lagrange’s equations, 1066 
Lagrangian, 1053-54 
Lagrangian equations, 1066-67 
Lagrangian multipliers, 1060-65 
cylindrical nuclear reactor, 1062 
particle in a box, 1061-62 
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Laguerre functions, 837^-8 

associated Laguerre polynomials, 841-43 
differential equation — Laguerre polynomials, 
837-41 

hydrogen atom, 843—45 
Laguerre polynomials, 624 
associated, 624-25 

confluent hypergeometric representation, 866 
generating function, 841-42 
integral representation, 843 
orthogonality, 843 
recurrence relations, 842 
Rodrigues’ representation, 767, 842 
confluent hypergeometric representation, 866 
differential equation, 837—41 
generating function, 837-39 
Gram-Schmidt construction, 647 
orthogonality, 624, 647 
recurrence relations, 840, 842 
Rodrigues’ formula, 839 
Schrodinger’s wave equation, 843 
self-adjoint form, 624, 840 
singularities, 564 

Laplace, Mellin, and Hankel transforms, 933 
Laplace function, 598 
Laplace’s equation, 536, 1057-58 
Bessel functions, 695 
Legendre polynomials, 760, 761 
solutions, 50-51, 96, 443, 452, 539, 559-60 
Laplace series 

expansion theorem, 790-91 
gravity fields, 791 
Laplace transforms, 965-71 

convolution theorem, 521, 1000, 1003, 1014 
definition, 965 
of derivatives, 971-78 
Dirac delta function, 975 
Earth’s nutation, 973-74 
impulsive force, 975-76 
simple harmonic oscillator, 973 
elementary functions, 965-66 
inverse transform, 967-68 
partial fraction expansion, 968-69 
step function, 969-70 
table of transforms, 967-68, 979 
translation, 1000 
Laplacian 

in Cartesian coordinates, 51-52, 554-55 
in circular cylindrical coordinates, 119 
development by minors, 167-68 
in orthogonal coordinates, 316 
of potentials, 50-51 
spherical polar coordinates, 126 
as tensor derivative operator, 161-62 
Laurent expansion, 430-38, 466, 472 


analytic continuation, 432-34 
exercises, 437-38 

Schwarz reflection principle, 431-32 
Taylor expansion, 430-31 
law of cosines, 16-17, 118, 745 
leading coefficients for ceo, 926-29 
leading coefficients of se^, 923-26 
least squares, method of, 1119 
Legendre duplication formula, derivation of, 
522-23 

Legendre equation, Maxwell’s equation, 779 
self-adjoint form, 623, 625 
Legendre functions, 741-816 
addition theorem, 798 
addition theorem for spherical harmonics, 
797-802 

derivation of addition theorem, 798-800 
exercises, 800-802 
trigonometric identity, 797-98 
alternate definitions of Legendre polynomials, 
767-70 

exercises, 769-70 
Rodrigues’ formula, 767 
Schlaefli integral, 768-69 
associated, 772 

associated Legendre functions, 771-86 
associated Legendre polynomials, 772-74 
equation, 558, 771-72, 778-82, 788 
Fourier transform, 770 
Gram-Schmidt construction, 789 
hypergeometric representation, 861 
lowest associated Legendre polynomials, 774 
magnetic induction field of a current loop, 
778-82 

orthogonality, 776-78 
parity, 776 
poles, 760, 782 
recurrence relations, 775 
Rodrigues’ formula, 772-73 
Schlaefli integral, 768 
second kind, 806-12 
self-adjoint form, 771-72 
special values, 774-75 
generating function, 741^-9 
exercises, 747^19 

extension to ultraspherical polynomials, 747 
Legendre polynomials, 742^-4 
linear electric multipoles, 744^-5 
physical basis — electrostatics, 741—42 
vector expansion, 745^17 
integrals of products of three spherical 
harmonics, 803-6 

application of recurrence relations, 804-5 
exercises, 805-6 

orbital angularmomentum operators, 793-97 
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orbital angular momentum operators, 796-97 
orthogonality, 756-67 

Earth’s gravitational field, 758-59 
electrostatic potential of a ring of charge, 
761-62 

exercises, 762-66 

expansion of functions, Legendre series, 
757-58 

polarization of dielectric, 764 
ring of electric charge, 761-62 
sphere in a uniform field, 759-61 
recurrence relations and special properties, 
749-56 

differential equations, 751-52 
exercises, 754-56 
parity, 753 

recurrence relations, 749-50 
special values, 752 

sphere in uniform electric field, 759-61 
upper and lower bounds for P n (cos6), 7534- 
of second kind, 806-13 
closed-form solutions, 810-12 
exercises, 812-13 

Q n (x ) functions of the second kind, 809-10 
series solutions of Legendre’s equation, 
807-9 

spherical harmonics, 786-93 
azimuthal dependence — orthogonality, 787 
exercises, 791-93 

Laplace series, expansion theorem, 790-91 
Laplace series — gravity fields, 791 
polar angle dependence, 788 
spherical harmonics, 788-90 
vector spherical harmonics, 813-16 
Legendre polynomials, 6444-6, 741, 742-44 
associated 

generating function, 773 
recurrence relations, 775 
generating function, 743 
by Gram-Schmidt orthogonalization, 64446 
Laplace’s equation, 760, 761 
orthogonality integral, 777 
recurrence relations, 749-50 
Rodrigues’ formula, 761 
Schlaefli integral, 768 
Legendre’s duplication formula, 503 
Legendre’s equation, 625 
differential form, 752 
Legendre’s equation 

self-adjoint form, 625, 771 
Legendre’s equation 

series solutions of, 807-9 
Legendre series, 333, 807-9 
recurrence relations, 807-8 
Leibniz criterion, 339—40 


formula for differentiating an integral, 590, 776 
formula for differentiating a product, 771 
Lerch’s theorem, 967 
Levi-Civita symbol, 146-47 
L’Hopital’s rule, 365 

Lie groups and algebras, 243, 248, 264-66 
limits of integration — unit step function, 985 
limits to values of elliptic integrals, 374 
linear electric multipoles, 744-45 
linear equations 

homogeneous, 165-66 
inhomogeneous, 165-66 
linear independence of solutions, 581-83 
linearity, 933-34 
linearly dependent solutions, 549 
linearly independent solutions, 549 
linear operator, 87, 176, 208, 535, 622, 650 
differential operator, 42-43, 249, 261, 285, 304, 
307, 554, 569, 629, 634, 664 
integral operator, 768, 1019 
linear oscillator 

Green’s function, 668-69 
linear oscillator equation, 1009-11 
linear transformation law, 152 
line integrals, 55 
Liouville’s theorem, 428 
liquid drop model, 785 
logistic map, 1080-84 
Lommel integrals, 697 
Lorentz covariance of Maxwell’s equations, 
283-91 

electromagnetic invariants, 288 
exercises, 289-91 
overview, 283-86 

transformation of E and B, 287-88 
Lorentz-Fitzgerald contraction, 148 
Lorentz gauge, 52 

Lorentz group, see homogeneous Lorentz group 
lowering operator, 263 

lowest associated Legendre polynomials, 774 
Lyapunov exponents, 1085-86 

M 

Maclaurin expansion, series computation, 512 
Maclaurin integral test, 327-30 
Riemann Zeta function, 329-30 
Maclaurin theorem, 354-55 
exponential function, 354-55 
logarithm, 355 
overview, 354 
Madelung constant, 347 

magnetic, 19, 46, 51, 66-67, 69, 74-76, 96, 100, 
127-28, 144-45, 283-84, 288, 306, 311, 
317, 447, 537, 638, 685, 703-5, 746, 
778-82, 974 
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magnetic field constant (B field), 44 

magnetic flux across an oriented surface, 306 

magnetic induction field of current loop, 778-82 

magnetic moments, 145 

magnetic vector potentials, 44, 74-76, 127-28 

Mandelbrot set, 1087-88 

mapping 

complex variables, 443-51 

branch points and multivalent functions, 
447-50 

exercises, 450-51 
inversion, 445^46 
overview, 443 
rotation, 444 
translation, 443^14 
conformal, 451-54 
exercises, 453-54 
Mathieu equation 
angular, 872 
modified, 872 
radial, 872 

Mathieu functions, 869-79, 921 
elliptical drum, 872-73 
Fourier expansions of, 919-29 

integral equations and Fourier series for 
Mathieu functions, 919-23 
leading coefficients for ceo, 926-29 
leading coefficients of sej, 923-26 
general properties of Mathieu functions, 874 
quantum pendulum, 873 
radial Mathieu functions, 874-79 
separation of variables in elliptical coordinates, 
870-71 

matrices, 165-239, see also determinants; 
diagonal matrices; orthogonal matrices 
addition and subtraction, 178-79 
adjoint, 208 

angular momentum matrices, 253, 273 
anticommuting sets, 236 
antihermitian, 221-23, 231 
antisymmetric, 204 
definition, 176 
diagonalization, 215-26 
direct product, 181-82 
equality, 178 

Euler angle rotation, 202-3 
exercises, 187-95 

Gauss-Jordan matrix inversion technique, 185 
Hermitian and unitary, 208-15 
exercises, 212-15 
overview, 208-9 
Pauli and Dirac, 209-12 
inversion of, 184-87 
Gauss-Jordan, 185-87 
overview, 184-85 


ladder operators, 263 
matrix multiplication, 176, 179-81 
moment of intertia, 215-16, 220 
multiplication, 179-80 
direct product, 181-82 
inner product, 179-81 
by scalar, 179 
normal, 231-39 
exercises, 236-39 
ill-conditioned systems, 234-35 
normal modes of vibration, 233-34 
overview, 231-32 
null matrix, 178 

orthogonal matrix, 201, 206, 209 
overview, 176-78 
product theorem, 181 
quaternions, 204, 212 
rank, 178 

relation to tensor, 206 

representation, 177, 184, 205, 208, 212 

self-adjoint, 209 

similarity transformation, 205 

skewsymmetric, 204 

symmetric, 204 

traces, 139, 183-84 

transposition, 177 

unitary, 209 

vector transformation law, 198 
Maxwell’s equations, 51, 284, 316-20 
derivation of wave equations, 52 
dual transformation, 290 
Gauss’ law, 52-53 
Legendre equation, 779 
Lorentz covariance of, 283-91 
electromagnetic invariants, 288 
exercises, 289-91 
overview, 283-86 
transformation of E and B, 287-88 
Oersted’s law, 52-53 
mean value theorem, 353 
Mellin transforms, 897, 933 
meromorphic functions, 439, 461 
integral of, 466 
pole expansion of, 461 
metric, curvilinear coordinates, 105 
metric tensor, 151-54 

Christoffel symbols as derivatives of, 155-56 
minimal substitution, 76 
Minkowski space, 136, 278-79 
Minkowski space-time, see kinematics and 
dynamics in Minkowski space-time 
minor, 168 

minors, Laplacian development by, 167-68 
missing dependent variables, 1042^43 
Mittag-Leffler theorem, 461 
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mixed tensor, 136, 139, 154 
modes of vibration, normal, 233-34 
modified Bessel functions, 713-19 
asymptotic expansion, 711, 719 
Fourier transform, 716 
generating function, 709 
integral representation, 720-23 
Laplace transform, 933 
recurrence relations, 714-16 
series form, 714 

modified Helmholtz operator, 598 
modified Mathieu equation, 872 
modulus, 406 

moment of inertia matrix, 215-16 
momentum, see angular momentum; orbital 
angular momentum 
momentum representation, 955-61 
harmonic oscillator, 958-59 
hydrogen atom, 957-58 
Schrodinger wave equation, 957-58 
momentum representation in quantum mechanics, 
1006-7 

monopole, 745^46 
Morera’s theorem, 427-28 
motion 

area law for planetary, 116-19 
equations of, 142 
moving particle 

Cartesian coordinates, 1054 
circular cylindrical coordinates, 1054-55 
multiplet, 245 
multiplication 
of matrices 

direct product, 181-82 
of vectors, 182 
inner product, 179-81 
by scalar, 179 

multiply connected regions, 423-24 
multipole expansion, electrostatic, 599 
multivalent functions, 447-50 
multivalued function, 409 
mutually exclusive, 1109-10 

N 

Navier-Stokes equations, 119 
Neumann boundary conditions, 543 
Neumann functions, 511 
asymptotic form, 602-3 
Bessel functions of second kind, 699-707 
coaxial wave guides, 703^4 
definition and series form, 699-700 
other forms, 701 
recurrence relations, 702 
Wronskian formulas, 702-3 
Fourier transform, 602 


Hankel function definition, 707-8 
integral form, 701 
recurrence relations, 702 
spherical, 507, 727 
Wronskian formulas, 702-3 
Neumann functions, integral form, 701 
Neumann problem, 617 
Neumann series, 1018-19 
Neumann series, separable (degenerate) kernels, 
1018-29 

numerical solution, 1023-25 
separable kernel, 1021 -22 
Neumann series solution, 1020-21 
neutron diffusion theory, 369, 951 
Newton’s second laws, 130, 233, 370, 973, 1054 
node, spiral, 1097, 1103-4 
non-Cartesian tensors, 140 
nonessential (regular) singular point, 563 
nonhomogeneous equation — Green’s function, 
592-610 

circular cylindrical coordinate expansion, 601-2 
form of Green’s functions, 596-98 
Legendre polynomial addition theorem, 

600-601 

spherical polar coordinate expansion, 598-600 
symmetry of Green’s function, 595-96 
nonhomogeneous integral equation, 1032-34 
nonlinear differential equations (NDEs), 1088-89 
autonomous differential equations, 1091-93 
Bernoulli and Riccati equations, 1089-90 
bifurcations in dynamical systems, 1103—4 
center or cycle, 1100-1101 
chaos in dynamical systems, 1105-6 
dissipation in dynamical systems, 1102-3 
fixed and movable singularities, special 
solutions, 1090 

local and global behavior in higher dimensions, 
1093-94 

routes to chaos in dynamical systems, 1106-7 
saddle point, 1095-97 
spiral fixed point, 1098-1100 
stable sink, 1095 

nonlinear methods and chaos, 1079-1108 
introduction, 1079-80 
logistic map, 1080-84 
exercises, 1084 

nonlinear differential equations (NDEs), 
1088-89 

autonomous differential equations, 1091-93 
Bernoulli and Riccati equations, 1089-90 
bifurcations in dynamical systems, 1103-4 
center or cycle, 1100-1101 
chaos in dynamical systems, 1105-6 
dissipation in dynamical systems, 1102-3 
exercises, 1089, 1102, 1106, 1107 
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fixed and movable singularities, special 
solutions, 1090 

local and global behavior in higher 
dimensions, 1093-94 

routes to chaos in dynamical systems, 1106-7 
saddle point, 1095-97 
spiral fixed point, 1098-1100 
stable sink, 1095 

sensitivity to initial conditions and parameters, 
1085-88 
exercises, 1088 
fractals, 1086-88 
Lyapunov exponents, 1085-86 
nonuniform convergence, 348—49 
normalization, 695 
normal matrices, 231-39 
exercises, 236-39 
ill-conditioned, 234-35 
normal modes of vibration, 233-34 
overview, 231-32 
null matrix, 178 
number operator, 823 

numbers, Bernoulli, see Bernoulli numbers 
numerical solution, 1023-25 
nutation, 973-74 

o 

Oersted’s law, 52, 66-68 
Olbers’ paradox, 337 

operators, differential vector, see differential 
vector operators 
optical dispersion, 484-85 
optical path near event horizon of black hole, 
1041-42 

orbital angular momentum, 251, 261-66 
exercises, 266 

ladder operator approach, 262-64 
Lie groups and algebras, 264-66 
Lie groups and operators, order of, 264-65 
operators, 793-97 
overview, 261 
rotation of, 251 
order 2 branch points, 440^12 
order parameter, 1086 

ordinary differential equations (ODEs), linear 
first-order, 547-50 

oriented surface, magnetic flux across, 306 
orthogonal coordinates 
Laplacian in, 316 
in M 3 , 103-10 
exercises, 109-10 

Jacobians for polar coordinates, 108 
overview, 103-8 

orthogonal eigenfunctions, 636, 637, 1030-32 


orthogonal functions, representation of Dirac delta 
function by, 88-89 
orthogonal groups, 243 
orthogonal group SO(3), 254, 256 
orthogonality, 694-99, 731, 776-78, 821-22, 
854-55 

Bessel series, 695 
continuum form, 696 
curvilinear coordinates, 104 
Earth’s gravitational field, 758-59 
electrostatic potential in hollow cylinder, 

695-96 

electrostatic potential of ring of charge, 761-62 
expansion of functions, Legendre series, 757-58 
Fourier series, 636-37 
Fourier series: Hilbert-Schmidt integral 
equations, 919-29 
normalization, 695 
over discrete points, 914-15 
sphere in a uniform field, 759-61 
Sturm-Liouville differential equations, 1031 
of vectors, 14 

orthogonality condition, 10, 198 
orthogonality integral 
Hermite polynomials, 821 
Legendre polynomials, 777 
spherical harmonics, 788 
orthogonality relations, spherical harmonics, 814 
orthogonalization, Gram-Schmidt, 173, 642-7 
orthogonal matrices, 195-208, 209 
applications to vectors, 197-98 
direction cosines, 196-97 
Euler angles, 202-3 
exercises, 206-8 
inverse, 200 
overview, 195-96 
relation to tensors, 206 
symmetry properties, 203-5 
transpose matrix, A, 200-202 
two-dimensional conditions for, 199-200 
orthonormal functions, 642^44 
polynomials, 646^-7 
vectors, 174 
oscillator 

damping, 979-80, 991-93, 1101 
driven, 457, 565, 991-93 
forced classical, 457-60 
harmonic, 822-27 
integral equation for, 991-93 
Laplace transform solution, 991-93 
linear, 668-69 

momentum space wave function, 569 

self-adjoint equation, 679 

series solution of differential equation, 568-69 
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singularities in harmonic oscillator differential 
equation, 564 
oscillatory series, 322 
overshoot, calculation of, 912-13 

P 

parabolic PDEs, 538 
parallelogram addition law, 2-3 
parallel transport, 157-60 
parity, 753, 776, 939 
Bessel functions, 687, 735 
Chebyshev functions, 569 
differential operator, 569 
Fourier cosine, sine transforms, 939 
Hermite functions, 569 
Legendre functions, 569 
Legendre functions, associated, 776 
Legendre functions, second kind, 812 
spherical harmonics, 776, 791 
vector spherical harmonics, 814 
parity transformation, 143 
Parseval relation, 485-86, 952-53 
partial differential equations (PDEs), 535^43 
bicharacteristics of, 538 
boundary conditions, 542-43 
characteristics of, 538-41 
classes of, 538^-1 
elliptic, 538 
examples of, 536-38 
harmonic functions, 539 
hyperbolic, 538 
introduction, 535-36 
inversion of, 949-50 
nonlinear, 541^42 
parabolic, 538 

partial fraction expansion, 968-69 
partial sum approximation, 390 
particle 

in a box, 1061-62 
in a sphere, 731-32 
particle motion 

Cartesian coordinates, 1054 
circular cylindrical coordinates, 1054-55 
quantum mechanical, 827 
in rectangular box, 1061-62 
in right circular cylinder, 1062 
in sphere, 731-32 
path-dependent work, 56-60 

integral definitions of gradient, divergence, and 
curl, 58-59 
overview, 56 
surface integrals, 56-57 
volume integrals, 57-58 
Pauli matrices, 209-12 
pendulums, period of simple, 370-71 


periodic functions, 888-90 

boundary conditions, 636, 883-5 
permutations and combinations, counting of, 
1114-15 

phase of a complex function, 409 
phase of a complex number, 409 
phase space, 88, 1080, 1091 
physical interpretation of divergence, 40-42 
pi, 7t, 219, 379, 396^100, 586 
Leibniz formula, 590, 776, 886 
Wallis formula, 399 

pion photoproduction threshold, 282-83 
pi-sine relation, verification of, 522 
planetary motion, area law for, 116-19 
Pochhammer symbol, 859-60, 864 
Poincare section, 1088-89, 1104-6 
point and space groups, crystallographic, 299-300 
point source equation, 662 
Poisson distribution, 1130-33 
Poisson’s equation, 536 
and Gauss’ law, 81-83 
Green’s function, 669-70 
polar angle dependence, 788 
polar coordinates, Jacobians for, 108-10, see also 
spherical polar coordinates 
polar vectors, 143^44 

pole expansion of meromorphic functions, 461 
poles, 439 

simple, on contour of integration, 468-69 
poly gamma functions, 511-12 
Catalan’s constant, 513 
polynomials, Bernoulli, 379-80 
potential energy, 309 

potentials, 68-79, see also thermodynamics 
gradient of, 34 
force as, 36 
Laplacian of, 50-51 
overview, 68 
scalar, 68-72 
centrifugal, 72 
gravitational, 72 
overview, 68-71 
vector, 73-79 

of constant B field, 44 
exercises, 77-79 
magnetic, 74-76 
potential theory 

conservative force, 69 
electrostatic potential, 593 
scalar potential, 70 
vector potential, 73, 311 
power series, 363-70 
continuity, 364 
convergence, 363 

uniform and absolute, 363 
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differentiation and integration, 364 
exercises, 366-70 
inversion of, 366 
overview, 363 

uniqueness theorem, 364-65 
L’Hopital’s rule, 365 
prime numbers, 379, 382-83, 897 
prime number theorem, asymptotic, 897-8 
primitive, 898 
principal axis, 216 
principal value, 409 
probability, 1109-51 

binomial distribution, 1128-30 
exercises, 1129 

repeated tosses of dice, 1128-30 
definitions, simple properties, 1109-15 
conditional probability, 1112 
counting of permutations and combinations, 
1114-15 
exercises, 1115 

probability for A or B, 1110-11 
scholastic aptitude tests, 1112-14 
Gauss’ normal distribution, 1134-38 
exercises, 1137-38 
Poisson distribution, 1130-33 
exercises, 1133 
random variables, 1116-28 

continuous random variable: hydrogen atom, 
1117-19 

discrete random variable, 1116-17 
exercises, 1127-28 
repeated draws of cards, 1123-26 
standard deviation of measurements, 1119-23 
sum, product, and ratio of random variables, 
1126-27 
statistics, 1138 

X 2 distribution, 1143^-5 
confidence interval, 1149 
error propagation, 113 8—40 
exercises, 1150 
fitting curves to data, 1140^-3 
student t distribution, 1146-49 
probability for A or B, 1110-11 
product convergence theorem, 344 
products, see also cross product; direct product; 
dot products; scalars 
expansion of entire functions, 462-63 
of infinite series, 396^-01 

convergence of infinite, 397-98 
exercises, 399^401 
overview, 396-97 

sine, cosine, and gamma functions, 398-99 
product theorem, 181 
projection operators, 644 
projections, of vectors, 4, 12 


pseudoscalars, 146 
pseudotensors, 142-51 
dual tensors, 147^-8 
exercises, 149-51 
irreducible tensors, 149-51 
Levi-Civita symbol, 146^-7 
overview, 142^-6 
pseudovectors, 146 
pullbacks, 309-13 

Gauss’ theorem, differential form, 312-13 
overview, 309-10 
Stokes’ theorem, 310-11 
differential form, 311 

Q 

QCD (quantum chromodynamics), 259 
Qn(x ) functions of the second kind, 809-10 
quadrupole, 149, 745^-7, 805 
quantization, 624-25, 1054 
quantum chromodynamics (QCD), 259 
quantum mechanical scattering, 469-71 
quantum mechanical simple harmonic oscillator, 
822-27 

quantum mechanics, sum rules, 484 

angular momentum, 189-92, 251-6, 261-4, 
266-70 

configuration space representation, 957-58 
expectation values, 263 
hydrogen atom, 245^16 
momentum representation, 1006-7 
Schrodinger representation, 1006-7 
quantum pendulum, 873 
quasiperiodic, 1100-1101, 1107 
quaternions, 189, 204, 212 
quotient rule, 141^-2 

equations of motion and field equations, 142 
exercises, 142 
overview, 141—42 

R 

R 3 , orthogonal coordinates in, see orthogonal 
coordinates 
Raabe’s test, 332 
radial Mathieu equation, 872 
radial Mathieu functions, 874-79 
radioactive decay, 553, 977-78, 1129, 1130-31, 
1133 

raising operator, 263 
random variables, 1116-28 

continuous random variable: hydrogen atom, 
1117-19 

discrete random variable, 1116-17 
standard deviation of measurements, 1119-23 
sum, product, and ratio of random variables, 
1126-27 
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rank, 264 

of matrices, 178 
of tensor, 133 
rapidity, 280 

rational approximations, 345 
ratio test, Cauchy, d’Alembert, 326 
Rayleigh formulas, 730 
Rayleigh-Ritz variational technique, 1072-76 
ground state eigenfunction, 1073 
vibrating string, 1074 
real part, 407 

rearrangement of double series, 345—48 
reciprocal, 916 
reciprocal lattice, 27 
reciprocity principle, 665 
rectifier, full-wave, 893-94 
recurrence relations, 567, 714-16, 749-50, 775, 
818-19 

application of, 804-5 
associated Legendre polynomials, 775 
Bernoulli numbers, 377 
Bessel functions, 677 
Bessel functions, spherical, 730 
Chebyshev polynomials, 850 
confluent hypergeometric functions, 866 
derivatives, 852-53 
exponential integral, 529 
factorial function, gamma, 504, 506, 529, 995 
Hankel functions, 708 
Hermite polynomials, 818-19 
hypergeometric functions, 861 
Laguerre functions, associated, 842 
Legendre polynomials, 749-50 
Legendre series, 807-8 
modified Bessel functions, 714-16 
Neumann functions, 702 
polygamma functions, 512 
and special properties, 749-56 
differential equations, 751-52 
parity, 753 

recurrence relations, 749-50 
special values, 752 

upper and lower bounds for P n (cos6), 
753-54 

spherical Bessel functions, 730 
reducible representations, 245^46 
reflection principle, Schwarz, 431-32 
regression coefficient, 1140^11 
regular (nonessential) singular point, 563 
regular functions (holomorphic or analytic 
functions), 415 
regular singularities, 572-73 
relations, see dispersion relations 
relativistic energy, 356-57 
repeated draws of cards, 1123-26 


repellant, 1082 
repellor, 1092 
representation 

fundamental, 259-60, 274-75 
irreducible, 246, 263, 265, 268, 274, 276, 293, 
298 

reducible, 246 

residue theorem, 455-56, 472; see also calculus of 
residues 

resonant cavity, 682-85 
Riccati equation, 1089-90 
Riemann-Christoffel curvature tensor, 138 
Riemann integral, 60-61 
Riemann manifold, 313-14 
Riemann’s theorem, 344 
Riemann surface, 448—49 
Riemann Zeta function, 329-30, 334-39 
and Bernoulli numbers, 382-84 
Fourier series evaluation, 329 
table of values, 382 
infinite series, 894-98 
Riesz’ theorem, 177 
RLC analog, 980-81 
RL circuit, 549-50 
Rodrigues’ formula, 767 
Laguerre polynomials, 839 
associated, 767, 842 
Rodrigues representation, 820-21 
Hermite polynomials, 820-21 
root diagram, 264 
root test, Cauchy, 326 
rotations, 176, 444 

of coordinate axes, 7-12 
exercises, 12 

vectors and vector space, 11-12 
of coordinates, 199 

of functions and orbital angular momentum, 251 
groups SO (2) and SO(3), 250 
invariance of scalar product under, 15-17 
isomorphic and homomorphic, 244-45 
Rouche’s theorem, 463 
routes to chaos in dynamical systems, 1106-7 

s 

saddle points (steepest descent method), 489-97, 
1092, 1095-97, 1103 
analytic landscape, 489-90 
asymptotic forms 

of factorial function T, 494-95 
of Hankel function Hy(s), 493-94 
exercises, 496-97 
factorial function T(z), 494-95 
Hankel function H^\ 493-94 
overview, 489 
sample space, 1109-10 
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sawtooth wave, 885-86 
scalar potential, 33-34, 70, 536 
scalar quantities, 1 
scalars, 7, 133 

multiplication of matrices by, 179 
potentials, 68-72 
centrifugal, 72 
gravitational, 72 
overview, 68-71 
products, 12-17 
exercises, 17 

invariance of under rotations, 15-17 
overview, 12-15 
triple, 25-27 

scattering, quantum mechanical, 469-71 
Schlaefli integral, 709, 768-69 
Legendre polynomials, 768 
Schmidt orthogonalonization, see Gram-Schmidt 
scholastic aptitude tests, 1112-14 
Schrodinger’s wave equation, 624 
degeneracy of, 638 
hydrogen atom, 843 

Schrodinger wave equation, 76, 537, 1069-70 
momentum space representation, 957-58 
variational derivations, 1069-70 
S chur’s lemma, 265 
Schwarz inequality, 652-54 
generalized, 661 

Schwarz reflection principle, 431-32 
second-rank tensors, 135-36 
section, see Poincare section 
secular equation, 218 
selection rules, 265 
self-adjoint eigenvalue equations, 595 
self-adjoint matrices, 209 
self-adjoint ODEs, 622-34 
boundary conditions, 627-28 
deuteron, 626-27 

eigenfunctions, eigenvalues, 624-25 
Hermitian operators, 629 
Hermitian operators in quantum mechanics, 630 
integration interval [a, b], 628-29 
Legendre’s equation, 625 
self-adjoint operator, 623, 630 

Sturm-Liouville theory, differential equations, 
622-30 

semiconvergent series, 391 
sensitivity to initial conditions and parameters, 
1085-88 

fractals, 1086-88 
Lyapunov exponents, 1085-86 
separable kernel, 1021-22 
separable variables, 544—45 
separation of variables in elliptical coordinates, 
870-71 


series, see infinite series 
series approach, 570-71 

Bessel’s equation, limitations of, 570-71 
Chebyshev, 338, 569 
Hermite, 567 

hypergeometric, 569, 859, 862 
incomplete beta, 523 
Laguerre, 569 

Legendre, 333, 507, 569, 757-62 
shifted polynomials, 836 
Chebyshev, 850 
Legendre, 629 
ultraspherical, 338 
series form, 714 

of second solution, 583-85 
series solutions — Frobenius’ method, 565-78 
expansion about xq, 569 
Fuchs’ theorem, 573 
limitations of series approach — Bessel’s 
equation, 570-71 

regular and irregular singularities, 572-73 
symmetry of solutions, 569 
sign changes, series with alternating, irregular, 
341^42 

similarity transformation, 205 

simple harmonic oscillator, 973 

simple pendulum, 1067-68 

simple pole on contour of integration, 468-69 

sine 

confluent hypergeometric representation, 393 
functions of infinite products, 398-99 
integrals in asymptotic series, 392-93 
sine transform, 939-40 
singularities, 438—43 
branch points, 440^42 
of order 2, 440^4-2 
exercises, 442^4-3 
fixed, 1090 
Laurent series, 439 
movable, 1090 
overview, 438 
poles, 439 

singular points, 562-65 
essential (irregular), 563 
irregular (essential), 563 
nonessential (regular), 563 
regular (nonessential), 563 
sink, 1092-96, 1101 
sinx 

infinite product representation, 378, 392-93, 
398, 439, 468-69, 583, 679-80, 728-29, 
730, 885, 889, 892, 911, 950, 1021, 
1097-98 

power series, 358, 406, 410 
skewsymmetric matrices, 204 
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Slater determinant, 274 
small oscillations, 370-71 
SO(2) rotation groups, 250 
SO(3) 

Clebsch-Gordan coefficients, 267-70 
homomorphism, 252-56 
rotation groups, 250 
soap film, 1045^-6 
soap film — minimum area, 1046^-9 
solenoidal, 42 
soliton solutions, 542 
space, vector, see vectors 

space and point groups, crystallographic, 299-300 
space-time, Minkowski, see kinematics and 
dynamics in Minkowski space-time 
special unitary groups 

SU (2), Pauli spin matrices, 189, 203-4, 
250-66, 267-70, 274-76 
SU(3), Gell-Mann matrices, 212, 256-60, 
265-66, 274-76 
SU00, Young tableaux, 274-76 
special unitary group SU(2), 252 
special values, 774-75 
spectral decomposition, 219, 225, 635 
sphere in a uniform field, 759-61 
spheres, total charge inside, 88 
spherical Bessel functions, 725-39 
asymptotic values, 729 
definitions, 726-29 
limiting values, 729-30 
recurrence relations, 730 
spherical components, 271 
spherical coordinates, Helmholtz equation, 725 
spherical harmonics, 264, 786-93 
addition theorem for, 797-802 

derivation of addition theorem, 798-800 
trigonometric identity, 797-98 
angular momentum operators, 793 
azimuthal dependence — orthogonality, 787 
Condon-Shortley phase conventions, 270 
integrals of, 804 
ladder operators, 796-97 
Laplace series, expansion theorem, 790-91 
orthogonality integral, 788 
orthogonality relations, 814 
polar angle dependence, 788 
spherical harmonics, 788-90 
vector spherical harmonics, 813-16 
spherical polar coordinates, 123-33, 557-60 
exercises, 128-33 
expansion, 598-600 
magnetic vector potential, 127-28 
V, V-, Vx for central force, 127 
overview, 123-26 
unit vectors, 123 


spherical symmetry, 616 
spherical tensor operator, 271 
spherical tensors, 271-74 
spherical waves, Bessel functions, 730 
spinors, 138-39 
exercises, 138-39 
overview, 138 
spinor wave functions, 212 
spiral fixed point, 1098-1100 
spiral node, 1097, 1103 
spiral repellor, 1097, 1103 
square integrable, 485, 487, 653, 658, 882 
squares of series, divergent, 344 
square wave, 911-12 
square wave — high frequencies, 892-93 
stable sink, 1095 
standard deviation, 1119, 1140 
standard deviation of measurements, 1119-23 
stark effect, 576, 847 
statistical hypothesis, 1138 
statistics, 1138 

X 2 distribution, 1143^-5 
confidence interval, 1149 
error propagation, 1138—40 
fitting curves to data, 1140^-3 
student t distribution, 1146-49 
steepest descent, method of, 489-96 
factorial function, 494—95 
Hankel functions, 493-94 
modified Bessel functions, 720 
step function, 969-70 
Stirling’s expansion, 495 
Stirling’s series, 516-20 

derivation from Euler-Maclaurin integration 
formula, 517 
Stokes’ theorem, 64-68 
alternate forms of, 66-68 

Oersted’s and Faraday’s laws, 66-68 
overview, 66 

on differential forms, 313-14 
Riemann manifold, 313-14 
exercises, 67-68 
overview, 64-65 
proof, 420-21 
pullbacks, 310-11 
straight line, 1044^4-5 
strange attractor, 1085, 1086 
string, Lagrangian of a vibrational, 1058, 1071 
structure constants, 248, 251, 259 
student? distribution, 1146^-9 
Sturm-Liouville theory, 885 
Sturm-Liouville theory — orthogonal functions, 
621-74 

completeness of egenfunctions, 649-61 
Bessel’s inequality, 651-52 
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expansion coefficients, 658 
Schwarz inequality, 652-54 
summary — vector spaces, completeness, 
654-58 

Sturm-Liouville theory — orthogonal functions 
completeness of Eigenfunction, 659-61 
Gram-Schmidt orthogonalization, 642-49 
exercises, 647-49 

Legendre polynomials by Gram-Schmidt 
orthogonalization, 644^46 
Green’s function — eigenfunction expansion, 

662- 74 

eigenfunction, eigenvalue equation, 667-68 
exercises, 670-74 

Green’s function and the Dirac delta function, 
669-70 

Green’s function integral — differential 
equation, 665-67 

Green’s functions — one-dimensional, 

663- 65 

linear ocillator, 668-69 
Hermitian operators, 634—42 
degeneracy, 638 
exercises, 639-42 
expansion in orthogonal 

eigenfunctions — square wave, 637 
Fourier series — orthogonality, 636-37 
orthogonal eigenfunctions, 636 
real eigenvalues, 634-35 
self-adjoint ODEs, 622-34 
boundary conditions, 627-28 
deuteron, 626-27 

eigenfunctions, eigenvalues, 624-25 
exercises, 631-34 
Hermitian operators, 629 
Hermitian operators in quantum mechanics, 
630 

integration interval [a, b], 628-29 
Legendre’s equation, 625 
SU (2) 

Clebsch-Gordan coefficients, 267-70 
isospin and SU(3) flavor symmetry, 256-60 
and SO(3) homomorphism, 252-56 
SU(3) flavor symmetry, 256-60 
subgroups and cosets, 293-94 
substitution, 979 
subtraction 

of matrices, 178-79 
of series, 324—25 
of sets, 1111 
of tensors, 136 

sum, product, and ratio of random variables, 
1126-27 

summation convention, 136-37, 139 
summation of series, 910 


sum rules, 484 

SU (n), young tableaux for, 274—78 
superposition principle for homogenous ODEs, 
PDEs, 536 

surface integrals, 56-57 
symmetric matrices, 204 
symmetric tensor, 137 
symmetrization of kernels, 1029-30 
symmetry, 889 
axes 

threefold, 296-99 
twofold, 294-96 
cylindrical, 617 

properties of orthogonal matrices, 203-5 

relations, 484 

of solutions, 569 

spherical, 616 

SU(3) flavor, 256-60 

of tensors, 137 

T 

tableaux for SU(«), Young, 274-78 
Taylor’s expansion, 352-63, 430-31 
binomial theorem, 356-57 
relativistic energy, 356-57 
exercises, 358-63 
Maclaurin theorem, 354-55 
exponential function, 354—55 
logarithm, 355 
overview, 354 
multiple variables, 358 
overview, 352-54 
tensor analysis 

contravariant tensor, 135-36, 153 
contravariant vector, 134-35, 139, 152-54, 158 
covariant tensor, 135-36, 158 
covariant vector, 134—35, 139^-0, 152-54, 156, 
158 

definition, 133-36 
displacement, 158 
isotropic tensor, 137 
non-Cartesian tensors, 140 
parallel transport, 158 
scalar quantity, 8, 15, 57, 134, 149, 179 
spherical components, 271 
spherical tensor operator, 271 
symmetry-asymmetry, 137 
tensor density, see pseudotensors 
tensor derivative operators 
curl, 162-63 
divergence, 160-61 
exercises, 162-63 
Laplacian, 161-62 
overview, 160 
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tensors, see also derivative operators, tensor; 
direct product; general tensors; 
pseudotensors; quotient rule; spinors 
general tensors, 151-60, see also Christoffel 
symbols 

covariant derivative, 156 
exercises, 158-60 

geodesics and parallel transport, 157-60 
metric tensor, 151-54 
overview, 151 

relation to orthogonal matrices, 206 
spherical, 271-74 
vector analysis in, 133-63 

addition and subtraction of, 136 
contraction, 139 
overview, 133-35 
second-rank, 135-36 
summation convention, 136-37 
symmetry-antisymmetry, 137 
thermodynamics, 72-79 
exact differentials, 72-76 
overview, 72-73 
vector potential, 73-79 
exercises, 77-79 
magnetic, 74-76 
Thomas precession, 280 
threefold Hermite formula, 827-28 
threefold symmetry axis, 296-99 
time-dependent diffusion equation, 536 
time-independent diffusion equation, 536 
Titchmarsh theorem, 487 
trace, 139 

trace formula, 224-25 
Gutzwiller’s, 898 
traces of matrices, 183-84 
trajectory, 38, 1088, 1091-92, 1097, 1099, 1100, 
1103, 1105 
transfer function, 962 
transfer functions, 961-64 
significance of 4>(7), 963-64 
transform, derivative of, 982-83; see also cosines; 
exponential; Fourier; Fourier-Bessel; 
Hankel; Laplace; Mellin; sine 
transformation law, 134 
transformation of differential equation into 
integral equation, 1008-9 
transformation of E and B, Lorentz, 287-88 
translation, 443^44, 981 
transport, parallel, 157-60 
transpose matrix, A, 200-202 
transposition, 177 
triangle inequalities, 406 
triangle rule, 268-69 
trigonometric form, 853-54 
trigonometric identity, 797-98 


triple scalar products, 25-27, 165-66 
triple vector products, 27-29, 46 
BAC-CAB rule, 28, 46, 51 
exercises, 27-32 
overview, 27 

Tschebyscheff, see Chebyshev 
two-dimensional conditions for orthogonal 
matrices, 199-200 
twofold symmetry axis, 294—96 

u 

ultraspherical polynomials, extension to, 747 
equation, 853, 861 
self-adjoint form, 854 

uncertainty principle in quantum theory, 941 
uniform convergence, 348—49, 363 
union of sets, 1111 
uniqueness theorem, 364-65 
descending power series, 781 
inverse operator, 181 
Laurent expansion, 433 
of power series, 364-65 
uniqueness theorem, L’Hopital’s rule, 365 
unitary groups, 243 

unitary matrices, see also Hermitian matrices 
algebra, 210-12 
Heaviside, 93, 981, 985, 996 
ring, 180, 187 
unit element of group, 293 
unit step function, 191 
vector space, 208 
unit vectors, 123 

Cartesian coordinates, 5 
circular cylindrical, 116 
orthogonality relation, 651 
spherical polar, 201-2 
spherical polar coordinates, 126 
upper and lower bounds for P n (cos 6), 753^4 

v 

values, limiting, of elliptic integrals, 374 
variables, see also complex variables 
dependent, 1052-58 
Hamilton’s Principle, 1053-54 
Laplace’s equation, 1057-58 
moving particle — Cartesian coordinates, 
1054 

moving particle — circular cylindrical 
coordinates, 1054-55 

dependent and independent, 1038^14, 1058-59 
alternate forms of Euler equations, 1042 
concept of variation, 1038—41 
missing dependent variables, 1042^43 
optical path near event horizon of a black 
hole, 1041^12 
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multiple, of Taylor’s expansion, 358 
separation of, 554-62 
variance, 1120 

variation, concept of, 1038—41 
variation of the constant, 548 
variations, see also calculus of variations 
variation with constraints, 1065-72 
Lagrangian equations, 1066-67 
Schrodinger wave equation, 1069-70 
simple pendulum, 1067-68 
sliding off a log, 1068-69 
vector analysis 

parallelogram addition law, 2-3 
reciprocal lattice, 27 
rotation of coordinates, 205 
transformation law, 134 
vector definition, 8-9 
representation of, 9 
vector expansion, 745^47 
vector field, 7 
vector integrals 
line integrals, 55 
surface integrals, 56-57 
volume integrals, 57 
vector potential, 73, 311 
vector product, 5, 11, 18-22, 25-29, 43^44, 46, 
147, 272 

vector quantities, 1 

vectors, 1—101, see also curved coordinates and 
vectors; divergence, V; gradient, V; 
integration; potentials; rotations; Stokes’ 
theorem; tensors 

applications of orthogonal matrices to, 197-98 
components, 8, 11, 153, 654 
contravariant, 134-35, 139, 152-54, 158 
covariant, 134-35, 139, 152-54, 156, 158 
cross product of, 315 
curl, V x, 43-49 
of central force field, 44^46 
exercises, 47—49 
gradient of dot product, 46 
integration by parts of, 47 
overview, 43 

potential of constant B field, 44 
definitions and elementary approach, 1-7 
exercises, 6-7 

differential vector operators, 110-14 
curl, 112-13 
divergence, 111-12 
exercises, 113-14 
gradient, 110 
overview, 110 
Dirac delta function, 83-95 
exercises, 91-95 

integral representations for, 90-95 


overview, 83-87 
phase space, 88 

representation by orthogonal functions, 
88-89 

total charge inside sphere, 88 
direction, 5 
direct product of, 182 
elementary approach to, 1-7 
elementary approach to, exercises, 6-7 
Gauss’ law, 79-83 
exercises, 82-83 
Poisson’s equation, 81-83 
Gauss’ theorem, 60-64 
alternate forms of, 62 
exercises, 62-64 
Green’s theorem, 61-62 
overview, 60-61 

by Gram-Schmidt orthogonalization, 174-76 
Helmholtz’s theorem, 95-101 
exercises, 100-101 
overview, 95-96 
irrotational, 45-46 
linear dependence of, 172-73 
normal, 15, 56 
or cross product, 18-22 
exercises, 22-25 
orthogonal, 108, 173 
overview, 1 

potentials, magnetic, 127-28 
scalar or dot product, 12-17 
exercises, 17 

invariance of under rotations, 15-16 
serve as a basis, 5 
space, 11-12 
exercises, 12 

successive applications of V, 49-54 
electromagnetic wave equation, 51-53 
exercises, 53-54 
Laplacian of potential, 50-51 
overview, 49-50 
triangle law of addition, 1-2 
triple product of, 27-29 
exercises, 27-32 
triple scalar product, 25-27 
vector space, linear space, 7, 11-12, 173, 177, 
208, 219, 247^18, 314, 638, 644, 650, 
654-55, 657-58, 884 
vector spaces, completeness, 654-58 
vector spherical harmonics, 813-16 
vector transformation law, 21 
velocity of electromagnetic waves in a dispersive 
medium, 997-99 
vibrating string, 1074 
vibration, normal modes of, 233-34 
vierergruppe, 292-93, 296 
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Volterra equation, 1005-6 

volume integrals, 57-58 

von Staudt-Clausen theorem, 379 

w 

Wallis’ formula, 399 

wave diffusion equation (Helmholtz diffusion 
equation), 536, 537 
wave equation, 947^4-8 
anomalous dispersion, 999 
derivation from Maxwell’s equation, 52 
Fourier transform solution, 947^4-8 
Laplace transform solution, 948 
wave equation, electromagnetic, 51-53 
wave functions, 624 
spinor, 212 

wave guides, coaxial, Bessel functions, 703^4- 
Weierstrass infinite-product form of T(z), 
499-500 

Weierstrass M test, 349-50 
weight diagram, 257, 258, 260, 265 
weight vectors, 265 
Whittaker functions, 866, 919 
Wigner-Eckart theorem, 273 
WKB expansion, 394 


work, potential, 34, 70-72 
Wronskian, 550 

Wronskian determinant, 579-80 
Wronskian formulas, 702-3 

absence of third solution, 587, 589 
Bessel functions, 102-4 
Bessel functions, spherical, 601, 723 
Chebyshev functions, 582-83, 591 
confluent hypergeometric functions, 868 
Green’s function, construction of, 592, 703 
linear independence of functions, 579-80, 665, 
703 

second solution of differential equations, 
583-87 

solutions of self-adjoint differential equation, 
702 

Y 

Young tableaux for SU(rc), 274-77 

z 

zero-point energy, 732, 826 
zeros, Bessel function, 682 
zeta function, see Riemann Zeta function 



